Azure Data Engineer
- ., Warren, NJ, United States
Our client is a global leader in consulting, technology and outsourcing solutions. We enable clients, in more than 30 countries, to stay a step ahead of emerging business trends and outperform the competition. We help them transform and thrive in a changing world by co-creating breakthrough solutions that combine strategic insights and execution excellence. With US$8.25 billion in annual revenues and 160,000+ employees our client is Building Tomorrow's Enterprise
Position Type: Full Time/Contract
Location: Warren, NJ, United States
Designing, implementing, and delivering batch data pipelines.
Analyze data requirements, complex source data, data model and determine the best methods in extracting, transforming and loading the data.
Writing clean and concise code that is well-tested, easy to maintain, and consistent with existing patterns in our codebase.
Clearly communicate technical information to both technical resources and business stakeholders.
Work in collaborative and Agile environment to deliver data products.
Strong data analytic skills related to working with structured and unstructured datasets.
Strong knowledge of Data warehousing/ETL standards and best practices.
Experience working with Dimensional Data Model and data pipelines in relation with the same.
Advanced working SQL knowledge and experience working with OLAP databases like SQL Datawarehouse.
Experience with Microsoft Azure public cloud and preferably components : Azure Data Lake, Azure Data Factory, SQL Server (SQL DB, SQL DW).
Experience working with Big data frameworks especially Spark, distributed processing.
Experience working with Databricks or other Hadoop distributions.
Hands on experience Designing and developing Data Pipelines for Data Ingestion or Transformation using Python(PySpark)/Spark SQL.
Experience working with version control GitHub and CI/CD pipelines using Azure DevOps is a plus.
All your information will be kept confidential according to EEO guidelines.