Azure Data Engineer
- Full-time
Company Description
UNIFY Dots is a global technology and software solutions company and Microsoft Solutions partner specializing Dynamics 365 and Microsoft Big Data cloud-based solutions. We are seeking an experienced Azure Data Engineer to join our dynamic team. This role is ideal for someone who has a strong foundation in data processing technologies and methodologies, including experience with Databricks, ETL processes, data warehousing, and analytics platforms. As a Data Engineer, you will play a crucial role in the development and maintenance of our data infrastructure, ensuring the reliability and accessibility of data for decision-making and operational efficiency.
Job Description
- Design, construct, install, test, and maintain highly scalable data management systems.
Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI.
Ensure systems meet business requirements and industry practices by integrating new data management technologies and software engineering tools into existing structures.
Create robust data pipelines using ETL processes that follow best practices in data modeling, ingestion, modeling, data cleansing, data enrichment, and transformation.
Utilize Azure cloud services effectively to deploy and maintain scalable data infrastructure.
Collaborate with data Analysts, data scientists and architects on several projects, ensuring optimal data delivery architecture is consistent throughout ongoing projects.
Engage with stakeholders and team members to assist with data-related technical issues and support their data infrastructure needs.
Develop high-performance algorithms, predictive models, and prototypes using Python and PySpark.
Qualifications
- Bachelor’s or master’s degree in computer science, Engineering or Information Technology.
3-5 years of experience in a Data Engineer role, with a deep understanding of data structures, data modelling, and software architecture.
Proficient in using Azure Databricks for developing scalable data processing pipelines.
Extensive experience with Azure, including Azure Data Factory, Azure Data Lake, Azure Synapse, Fabric and other services.
Expertise in ETL tools and processes, and data warehousing solutions.
Strong analytical skills with the ability to collect, organize, analyse, and disseminate significant amounts of information with attention to detail and accuracy.
Experience with Power BI and other visualization tools to convert raw data into actionable insights.
Excellent problem-solving skills and ability to work in a dynamic and agile environment.
Strong written and verbal English communication skills
Certifications Required
Azure Data Engineer Associate
Databricks Certified Data Engineer Professional
Additional Information
BENEFITS:
- Market competitive compensation.
- Medical Insurance.
- Work Laptop
- People before Profit Culture that values team members over financial numbers.