Azure Databricks Data Engineer / Data Architect
- Full-time
Company Description
Miratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-driven organization and our culture of Relentless Performance has enabled over 99% of Miratech's engagements to succeed by meeting or exceeding our scope, schedule, and/or budget objectives since our inception in 1989.
Miratech has coverage across 5 continents and operates in over 25 countries around the world. Miratech retains nearly 1000 full-time professionals, and our annual growth rate exceeds 25%.
Job Description
We are looking for experienced Azure Databricks Data Engineer / Data Architect to design, build, and optimize scalable data platforms in a modern cloud environment. This role involves hands-on development of ETL/ELT pipelines, data quality automation, cloud migration, and implementation of governance frameworks supporting analytics, BI, and ML use cases.
Key Responsibilities
- Architect, design, and implement scalable data solutions on Azure and Databricks.
- Build, automate, and orchestrate robust ETL/ELT pipelines using CI/CD best practices.
- Ensure data quality through automated unit, integration, and validation testing.
- Manage data ingestion and integration from on-premise systems to cloud environments.
- Implement and maintain Data Governance frameworks using Azure Purview and Unity Catalog.
- Optimize cloud data architectures for performance, security, and cost efficiency.
- Collaborate with analytics, BI, and ML teams to ensure high-quality data availability.
- Monitor and maintain data platform reliability, scalability, and compliance.
Qualifications
- Strong proficiency in Python and Apache Spark for large-scale distributed data processing.
- Solid experience with SQL and NoSQL databases, including data modeling and query optimization.
- Hands-on experience designing workflows using data pipeline orchestration tools (e.g., ADF, Airflow, Databricks Workflows).
- Experience with cloud-native data platforms, ideally in Azure.
- Familiarity with Infrastructure as Code (IaC) tools such as Terraform or ARM templates.
- Understanding of data quality frameworks, testing methodologies, and CI/CD pipelines.
- Exposure to Business Intelligence (BI) and Machine Learning (ML) scenarios, ensuring data readiness for advanced analytics.
- Strong analytical, problem-solving, and communication skills.
Nice to Have
- Experience with Microsoft Azure ecosystem (Azure Data Factory, Synapse, Azure Storage, Azure Functions).
- Hands-on experience with Databricks (Delta Lake, Unity Catalog, Workflows, Optimizations).
- Relevant certifications (e.g., Azure Data Engineer, Databricks Data Engineer Associate/Professional).
Additional Information
We offer:
- Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
- Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
- Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
- Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.