Senior Staff Engineer - Cloud Architect

  • Full-time
  • Service Region: Others

Company Description

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at a scale — across all devices and digital mediums, and our people exist everywhere in the world (17500+ experts across 36 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!

Job Description

  • Cloud Architect for Azure Databricks designs and manages data platforms on Azure, leveraging Databricks for unified data science, engineering, and analytics, focusing on the two-plane architecture (Control & Data Planes), data governance (Unity Catalog), security (Entra ID, Key Vault), cost optimization, and building reliable Lakehouse solutions using Microsoft's Well-Architected Framework principles for data pipelines (Bronze, Silver, Gold layers) and integration with other Azure services like Synapse, Power BI, and Azure Monitor.
  • Architecture Design: Designing end-to-end data solutions, from ingestion to consumption, using Databricks'''' Lakehouse Platform on Azure.
  • Control Plane vs. Data Plane: Understanding the separation where Databricks manages the backend (Control Plane) while the customer owns the compute and data (Data Plane) within their Azure subscription, ensuring data residency and security.
  • Data Governance: Implementing Unity Catalog for centralized access control, lineage, and security across data assets.
  • Security & Identity: Integrating with Microsoft Entra ID (Azure AD) for SSO, using Azure Key Vault for secrets, and Microsoft Defender for Cloud for protection.
  • Performance & Cost: Optimizing cluster configurations (classic vs. serverless), storage (ADLS Gen2), and resource usage for cost efficiency.

Qualifications

Must have Skills: Cloud development (Strong), Cloud architecture (Strong), Databricks

Privacy NoticeImprint