Lead- Cloud Data Engineer

  • Full-time
  • Sub Division: Data Analytics and Artificial Intelligence
  • Division: GCOO

Company Description

Join the UAE’s largest bank and one of the world’s largest and safest financial institutions. Our focus is to create value for our employees, customers, shareholders and communities to grow through differentiation, agility and innovation. We are looking for top talent and your success is our success. Accelerate your growth as you help us reach our goals and advance your career. Be ready to make your mark a top company, in an exciting & dynamic industry. 
 

Job Description

Job Purpose 

Role is required to support the transformation programme which aims at modernizing the data platforms estate for the bank. Traditional on-premises data warehouse and data lake should be transformed to meet the scalability, agility and modern capabilities needs as the bank embarks on the journey to implement the industry best analytics and AI services, while ensuring the stability, resilience and data security remains intact.

Key Accountabilities

  • Lead Data Engineering efforts / teams working jointly to deliver the target platform and applications & data migration.
  • Analyze and understand the current data platforms architecture, and work with the multiple teams to plan and execute the migration of the data and workloads to Cloud.
  • Re-architect/Innovate the data ingestion and data engineering workloads considering the velocity requirements, optimized operational cost, platform performance and time to market for any change.
  • Engineering re-usable patterns for platform/Cloud Infrastructure and application workloads
  • Produce high level and low-level design for the target data platform estate on hybrid cloud topology.
  • Establish best practices to design and develop the E2E Data Pipeline: data transformation, ingestion, processing, and surfacing of data for large-scale applications.

Qualifications

  • Bachelor’s degree in computer science, Computer Engineering, IT, or related fields
  • 7+ years of overall experience with at least 2 years of leading teams delivering data lakes, data warehouses, data lakehouse
  • Proficiency in at least one of the programming languages viz. Python, Scale
  • Minimum 2 years’ experience on developing and deploying workloads on Apache Spark
  • SQL skills are must
  • Experience in deploying Lakehouse on Azure/AWS
  • Must have Cloud DevOps skills to be able to build and maintain the infrastructure as a code,
  • Experience with CI/CD on Cloud for application artefacts
  • At least 4 years of experience in Cloud, preferably Azure
  • Communication skills to be able to explain the technical scenarios to senior IT and business stakeholders.
  • Experience in agile way of working.

Additional Information

#LI-KS1

Privacy PolicyImprint