Lead Data Engineer (Director Level), Data Platform (Data-as-a-Service)

  • Full-time
  • Job Family Group: Technology and Operations

Company Description

Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive.

When you join Visa, you join a culture of purpose and belonging – where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world – helping unlock financial access to enable the future of money movement.

Join Visa: A Network Working for Everyone.

Job Description

As a Lead Engineer in Data Platform, you will be a technical leader for the Data-as-a-Services development team based in Bangalore, India. You will be responsible and accountable for creating a product tasked with creating core datasets for Visa’s transactions. Visa is the world’s largest processor of credit and debit transactions and the platform you build will process hundreds of billions of transactions records every year and serve to deliver clean and enriched data to Visa and other financial institutions. You will also own systems responsible for all aspects of data governance required to deliver high quality and mission-critical data to Visa and its partners. This role will lead design discussions, build and deploy solutions to ensure successful delivery of business capabilities. Visa provides a challenging environment of volume, velocity and variety that is rarely matched.  This position will report to the Sr. Director of Data-as-a-Services development based in Bangalore.

Primary Responsibilities

  • Take complete end-to-end ownership of one or more applications.
  • Translate business requirements into technical solutions.
  • Responsible for the design and implementation of an innovative, scalable, and distributed systems that take advantage of technology to allow standardization, security, timeliness and quality of data.
  • Design and deploy data and pipeline management frameworks built on top of open-source components, including Hadoop, Hive, Spark, HBase, Kafka streaming and other Big Data technologies.
  • Work in and promote an agile development culture focused on high quality code development and deployment to production.
  • Champion Design and Coding best practices while technically leading a small team.

Qualifications

12+ years of work experience with a bachelor’s degree, or at least 8 years of work experience with a master’s degree, or 5 years of work experience with a PhD degree in computer science or related fields.

  • 12+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in leveraging standard development best practice methodologies.
  • Expertise in Object Oriented Programming Language – Java / Python.
  • 6+ years of hands-on experience in Hadoop using Core Java Programming, Spark, Scala, Hive, PIG scripts, Sqoop, any ETL tool exposure.
  • Strong knowledge of Database concepts and UNIX.
  • Experience in handling very large data volume in low latency and/or batch mode.
  • Strong leadership and team player; including mentoring/growing junior engineers
  • Strong on driving for results and self-motivated, strong learning mindset, with good understanding of related advanced/new technology. Keep up with the technology 
  • development in the related areas in the industry, which could be leveraged to enhance current architectures and build durable new ones.
  • Outstanding verbal, written, presentation, facilitation, and interaction skills, including ability to effectively communicate architectural issues and concepts to multiple organization levels and executive management.
  • Quick learner, self-starter, detailed and work with minimal supervision.
  • Payment industry experience (preferred).

Additional Information

Visa has adopted a COVID-19 vaccination policy. As a condition of employment, all employees based in the country where this job is located are required to be fully vaccinated for COVID-19, unless a reasonable accommodation is approved or as otherwise required by law.
Privacy Policy