Lead Data Engineer, Data Platform

  • Full-time
  • Job Family Group: Technology and Operations

Company Description

Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive.

When you join Visa, you join a culture of purpose and belonging – where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world – helping unlock financial access to enable the future of money movement.

Join Visa: A Network Working for Everyone.

Job Description

You may have noticed that payment has become a very active/hot area in the last several years. Given the strong demands and innovation, this will be a very exciting area in the next 5 to 10 years. VISA is clearly a very strong leader in the payment industry, and is in a fast pace of technology transformation. For a payment system to work well, advance technologies such as data platform, big data, data mining, machine learning, cloud, etc. are critical. In VISA, we have all of these. The Data Platform team is in the center for many of these technologies and development.

The Data Platform team is a key component of Visa's Technology organization that provides an enriched and valuable ecosystem of data platform and data services that drive innovation for our partners and clients, within Visa and globally. Data is the most valuable asset in Visa. The Data Platform team is dedicated to develop advanced technology (e.g. Cloud, Machine Learning and Big Data), systems and services to make data secure, high quality, rich, fast, and easy to use, therefore enabling Visa the ability to leverage its data asset in an effective and timely manner to maximize technology/business development and differentiate Visa from others in the payment industry. The department maintains over 100 petabytes of data supporting over 100 services for various internal lines of business and external clients.

The Data as a Service (DaaS) Data Assets Group in the Data Platform Department develops techniques, platforms, systems, and services to ensure the data pipeline development and services are efficient, high quality, rich, and easy to use.

Visa is seeking highly energetic, passionate, technology enthusiast for Data Platform team.

The successful candidate will work as a Lead Data Engineer and be part of the Data as a Service team to design and develop solutions for all data requirements. The ideal candidate will bring robust technical strength in developing solutions in extremely high volume, good hands-on to opensource tech stack, low latency ETL workflow design and also bring an excellent understanding of data. This role will participate in design discussions, create solutions, develop programs and ensure successful delivery of business capabilities. This role will assume technical ownership of multiple applications and create robust and scalable solutions.
 
Visa provides a challenging environment of volume, velocity and variety that is rarely matched.

Candidates looking forward to thrive in such environment are encouraged to apply.

Responsibilities:

  • Translate business requirements and source system understanding into technical solutions using Opensource Tech Stack, Big Data & Java etc.
  • Work with business partners directly to seek clarity on requirements
  • Define solutions in terms of components, modules and algorithms
  • Design, develop, document and implement new programs  and subprograms, as well as enhancements, modifications, and corrections  to existing software. 
  • Create technical documentation and procedures for installation and maintenance.  
  • Write Unit Tests covering known use cases using appropriate tools
  • Integrate test frameworks in development process
  • Refactor existing solutions to make it reusable and scalable
  • Work with operations to get the solutions deployed
  • Take ownership of production deployment of code
  • Collaborating with and/or lead cross functional  teams, build and launch applications and data platforms at scale, either for revenue generating or operational purposes
  • Lead a mid size team
  • Come up with Coding and Design best practices
  • Thrive in self-motivated internal-innovation driven environment
  • Adapting fast to new application knowledge and changes
     

Qualifications

  • Master/Bachelor degree in Computer Science, Electrical Engineering, Information Systems or other technical discipline; advanced degree preferred.
  • Minimum of 12+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in leveraging standard development best practice methodologies.
  • Minimum 6+ years of hands-on experience in Hadoop using Core Java Programming, Spark, Hive, PIG scripts, Sqoop, any ETL tool exposure.
  • Need exposure to NoSQL database.
  • Strong knowledge of Database concepts and UNIX.
  • Expertise in Object Oriented Programming Language – Java / Python.
  • Hand-on experience using CI/CD process. 
  • Experience in handling very large data volume in low latency and batch mode.
  • Expertise in Automation will be a value added.
  • Result oriented with strong analytical and problem solving skills.
  • Experience in leading broad initiatives and teams.
  • Works independently with minimal supervision.
  • Experience in handling very large data volume in low latency and batch mode.
  • Strong communication skills with proven ability to present complex ideas and document in a clear and concise way.
  • Should be a Quick learner; self-starter, detailed and in-depth.

Additional Information

Visa has adopted a COVID-19 vaccination policy. As a condition of employment, all employees based in the country where this job is located are required to be fully vaccinated for COVID-19, unless a reasonable accommodation is approved or as otherwise required by law.
Privacy Policy