Data Engineer
- Full-time
- Job Family Group: Product Development
Company Description
Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive.
When you join Visa, you join a culture of purpose and belonging – where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world – helping unlock financial access to enable the future of money movement.
Join Visa: A Network Working for Everyone.
Job Description
We are looking for an individual contributor with deep expertise in building large-scale data processing systems by using the latest database and data processing technologies. This position plays a critical role in enabling the foundations through which Data Scientists, Analysts, and BI Users drive solutions for our Visa clients. The Data Engineer takes responsibility for building and running data pipelines, designing local data frameworks, and catering for different data presentation techniques in order to enable scalable Solution development for the CEMEA region.
The Global Data Science team is the engine of analytics at Visa, this is a high-performing team of data scientists, data analysts, statisticians, and business analysts from a variety of countries – serving the Asia Pacific, Central Europe, Middle East and Africa geographies.
As a Data Engineer you will be responsible for designing, developing and delivering data solutions through best in class architected solutions to enable the development of the Visa Portfolio Health Check. This is an individual contributor role and currently has no line management responsibility.
Principal Responsibilities
- Create and maintain optimal data pipelines based on our Global Technology Stack
- Contribute to the technical design, architecture and development of data artifacts to support building new scalable solutions for our clients
- Apply software engineering and CI/CD principles to our data pipeline design in order to ensure modularity, scalability and governance across our solutions
- Data validation and application of software testing techniques in a data-driven context
- Continuous improvement and maintenance of existing pipelines based on business need and changes in our technology landscape
- Integration of analytical solution output with downstream corporate systems to facilitate delivery and consumption
- Executing medium to large analytic projects along with rest of the stakeholders in the Visa data science team and Client team
Leadership Competencies
- Exhibits intellectual curiosity and a desire for continuous learning
- Demonstrates integrity, maturity and a constructive approach to business challenges
- Role model for the organization and implementing core Visa Values
- Respect for the Individuals at all levels in the workplace
- Strive for Excellence and extraordinary results
- Use sound insights and judgments to make informed decisions in line with business strategy and needs
- Leadership skills include an ability to allocate tasks and resources across multiple lines of businesses and geographies. Leadership extends to ability to influence senior management within and outside Analytics groups
- Ability to successfully persuade/influence internal stakeholders for building best-in-class solutions
Qualifications
• 5 - 8 years application development and support experience.
• Deep knowledge of distributed data architecture, parallel processing frameworks, commonly-used BI tools, and job scheduling applications
• Experience creating production software/systems in Python and/or Scala, and a proven track record of identifying and resolving performance bottlenecks for production systems.
• Experience with complex, high volume, multi-dimensional data.
• Good understanding of the Payments and Banking Industry including aspects such as consumer credit, consumer debit, prepaid, small business, commercial, co-branded and merchant
• Demonstrated ability to incorporate new techniques to solve business problems
Technical Expertise
• Qualification in Computer Science or Engineering ideal.
• Certification in Hadoop (Cloudera or Hortonworks) and Apache Spark ideal.
• Experience in developing production systems, with software engineering governance practices in place e.g, Object orientation, functional programming, unit testing frameworks, CI/CD and job scheduling technologies
• Data acquisition and provisioning through various modes and channels, e.g., Batch, real-time, event-driven architecture, APIs, etc.
• Working knowledge of Hadoop ecosystem and associated technologies, e.g., Hadoop, Hive, Apache Spark, Kubernetes, Kafka, etc.
• Advanced experience in writing and optimizing efficient SQL queries and scripts, Scala experience is ideal
• Excellent communication skills in both spoken and written English (upper intermediate plus)
Business Experience
• Results-oriented with strong problem solving skills and demonstrated intellectual and analytical rigor
• Good business acumen with a track record in solving business problems through data-driven methodologies.
• Team oriented, collaborative, diplomatic, and flexible style, with the ability to tailor data driven results to various audience levels
• Very detailed oriented, is expected to ensure highest level of quality/rigor in reports and data analysis
• Exhibits intellectual curiosity and a desire for continuous learning