Principal Data Engineer

  • Full-time
  • Job Family Group: Technology and Operations

Company Description

Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive.

When you join Visa, you join a culture of purpose and belonging – where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world – helping unlock financial access to enable the future of money movement.

Join Visa: A Network Working for Everyone.

Job Description

You may have noticed that payment has become a very active/hot area in the last several years. Given the strong demands and innovation, this will be a very exciting area in the next 5 to 10 years. VISA is clearly a very strong leader in the payment industry, and is in a fast pace of technology transformation. For a payment system to work well, advance technologies such as data platform, big data, data mining, machine learning, cloud, etc. are critical. In VISA, we have all of these. The Data Platform Department is in the center for many of these technologies and development.

The Data Platform team is a key component of Visa's Technology organization that provides an enriched and valuable ecosystem of data platform and data services that drive innovation for our partners and clients, within Visa and globally. Data is the most valuable asset in Visa. The Data Platform Department is dedicated to develop advanced technology (e.g. Cloud, Machine Learning and Big Data), systems and services to make data secure, high quality, rich, fast, and easy to use, therefore enabling Visa the ability to leverage its data asset in an effective and timely manner to maximize technology/business development and differentiate Visa from others in the payment industry. The department maintains tens of petabytes of data supporting over 100 services for various internal lines of business and external clients.

Position Summary:

Visa is seeking a Chief Data Architect in the Data Platform department to act as one of key technology leaders to build and manage Visa's data and technology assets in the data Platform, build and maintain Visa Data Lake, enable wide range of application to be deployed and operate in Data Lake.

This individual will act as a trusted technical advisor and strategic thought leader to the Data Platform department. The successful candidate will be comfortable navigating challenging forces in the dynamic payments space especially in big data and data platform areas and be comfortable in a fast-paced environment with significant changes; developing/implementing strategies and processes that enable the organization to innovate and grow fast. You will have the opportunity to lead, participate, guide, and mentor other people in the team on architecture and design in a hands on manner. You are responsible for the strategic and technical direction of Visa Data Platform. This position reports to the Sr. Director of Architecture for Data as a Service team in Data Platform and will be based in Bangalore, India.

Primary responsibilities will include:

  • Provide Architectural leadership and vision for Visa's Data Platform and Data Lake. Develop and maintain architectural roadmap for data products and data services plus ensuring alignment with the business and enterprise architecture strategies and standards. Able to develop, present and explain the value and vision of proposed architectures and solutions to a wide range of audience.

  • Provide leadership and guidance on design and management of data for data applications, formulate best practices and organize processes for data management, governance and evolution. Build processes and tools to maintain high data availability, quality and maintainability.

  • Contribute to the DP strategies and roadmap development to meet business objectives with existing or emerging technologies. Ability to translate business concepts to technical terms. Understands and communicates company goals and objectives.

  • Apply creative thinking/approach to determine technical solutions that further business goals and align with corporate technology strategies, keeping in mind performance, reliability, scalability, usability, security, flexibility, and cost.

  • Define and drive technology standard and best practices in the Data Platform areas, and lead some key projects.

  • Oversee and sign off key architecture artifacts in the group.

  • Articulate technology solutions as well as explain the competitive advantages of various technology alternatives.

  • Collaborate with the key stakeholders, other product development groups and software vendors to identify and define solutions for complex business and technical requirements.

  • Engage with Data Platform customers/partners to understand their needs and provide suggestions/guidance on what data platform techniques are appropriate to solve their problems with pros/cons articulated clearly.

  • Drive internal proof of concept initiatives. When needed, quickly design and implement a prototype of a system or component with a proper architecture, and then hand over to (may lead) a small group of devs to finish.

  • Provide mentorship and help team growth especially on technical side.

Qualifications

Basic:

  • 15 years+ of work experience with a Bachelor's Degree; 

Deep experience in:

  • Architecting Data Platforms based on Hadoop to deal with PetaByte Scale Data
  • SQL/noSQL technology. Familiar with Databases like Oracle, DB2, SQL Server, etc.
  • ETL, Data Warehousing, Metadata management, Data Governance
  • Web Services (REST/ SOAP)
  • Open source contributions

Preferred:

  • Experienced technology leader with a minimum of 15+ years of software development experience including 5+ years of data application or data platform architecture experience with deep technology expertise in the following:
  • Architecture design and development of large scale data platforms and data application with simple solutions
  • Expertise in design and management of complex data structures and data processes
  • Expertise in metadata management, reference data management. Expertise in streaming and batching data processing and efficient and performing organization of data in devices set of data platforms.
  • Deep knowledge and hands on experience on big data and cloud computing technologies including Hadoop, Spark, Hive, HBase, etc.
  • Extensive hands on design/coding experience/skills using languages like Java, Strong on elegant coding, can write very solid prototypes or core components quickly.
  • Strong service architecture and development experience with high performance and scalability
  • Technical background in data with deep understanding of issues in multiple areas such as data acquisition and processing, data management, distributed processing, and high availability is required. Experience in statistics, data mining, machine learning and operational excellence of production systems is a plus.
  • Strong at technical goal setting for a project with actionable success metrics. Good knowledge and experience on measuring a service from user experience angle.
  • Strong on driving for results and self-motivated, strong learning mindset, with good understanding of related advanced/new technology. Keep up with the technology development in the related areas in the industry, which could be leveraged to enhance current architectures and build durable new ones.
  • Outstanding verbal, written, presentation, facilitation, and interaction skills, including ability to effectively communicate architectural issues and concepts to multiple organization levels and executive management.
  • Experience on data application/platform instrumentation, measurement, log data processing, and monitoring.
  • Experience on distributed application performance engineering, mobile application development, database design, middleware, user interface development, and information security engineering
  • Bachelor's degree in Computer Science or related technical discipline required; advanced degree is a plus.
  • Strong leadership and team player.
  • Strong skills on mentoring/growing junior people
  • Payment industry experience is a plus.

Travel Requirements This position requires the incumbent to travel for work 15% of the time.

Mental/Physical Requirements This position will be performed in an office setting.  The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers, and reach with hands and arms.

Additional Information

Visa has adopted a COVID-19 vaccination policy. As a condition of employment, all employees based in the country where this job is located are required to be fully vaccinated for COVID-19, unless a reasonable accommodation is approved or as otherwise required by law.
Privacy Policy