Sr. Data Engineer
- Cleveland, OH, USA
Let’s face it. Everyone prefers shopping in their pajamas at home over traveling to the mall. CardinalCommerce, a Visa company, works to make online shopping as safe and easy as possible. For over two decades, we’ve been bringing merchants, issuers, and shoppers together in an experience where everybody wins. With singular focus, proven technology, and dedicated service, we are continuously raising the bar for payment authentication around the world. We put authentication first because we believe digital commerce should be safe, rewarding and engaging for everyone involved in the process.
Join us on this journey. At Cardinal, we’re a group of genuine, dependable, and hardworking people who are treated right with flexible work schedules, a fun company culture and unbeatable benefits. See why we’re one of the leading FinTech companies in Northeast OH.
As a Senior Data Engineer, you are given the ability to work with large data sets using some of the newest technologies including Spark, Kafka, Airflow, Elastic-search all in a cloud environment. You will aid in defining the vision and direction of the Data Engineering team, helping to move us toward near-real-time data consumption, anomaly detection and on-the-fly analysis.
What You’ll Do:
You are responsible for the consumption of data from a variety of sources to a variety of end storage locations, maintaining a fast, efficient data pipeline, and supporting development, analytics and business teams in their data needs. You would be expected to stay current with best practices and tools in the industry and be able to assimilate new technologies quickly.
You will be expected to develop, maintain and monitor ETL jobs and building systems to ease this work. The position will give you the opportunity to work with all groups in Cardinal to provide necessary data for their work and help them understand the underlying data to allow them to make data driven decisions.
What we need you to have:
Minimum of a Bachelor’s degree in Computer Science, Information Systems or other related field
o In lieu of degree, a high school diploma/equivalent with four or more years related experience and/or training or equivalent combination of education and experience will be considered
5+ years of experience in Java, Scala or Python
2+ years of experience with Spark
3+ years of experience with SQL
Strong independent development skills
What we would prefer you to have:
Experience using Spark, developing in Python or Scala, knowledge of databases including warehousing and data lakes, strong development skills, ability to design solutions and communicate designs
Kafka experience as this is the future of our work and vital to our team vision
Strong abilities in both Python and Scala, experience using and administering Kafka, experience using Elasticsearch, experience developing visualizations in Kibana and Grafana
Visa will consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.