Data Engineer

  • Full-time
  • Department: Product Development
  • Role Type: Hybrid
  • Employee Status: Regular
  • Schedule: Full Time

Company Description

Experian is the world’s leading global information services company. During life’s big moments — from buying a home or a car to sending a child to college to growing a business by connecting with new customers — we empower consumers and our clients to manage their data with confidence. We help individuals to take financial control and access financial services, businesses to make smarter decisions and thrive, lenders to lend more responsibly, and organizations to prevent identity fraud and crime.

We have 17,800 people operating across 44 countries, and every day we’re investing in new technologies, talented people and innovation to help all our clients maximize every opportunity. We are listed on the London Stock Exchange (EXPN) and are a constituent of the FTSE 100 Index.

Learn more at www.experianplc.com or visit our global content hub at our global news blog for the latest news and insights from the Group

Experian is the world’s leading global information services company. During life’s big moments — from buying a home or a car to sending a child to college to growing a business by connecting with new customers — we empower consumers and our clients to manage their data with confidence. We help individuals to take financial control and access financial services, businesses to make smarter decisions and thrive, lenders to lend more responsibly, and organizations to prevent identity fraud and crime.

We have 17,800 people operating across 44 countries, and every day we’re investing in new technologies, talented people and innovation to help all our clients maximize every opportunity. We are listed on the London Stock Exchange (EXPN) and are a constituent of the FTSE 100 Index.

Learn more at www.experianplc.com or visit our global content hub at our global news blog for the latest news and insights from the Group

Job Description

Data Engineer

5-9 years of experience

Tech skills: Python, Pyspark, basics Apache Spark,AWS, AWS Glue, Arora/Postgres,  Docker, Jira, Jenkins

Nice to have: Okta, GraphDB/Neptune, ELK stack, Bitbucket

 

 

Qualifications

Roles and Responsibilities

  • Create and maintain processes to acquire, validate, and enrich data from various sources
  • Design and develop code, scripts and data pipelines that leverage structured and unstructured data using python
  • Work with Data Integration to build and maintain efficient processes for loading acquired data into our relational, dimensional
  • Work with other teams to identify new sources of data, and estimate feasibility of acquiring specific data sources
  • Experience in SQL Development, specifically with complex queries is a plus
  • Develop Python scripts to filter/cleanse/map/aggregate data.
  • Develop data profiling, deduping logic, matching logic for analysis.
  • 2+ years of programming experience in PySpark for data processing and analysis is a plus
  • Ability to motivate, teach and train other team members
  • Strong collaboration and communication skills (both written and verbal)

Additional Information

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Privacy Policy