Senior Data Engineer
- Castlefield Rd, Reigate RH2, UK
- Salary: Competitive
- Department: Data
- Working Hours: 35
Here at esure Group, we’re no strangers to change. As one of the industry leaders in the insurance business, striving to become a world class digital insurer, we’re getting ready for more. It’s creating great new opportunities for innovative and talented industry professionals to join us at a pivotal point in our development.
It’s an opportunity you simply don’t want to miss. You can expect our investment in you to include a highly competitive package, career and development opportunities and flexible benefits built around you and your lifestyle.
An exciting permanent role for a Lead Data Engineer has emerged within our growing Data Platform team in Reigate!
You'll develop and lead the data engineering stack at esure, whilst being responsible for the ingestion, storage, and development of data pipelines into our core data platform.
The day to day:
Modifying and improving data engineering processes to handle ever larger, more complex, and more types of data sources and pipelines, you'll evaluate and experiment with novel data engineering tools and advise IT leads and partners about new capabilities to provide efficient solutions for particular technical problems or designated use cases.
Transforming data into a common domain model for end user access (be it data science needs, data products or BI), you will integrate data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
You'll be working alongside our Architects on the best design for data products whilst considering the future state of data assets and how we can try to future-proof ourselves for working with different data types.
Collaboration is key in our aim to build esure's core data platform, so we are looking for someone to provide valuable mentorship to our Junior Engineers.
We'd love you to bring:
Extensive hands-on experience in one or more modern Object-Oriented Programming languages (Java, Scala, Python) including the ability to code in more than one programming language.
Strong hands-on experience applying principles, best practices, and trade-offs of schema design to different database systems, including relational (Oracle, MSSQL, Postgres, MySQL) and NoSQL (HBase, Cassandra, MongoDB)
Hands-on experience implementing batch and real-time data integration frameworks and/or applications in private or public cloud environments (AWS, Azure, GCP, etc.) using various technologies (Spark, Impala, Pandas etc.), including assessing performance, debugging, and fine-tuning those systems
Deep understanding of the latest data engineering methods and processes to develop impactful and reusable patterns and abstractions from enterprise-level data assets
Hands on experience in all phases of data modeling from conceptualization to database optimization
Demonstrated ability to perform the engineering necessary to acquire, ingest, cleanse, integrate, and structure substantial volumes of data from multiple sources and systems into enterprise analytics platforms
Ability to craft and optimize queries to build scalable, modular, efficient data pipelines
Ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate data sets
Experience delivering production-ready data engineering solutions, including requirements definition, architecture selection, prototype development, debugging, unit-testing, deployment, support, and maintenance
What we will offer you in return:
- A competitive salary that recognises your skills, experience and potential
- 25 days annual leave plus 8 flex days (equivalent to bank holidays to be taken as and when suits you)
- Bonus scheme
- Flexible working – including hybrid working post covid
- Staff discount on our products
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.