Senior Data Engineer

  • Full-time
  • Department: Technology
  • Employment Type: Permanent

Company Description

Fastmarkets is an industry-leading price-reporting agency (PRA) and information provider for global commodities, providing price data, news, analytics and events for the agriculture, forest products, metals and mining and new-generation energy markets.

Fastmarkets' data is critical for customers seeking to understand and predict dynamic, sometimes opaque markets, enabling trading and risk management. Fastmarkets is a global business with a history dating back to 1865 and is built on trust and deep market knowledge. It has more than 700 employees spread across global locations in the UK, US, China, India, Singapore, Brazil, Belgium, Bulgaria, Finland and beyond. 

Job Description

JOB PURPOSE

Fastmarkets Data team is a new and dynamic function supporting the business in developing and delivering our data strategy through data, insights, and business intelligence. Highly valued by the business we are working hard to transform data function and ways of working.

Reporting directly to the Data Platform & AI Manager, we are seeking an experienced Data Engineer to step up into a senior role within our DataOps team. This is a fantastic opportunity for an internal candidate to grow into senior-level responsibilities at the start of our journey to bring Data, BI, Analytics, and Insights together into a high performing workstream in its own right.

The Senior Data Engineer will operate in a dual capacity, splitting time approximately 50/50 between hands-on data engineering work and senior-level responsibilities. Beyond core technical delivery, this role introduces key senior responsibilities including team oversight, mentoring, and acting as a technical bridge between engineering teams and business stakeholders. The successful candidate will be instrumental in driving the creation and delivery of Level 2 (L2) data products for MI and Operational reporting teams, whilst continuing to contribute directly to technical delivery and fostering a collaborative, growth-oriented team culture.

PRINCIPLE ACCOUNTABILITIES

Core Data Engineering Responsibilities (~50%)

  • · Design, develop, and maintain scalable and efficient data pipelines using Python, DBT, Dagster, and other relevant technologies (i.e. Fivetran, Airbyte, Meltano or similar)
  • · Build and maintain data transformation workflows using DBT, ensuring high-quality, well-tested, and documented analytics code
  • · Collaborate with data scientists, BI engineers, Data Analysts, and other stakeholders throughout the business to understand data requirements and translate them into technical solutions
  • · Optimize data workflows for quality, performance, reliability, and scalability
  • · Implement data quality checks and monitoring to ensure data integrity and reliability
  • · Embrace DataOps approach, delivering "data-as-code"
  • · Troubleshoot and resolve data pipeline issues in a timely manner
  • · Stay updated with the latest technologies and best practices in data engineering. Ability to recommend improvements to existing processes and systems

Additional Senior Responsibilities (~50%)

Team Oversight & Technical Leadership

  • · Provide technical guidance and oversight to data engineering team members, setting standards for code quality, architecture decisions, and best practices
  • · Conduct code reviews and provide constructive feedback to peers and junior engineers
  • · Facilitate knowledge sharing sessions and promote a culture of continuous learning
  • · Act as an escalation point for complex technical challenges
  • · Support the Data Platform & AI Manager with technical input on prioritization and planning decisions

Stakeholder Management & L2 Data Product Delivery

  • · Serve as key technical liaison between data engineering team and MI/Operational reporting teams
  • · Gather, analyze, and translate business requirements into technical specifications for L2 data products
  • · Lead the design and delivery of L2 data products that meet stakeholder needs for management information and operational reporting
  • · Manage expectations and communicate progress, risks, and dependencies to stakeholders
  • · Ensure delivered data products meet quality, performance, and usability standards
  • · Participate in roadmap planning and prioritization discussions with business stakeholders

Mentoring & Development

  • · Lead onboarding process for new data engineers and junior team members
  • · Create and maintain onboarding documentation and learning materials
  • · Provide regular mentoring, coaching, and technical guidance to junior engineers
  • · Support team members in their professional development and skill building
  • · Foster an inclusive and supportive team environment that encourages growth and innovation

 

KEY INTERFACES

  • · Data Platform & AI Manager
  • · Head of Cloud Engineering
  • · MI and Operational Reporting Teams
  • · Data Governance Manager
  • · BI Engineers and Data Analysts
  • · Data Engineering Team Members
  • · Business Stakeholders across Fastmarkets

Qualifications

KNOWLEDGE, EXPERIENCE AND SKILLS

We are looking for an individual who is highly motivated, driven, and have a passion to be part of a fast-paced, successful team. Being a strong team player is also important as well as someone who is happy to work flexibly and eager to grow into senior-level responsibilities.

Core Technical Skills

  • · Azure (transferable skills from AWS/GCP/Digital Ocean will be considered)
  • · Proven experience as a Data Engineer or similar role
  • · Strong proficiency in Python programming language
  • · Strong proficiency in DBT (data build tool) for data transformation and analytics engineering
  • · SQL expertise
  • · Experience with data orchestration tools such as Dagster, Apache Airflow or Prefect
  • · Exposure to Git and CI/CD
  • · Any exposure to Kubernetes a bonus
  • · Hands-on experience with Snowflake Data Cloud platform
  • · Experience building pipelines and ELT process against a wide variety of data sources
  • · Solid understanding of database design principles, data modelling, and ETL processes. Data-Vault knowledge a bonus
  • · Excellent problem-solving skills and attention to detail
  • · Strong communication and collaboration skills
  • · Natural self-starter, with enthusiasm for learning and research

Senior-Level Requirements

  • · Demonstrated ability to work independently and take ownership of complex technical challenges
  • · Strong stakeholder management skills with ability to communicate technical concepts to non-technical audiences
  • · Experience or willingness to work directly with MI, analytics, or reporting teams to deliver business-critical data products
  • · Ability to balance hands-on technical delivery with emerging senior-level responsibilities
  • · Enthusiasm for mentoring and supporting the development of other engineers
  • · Track record of promoting best practices and technical excellence in your work
  • · Strong documentation skills and commitment to knowledge sharing
  • · Growth mindset and willingness to take on increasing leadership responsibilities

Preferred Qualifications

  • · Degree in related technology field OR 5+ years' experience in similar role with professional qualifications (e.g. SnowPro Core)
  • · Direct experience with modern data platforms (Snowflake, Databricks, Synapse or similar)
  • · Can demonstrate experience working on a project that delivered transformational change, or exceptional business value – or personal technology project/hobby that required significant dedication to achieve the outcome
  • · Experience working in a fast-paced Agile development environment
  • · Experience building and delivering L2 data products for business intelligence or operational reporting
  • · Any experience in mentoring, coaching, or supporting junior team members
  • · Demonstrated ability to integrate AI tools (e.g., GitHub Copilot, ChatGPT, Claude) into development workflows

Additional Information

Our Values

Fastmarkets people come from all different walks of life. It’s this mix of brilliant personalities, experiences and insights that gives us that warm, open, and friendly culture you can feel as soon as you meet us. But however wonderfully different we all are, there are six things we all have in common – and they form our Fastmarkets values.

Created by our own employees to reflect some of the personal traits that Fastmarkets people have, our values are key to what makes our culture unique. They reflect who each of us are and they're embedded in everything we do. Our values are:

  • METRICS DRIVEN. We use insights to improve our customers’ experience and our business performance
  • ACCOUNTABLE. We are accountable to ourselves and those we work with: we keep our promises and get things done
  • GROWTH MINDSET. This value enables us to be nimble to the changing realities and operate with a sense of urgency
  • INCLUSIVE. We are inclusive and respectful, celebrating each of us and giving everyone a deep sense of belonging with the desire to bring their best self to work every day.
  • CUSTOMER CENTRIC. We are customer-centric in all that we do
  • COLLABORATIVE. We are collaborative, able to work across teams and capitalise on the diversity of intellect, perspectives, and experiences.

We are committed to ensuring all candidates feel welcomed and supported. Should your application advance and you require accommodations for the interview process, please inform us so we can make the necessary arrangements.

You’ve read a little about us – now it’s over to you!

If you like what you’ve read so far and think you can see yourself as a Fastmarkets person, it’s time to fill in your application form. This form is an important part of the selection process: it’s used to determine whether or not you’ll be chosen to have an interview and acts as a basis for the questions we’ll ask you on the day.

It’s vital that you try to capture all the relevant information we have asked for on the form so we can get a good feel for who you are and why you’re great.

Privacy Policy