Senior Data Engineer

  • Full-time

Company Description

At Intellihub, we're not just about metering and data solutions – we're about our people. Our team of passionate individuals drives our mission to simplify the energy transition and make a real difference in the lives of millions of people across Australia and New Zealand.  But our success is not just measured by numbers. It's measured by the diverse and inclusive culture we foster within our team, where everyone is valued and given equal opportunities to thrive in a positive, safe and productive workplace.

Providing smart metering devices and services to over 50 energy retailers across ANZ, our reach is growing rapidly. But the true breadth of what we do goes beyond the meter, touching everything from solar to water, virtual power plants to electric vehicle charging.

Job Description

As a Senior Data Engineer at Intellihub, you’ll design, build, and maintain high-performing data pipelines and integration frameworks that power our enterprise data platform. You’ll optimize performance, ensure seamless data integration, and drive efficiency across our data ecosystem while embracing innovative technologies like Generative AI (GenAI) and advanced analytics. In addition to defining and implementing improvements to data engineering frameworks and standards, you’ll play a key role in mentoring junior engineers, fostering growth, and building a culture of excellence. Your work will empower teams with timely, actionable insights, unlocking new opportunities and driving business success. If you’re passionate about data-driven innovation and eager to make a meaningful impact, this is your chance to lead and inspire.

  • Building and maintaining efficient data pipelines to support the collection, transformation, and loading (ETL) of data into data warehouses or data lakes.
  • Work closely with business analysts to build data solutions that allow them to obtain insights from our data and use those to support important decision. Convert solution designs into detail data pipeline designs.
  • Develop reusable ingestion and data transformation frameworks in python, spark or SQL.
  • Write reusable unit and functional test scripts and automate testing.
  • Use CI/CD Tools like Bitbucket to build, test, deploy the code and automated job schedules.
  • Identify and implement improvements on data engineering processes, frameworks, documentations, and deployed code. Optimising code and ensuring we are getting the best out of the Data Platform.
  • Mentor and guide our junior data engineers, fostering their growth and development.
  • Promote a safe and healthy work environment and contribute to continual improvement in quality and performance at Intellihub by complying with all relevant policies and procedures.

Qualifications

  • Proactive, positive, flexible, and resilient
  • Passionate about data, software engineering and innovation
  • Experience in Agile Program Increment / Scaled Agile Framework, backlog grooming to enable continuous delivery.
  • Highly motivated to identify and solve problems.
  • Experience in implementing data pipelines and solutions on cloud platforms (e.g. AWS, Databricks, Spark, DBT)
  • Experience in Data Warehouse, Data Lake and/or Data Lakehouse implementation
  • Advanced knowledge of SQL and Python
  • Knowledge in Data modelling techniques and practices used for Data Warehouse and Data Mart application
  • Expertise in using various AWS services and their related integration.
  • Basic understanding of Infrastructure as Code frameworks like Terraform, AWS Cloudformation.
  • In depth knowledge of large-scale data sets including both structured and unstructured data
  • Implementation experience with DevOps and agile delivery (code management, CI/CD, modular design)
  • Tertiary qualified with a degree in Information Technology or Engineering, or a related discipline

Additional Information

Sound exciting? Apply now and be part of a team that's shaping the future of energy. For further information, please contact Chelsea at [email protected]

Privacy Notice