2024-7288_Data Engineer

  • Full-time

Company Description

AGSI was incorporated in April 2016. We are committed to supporting the goals of Arch divisions through exceptional service delivery. We pride ourselves on maintaining flexibility and responsiveness to adapt to business unit and industry demands while focusing on sound project management. We are dedicated to growing and developing our employees as we build strong teams with strategic leadership.

Job Description

JOB SUMMARY

As a Data/QA Engineer in our Enterprise Data department, you will be responsible for creating and managing automated tests to identify issues with the ETL process to ensure the quality of data in the Enterprise Data Warehouse.

The role involves working together with the onshore Enterprise Data team to decide on the required tests on the process, automate them through creating stored procedures, custom dbt tests and scheduling these as part of the ETL process which loads data from source into the EDW.

  • Use dbt to build tests that ensures the ETL process is working as intended
  • Automate the common data validation testing by the QA through creating macros in dbt or Python script
  • Build and monitor automated system health checks
  • Collaborate with Enterprise Data Engineers to investigate root cause of issues and suggest resolutions.
  • Orchestrate data testing solutions using airflow
  • Be able to support the team in doing releases

Qualifications

Required Skills/Experience

  • Solid understanding of principles and practices associated with agile product model environment.
  • Solid understanding of SQL and ability to use SQL tools to query a database to retrieve data. (must have)
  • Experience with Windows, Web Applications and/or Web Service
  • Experience using JIRA or similar agile tools. 
  • Experience with Python development (must have)
  • Experience with API Development
  • Application support experience
  • Ability to clearly communicate across multiple teams, and the ability to communicate and escalate major issues when appropriate.
  • Experience in Github (must have)

Desired Skills/Experience

  • Strong SQL and data transformation skills
  • Understanding of ETL/ELT process fundamentals (nice to have)
  • Experience in dbt, snowflake, airflow (Nice to have)
  • Willing to do automation for data testing

Additional Information

  • Required

    Bachelor’s degree in computer science or equivalent work experience.