Azure Data Engineer

  • Contract

Job Description

Position : Azure Data Engineer

Location : Glen Allen, VA

Duration : Long Term (3+ Years)

Experience: 10+ Only

Job Description:

  • Create and maintain optimal data pipeline architecture for enterprise big data and analytics in a cloud based big data environment
  • Design and assemble large, complex data sets that meet functional / non-functional business requirements.
  • Implement internal process improvements in data analytics: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure and workflows required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.
  • Build analytics applications that utilize the data pipeline to provide actionable insights into key business performance metrics.
  • Create tools and processes to keep sensitive data, including PHI and PII data separated and secure across clients.
  • Work with data and analytics experts to strive for greater functionality in our data systems to help make us a market leader in big data.

 

    Qualifications

     

    • 5+ years of Experience with Azure Data Factory, SSIS, SAS, Informatica or other ETL tools including building and optimizing big data pipelines and data sets
    • 5+ years of experience with Power BI or other similar tools
    • 3+ years of Experience on Azure Databricks with Python and PySpark
    • 3+ years of Experience on frameworks such as .NET and .NET Core
    • 1+ years of Experience in the Azure Data Engineering environment using Databricks, Azure Data Lake Storage, etc.
    • Expert in using XML, JSON, EDI, or other data schema formats
    • Expert in object-oriented analysis, SOA, design patterns, development, implementation and maintenance
    • Expert with relational databases (SQL Server preferred) and query languages such as SQL, T-SQL, Linq, etc.
    • Very good knowledge of Microsoft development tools such as
      • Languages like C#, Visual Basic .NET, F#, C++ .NET
      • Web frameworks like ASP.NET, MVC 1-6, ASP.NET Web Api
      • Messaging and data exchange using frameworks like WCF, ASP.NET WebApi
      • ORM’s such as Entity Framework
    • Experience in agile devops including continuous integration
      • Unit testing frameworks nUnit, SpecFlow, MSTest, xUnit
      • Source code control using Git and GitFlow
      • Code deployment using tools like TeamCity, Jira, etc.
      • Agile team workflow using SAFe
    • Excellent verbal and written communication skills
    • Experience in onshore/offshore mixed development team models

    Additional Information

    All your information will be kept confidential according to EEO guidelines.

    By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply