Data Engineer

  • Contract

Job Description

Position: Data Engineer

Location: (Remote Job)

Duration: Long Term Contract

Duties and Responsibilities:

Must have 11 + Years of overall experience with handson Python, Spark , ETL & Sql

Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (e.g., scripts, programs, automation, etc.)

Ensures quality of technical solutions as data moves across multiple zones and environments

Provides insight into the changing data environment, data processing, data storage and utilization requirements for the company, and offer suggestions for solutions

Ensures managed analytic assets to support the company’s strategic goals by creating and verifying data acquisition requirements and strategy

Develops, constructs, tests, and maintains architectures

Aligns architecture with business requirements and use programming language and tools

Identifies ways to improve data reliability, efficiency, and quality

Conducts research for industry and business questions

Deploys sophisticated analytics programs, machine learning, and statistical methods to efficiently implement solutions

Prepares data for predictive and prescriptive modeling and find hidden patterns using data; in support of the Data Science team

Uses data to discover tasks that can be automated

Creates data monitoring capabilities for each business process and works with data consumers on updates

Aligns data architecture to the solution architecture; contributes to overall solution architecture

Develops patterns for standardizing the environment technology stack

Helps maintain the integrity and security of company data

Minimum Qualifications:

Bachelor’s Degree in Computer Engineering or related field

8+ years of experience in data engineering

5+ years of experience in data programming languages, such as Java, Python or Pyspark

5+ years of experience working in a ‘Big Data’ ecosystem process data; includes file systems, data structures/data bases, , automation, security, messaging, movement, etc.

5+ years of experience working in a production cloud infrastructure

 

Additional Information

All your information will be kept confidential according to EEO guidelines.