Data Engineer
- Contract
Job Description
Position: Data Engineer
Location: (Remote Job)
Duration: Long Term Contract
Duties and Responsibilities:
Must have 11 + Years of overall experience with handson Python, Spark , ETL & Sql
Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (e.g., scripts, programs, automation, etc.)
Ensures quality of technical solutions as data moves across multiple zones and environments
Provides insight into the changing data environment, data processing, data storage and utilization requirements for the company, and offer suggestions for solutions
Ensures managed analytic assets to support the company’s strategic goals by creating and verifying data acquisition requirements and strategy
Develops, constructs, tests, and maintains architectures
Aligns architecture with business requirements and use programming language and tools
Identifies ways to improve data reliability, efficiency, and quality
Conducts research for industry and business questions
Deploys sophisticated analytics programs, machine learning, and statistical methods to efficiently implement solutions
Prepares data for predictive and prescriptive modeling and find hidden patterns using data; in support of the Data Science team
Uses data to discover tasks that can be automated
Creates data monitoring capabilities for each business process and works with data consumers on updates
Aligns data architecture to the solution architecture; contributes to overall solution architecture
Develops patterns for standardizing the environment technology stack
Helps maintain the integrity and security of company data
Minimum Qualifications:
Bachelor’s Degree in Computer Engineering or related field
8+ years of experience in data engineering
5+ years of experience in data programming languages, such as Java, Python or Pyspark
5+ years of experience working in a ‘Big Data’ ecosystem process data; includes file systems, data structures/data bases, , automation, security, messaging, movement, etc.
5+ years of experience working in a production cloud infrastructure
Additional Information
All your information will be kept confidential according to EEO guidelines.