Data Engineer
- Full-time
- Company: emp_v30_apr1
Company Description
Company Name: emp_v30_apr1
Job Description
We are seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining robust data infrastructure that supports our organization's data-driven decision-making processes. You will work with cutting-edge technologies to ensure efficient data flow and accessibility for analytical and machine learning applications.
Job PurposeThe primary purpose of this role is to develop and maintain scalable, reliable data systems that enable efficient data collection, storage, processing, and accessibility. The Data Engineer will create data pipelines and infrastructure that support analytical needs and machine learning initiatives across the organization.
Job Duties and Responsibilities- Data Infrastructure Design
- Data Collection & Processing
- Python Programming
- SQL Development
- Scala Programming
- Apache Spark Implementation
- Apache Kafka Integration
- Apache Airflow Orchestration
- AWS Cloud Services
- Google Cloud Platform Management
- Data Pipeline Development
- ETL/ELT Processes
- Data Warehousing
- System Scalability
- Data Accessibility Solutions
Qualifications
- Python Proficiency
- SQL Expertise
- Scala Knowledge
- Apache Spark Experience
- Apache Kafka Experience
- Apache Airflow Experience
- AWS Cloud Platform
- Google Cloud Platform
- Data Engineering
- Data Pipeline Development
- Cloud Platform Experience
- Database Systems
- Data Warehousing
- ETL/ELT Processes