Jobs for Humanity Data Engineer

Company Description

Jobs for Humanity is partnering with emp_apr2_v6 to build an inclusive and just employment ecosystem. Therefore, we prioritize individuals coming from all walks of life.

Company Name: emp_apr2_v6

Job Description

We are seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining robust data infrastructure that supports our organization's data-driven decision-making processes. You will work with cutting-edge technologies to ensure efficient data flow and accessibility for analytical and machine learning applications.

Job Purpose

The primary purpose of this role is to develop and maintain scalable, reliable data infrastructure that enables efficient data collection, storage, processing, and accessibility for analysis and machine learning applications, supporting the organization's data-driven initiatives.

Job Duties and Responsibilities

Data Infrastructure Design
Data Collection & Processing
Python Programming
SQL Development
Scala Programming
Apache Spark Implementation
Apache Kafka Integration
Apache Airflow Orchestration
AWS Cloud Services
Google Cloud Platform Management
Data Pipeline Development
ETL/ELT Processes
Data Warehousing
Data Storage Solutions
Data Accessibility Optimization

Qualifications

Required Qualifications

Python Proficiency
SQL Expertise
Scala Knowledge
Apache Spark Experience
Apache Kafka Experience
Apache Airflow Experience
AWS Cloud Platform
Google Cloud Platform
Data Engineering
Data Pipeline Development
Cloud Platform Experience
Database Systems
Data Warehousing
ETL/ELT Processes