Senior Data Engineer
- Full-time
Company Description
Ringier South Africa is a technology company supporting international marketplaces. We build and maintain the tech for Classifieds Marketplaces across the world. Our platforms attract millions of views per month and are market leaders in their respective countries. We aim to solve all of the technical requirements for running a highly scalable, highly available marketplace business. It does this while still giving local customizations for different countries and continuously improving from what we’ve learned in other markets.
Job Description
What will you do?
- Develop and maintain data architecture, including processes for data transformation, structures, metadata, dependencies, and workload management.
- Design and implement data integrations, a data quality framework, and enhancements/new features for data warehousing, reporting, visualization, and master data management.
- Design and implement data architecture to support analytics use cases, and drive internal process improvements through automation, optimization, and infrastructure redesign.
- Develop, test, and document data solutions, proactively suggesting improvements and staying current with relevant technologies.
- Analyze stakeholder requirements to implement data system enhancements and ensure solutions align with those requirements.
- Serve as a subject matter expert, leading the team in developing and maintaining CI/CD processes for data pipelines.
- Assemble and process complex datasets, including ETL jobs for continuous data flows, ensuring data consistency and managing unit test scope.
- Develop and maintain automated monitoring solutions, implement reporting and analytics infrastructure, and ensure data quality, governance, and security.
- Champion data system improvements, manage data set permissions, and research/recommend advancements in data warehousing, reporting, visualization, and master data.
Qualifications
- BSc degree in Computer Science/information systems/Engineering or related technical field or equivalent work experience
- 7+ years related work experience
- 4 years experience in Python
- 4 years experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Experience in leading projects i.e. migrations
- Experience in leading data teams highly desirable
- Proficiency in managing data life cycle
- Proficiency in manipulating, processing and architecting large disconnected data sets for analytical requirements
- Ability to maintain and optimise on processes supporting data transformation, data structures, metadata, dependency and workload management.
- Good understanding of data management principles - data quality assurance and governance
- Strong analytical skills related to working with unstructured datasets
- Experience in message queuing, stream processing, and highly scalable ‘big data’ data stores
- Strong attention to detail
- Good communication and interpersonal skills
Additional Information
Why work for us?
- We are fully remote! Work from anywhere in the world within a 3 hour SAST timezone
- We have co-working spaces in Cape Town, Mauritius, Kenya & Nigeria
- A cutting-edge development stack is waiting for your code contribution
- You will be working with over 80+ highly skilled technical minds (and expanding)
- Backing of the international media powerhouse Ringier AG, which allows us to access
- world-class development resources, shared knowledge, and a wealth of international
- business insights
- Our teams work with a wide range of tech stacks
- We are committed to the future growth prospects of our employees by allowing autonomy,
- flexibility and an opportunity to master your respective skill