We are looking for an experienced Senior Data Engineer to join our growing Data Engineering team. In this role, you will design, build, and optimize scalable data platforms and pipelines that power business intelligence, analytics, machine learning, and AI solutions. As a technical leader, you will architect robust data solutions, drive best practices, mentor junior engineers, and collaborate with cross-functional teams to deliver high-quality, production-ready data products in a fast-paced environment.
Responsibilities
- Design, develop, and maintain scalable data pipelines and enterprise data platforms.
- Build and manage end-to-end data pipelines, including data ingestion, transformation, and Data Marts within the Enterprise Data Warehouse.
- Develop and maintain API integrations to support increasing data volumes and complexity.
- Collaborate with business, analytics, and engineering teams to deliver reliable, accessible, and high-quality data solutions.
- Design and optimize data models, ETL/ELT processes, and dimensional data warehouse architectures.
- Implement data quality, monitoring, and governance frameworks to ensure trusted production data.
- Partner with Data Scientists to productionise machine learning and AI solutions.
- Build and maintain CI/CD/CT pipelines to automate deployment and delivery of data solutions.
- Troubleshoot production data issues and implement sustainable solutions.
Qualifications & Experience
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
- 5+ years of experience as a Data Engineer or in a similar role.
- 5+ years of Python development experience.
- 5+ years of Microsoft SQL Server experience (PostgreSQL is advantageous).
- Strong experience designing and implementing enterprise data warehouses, dimensional modelling, and schema design.
- Experience designing, building, and maintaining data processing systems across cloud platforms (Azure, AWS, Microsoft Fabric) and on-premises environments (Microsoft SQL Server, SSIS).
- Strong experience developing ETL/ELT processes and scalable data pipelines.
- Hands‑on experience with Apache Spark.
- Experience implementing CI/CD/CT pipelines for automated deployment and delivery.
The reference number for this position is NG61441 which is a Permanent, Hybrid role in Cape Town, offering a salary of up to R1.2mil per annum salary negotiable based on experience.