About the Role
Our client, a leading technology services provider, is seeking a Senior Data Engineer to join their innovative team in Centurion, Gauteng . This role is crucial for designing, building, and maintaining scalable data infrastructure and pipelines that support the company's advanced analytics and business intelligence initiatives. You will work with large, complex datasets, leveraging cloud platforms to ensure data is accessible, reliable, and optimized for performance. The ideal candidate will possess a deep understanding of data warehousing, ETL processes, big data technologies, and cloud data services. You will collaborate closely with data scientists, analysts, and business stakeholders to understand data needs and deliver robust data solutions. This position offers a fantastic opportunity to shape the data landscape of a forward-thinking organization and contribute to data-driven decision-making across various departments. The role offers a blend of challenging technical work and impactful business contributions in a dynamic environment in Centurion, Gauteng .
Key Responsibilities
- Design, develop, and optimize robust, scalable data pipelines for data ingestion, transformation, and aggregation.
- Build and maintain data warehouses and data lakes on cloud platforms such as AWS, Azure, or GCP.
- Implement ETL/ELT processes using various tools and technologies.
- Ensure data quality, integrity, and consistency across all data systems.
- Collaborate with data scientists and analysts to understand their data requirements and provide efficient data access.
- Develop and manage data models that support business reporting and analytics needs.
- Monitor data infrastructure performance and implement improvements for efficiency and reliability.
- Implement data security best practices and ensure compliance with data governance policies.
- Automate data processes and workflows for increased efficiency and reduced manual intervention.
- Stay current with emerging trends and technologies in data engineering and cloud computing.
- Troubleshoot and resolve data-related issues in a timely manner.
- Mentor junior data engineers and contribute to team knowledge sharing.
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.
- 5+ years of professional experience in data engineering, with a strong focus on building and managing data infrastructure.
- Proven experience with cloud data services (e.g., AWS Redshift/S3/Glue, Azure Data Factory/Synapse, Google BigQuery/Cloud Storage).
- Proficiency in SQL and experience with NoSQL databases.
- Strong programming skills in languages such as Python, Scala, or Java.
- Experience with big data technologies (e.g., Spark, Hadoop, Kafka) is essential.
- Knowledge of data warehousing concepts and best practices.
- Experience with ETL/ELT tools and workflow orchestration (e.g., Airflow).
- Excellent problem-solving, analytical, and troubleshooting skills.
- Strong communication and collaboration abilities.
- Ability to work effectively in a hybrid work model in Centurion, Gauteng .
Benefits
- Competitive salary package with performance-based incentives.
- Comprehensive medical, dental, and vision insurance.
- Generous annual leave and company holidays.
- Retirement savings plan with employer match.
- Opportunities for professional development, training, and certifications.
- Access to advanced cloud computing resources and tools.
- Collaborative and innovative work environment.
- Potential for career advancement within a growing organization.
- Hybrid work model offering flexibility.
- Engage in impactful projects driving data-driven strategy.