Senior Data Engineer - Big Data & AI

About the Role

Our client is seeking an experienced Senior Data Engineer to build and maintain scalable data infrastructure that supports advanced analytics and AI initiatives in Klerksdorp . You will be responsible for designing, developing, and optimizing data pipelines, ensuring the availability and quality of data for machine learning models and business intelligence. This role is critical for empowering data scientists and analysts with the data they need to drive insights and innovation. The ideal candidate has a strong background in big data technologies and a passion for enabling data-driven decision-making.

Key Responsibilities

• Design, build, and maintain robust, scalable ETL/ELT pipelines for large datasets.
• Develop and manage data warehousing solutions and data lakes using big data technologies.
• Ensure data quality, integrity, and security across all data systems.
• Collaborate with data scientists and analysts to understand data requirements and provide necessary data access.
• Optimize data infrastructure for performance, cost-efficiency, and reliability.
• Implement data governance best practices and monitoring solutions.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering, with a focus on big data technologies (e.g., Spark, Hadoop, Kafka).
• Proficiency in SQL and programming languages like Python or Scala.
• Experience with cloud data platforms (AWS, Azure, GCP) and their data services.
• Familiarity with data modeling, database design, and data warehousing concepts.
• Strong understanding of data pipeline orchestration tools (e.g., Airflow) and MLOps concepts is a plus.

Benefits

• Attractive salary and bonus structure.
• Fully remote position, providing exceptional work-life balance.
• Comprehensive health and wellness benefits package.
• Opportunities for continuous learning and career advancement in a growing field.
• Be part of a collaborative and innovative team focused on cutting-edge data solutions.