Data Engineer - Big Data Technologies

About the Role

Our client is seeking a skilled Data Engineer to build and maintain robust data infrastructure in Durban . This role is crucial for enabling data-driven insights across the organization by ensuring the availability, integrity, and efficiency of our data systems. You will be responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems. This position offers a significant opportunity to work with cutting-edge big data technologies and contribute directly to the company's data strategy.

Key Responsibilities

• Design, build, and maintain scalable and reliable ETL/ELT pipelines for batch and real-time data processing.
• Develop and optimize data models and database schemas for performance and analytical use cases.
• Implement data warehousing solutions and manage large datasets using distributed computing frameworks.
• Ensure data quality, integrity, and security across all data platforms.
• Collaborate with data scientists and analysts to understand their data requirements and provide accessible data solutions.
• Monitor data systems, troubleshoot issues, and implement performance improvements.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience as a Data Engineer or in a similar data-focused role.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Hands-on experience with big data technologies such as Apache Spark, Hadoop, Kafka, or similar.
• Experience with cloud data platforms (e.g., AWS Redshift, Azure Data Lake, Google BigQuery).
• Strong programming skills in Python or Scala.

Benefits

• Competitive annual salary and potential for performance bonuses.
• Comprehensive health insurance coverage.
• Opportunities for learning and development in new data technologies.
• A collaborative work environment with a focus on innovation.
• Hybrid work arrangement promoting work-life balance.