Senior Data Engineer

Reports To: (Head of Data Science / Director of Analytics / CTO)

Key Responsibilities

• Lead the design, development, and maintenance of scalable data pipelines and systems.
• Implement and oversee data integration solutions to consolidate data from various sources.
• Optimize data architecture and data flow for performance, reliability, and scalability.
• Collaborate with data analysts, scientists, and other stakeholders to understand data requirements and deliver solutions.
• Ensure data quality and integrity through rigorous testing, validation, and monitoring.
• Develop and maintain ETL processes to extract, transform, and load data.
• Monitor, troubleshoot, and improve data systems to ensure smooth operation.
• Stay updated with the latest industry trends and technologies to continuously enhance data infrastructure.
• Mentor and guide junior data engineers and other team members.

Qualifications

• Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field.
• Extensive experience as a Data Engineer or in a similar role, with a proven track record of building and maintaining data infrastructure.
• Proficiency in advanced data engineering tools and technologies (e.g., SQL, (Python – AI/ML libraries), Hadoop, Apache Spark, Git and Github, Google Colab, AutoML platforms)
• Strong understanding of database management systems, data warehousing, and big data technologies.
• Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) is highly desirable.
• Excellent problem-solving skills and attention to detail.

Skills

• Ability to design and implement complex data systems.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with big data technologies and frameworks.
• Knowledge of data modelling and database design.
• Ability to work independently and lead a team.
• Strong analytical and troubleshooting skills.
• Leadership and mentoring abilities.
• Opportunities for professional development and growth.
• Leadership opportunities within the data engineering team