Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, develop, and maintain reliable data pipelines and processing systems. The role involves building scalable data solutions, improving existing systems, optimising performance, and ensuring data processing workflows are reliable and maintainable. You will also provide technical guidance to the engineering team and drive improvements in development practices.

Key Responsibilities Design, develop, and maintain data pipelines, ETL processes, and data integration workflows. Build and manage large-scale data processing workflows, including scheduling, monitoring, error handling, and recovery. Improve and modernise existing systems while ensuring data accuracy and consistency. Design and optimise databases, data models, and data processing workflows. Develop reusable tools and components to improve development efficiency. Implement automated testing and deployment processes using CI/CD tools. Manage source code, conduct code reviews, and maintain technical documentation. Monitor system performance, troubleshoot production issues, and implement improvements. Provide technical guidance, review solution designs, and mentor other engineers. Work with stakeholders to translate business requirements into effective technical solutions.

Requirements At least

7 years of relevant experience

in data engineering, data platform development, or software engineering. Strong proficiency in

Python and SQL . Experience in ETL, data integration, and data pipeline development. Good knowledge of Linux/Unix environments and shell scripting. Strong understanding of software engineering practices, including testing, logging, error handling, and documentation. Experience in system migration, modernisation, and large-scale data processing. Experience with Git/GitLab, code reviews, and CI/CD pipelines. Ability to design solutions that balance performance, scalability, maintainability, and reliability. Experience providing technical guidance or mentoring other engineers. Familiarity with cloud platforms and workflow orchestration tools would be an advantage. Strong analytical, problem-solving, and communication skills.

Interested candidates are encouraged to submit their resumes outlining their relevant experience and achievements to sherriyang(@)talentvis.com or click apply! ..We regret to inform that only shortlisted candidates would be notified.. EA License No: 04C3537 EA Personnel No: R22106683 EA Personnel Name: Yang Hui Shan, Sherri