We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable data platforms and pipelines that support analytics, reporting, and operational needs. The successful candidate will work closely with cross-functional teams to deliver reliable, secure, and high-quality data solutions.
Key Responsibilities
- Design, develop, and maintain ETL/ELT data pipelines using Python and PySpark.
- Build and manage scalable lakehouse/data lake architectures across raw, curated, and consumption layers.
- Deploy and support containerized data workloads using Kubernetes and Docker.
- Develop, optimize, and maintain SQL Server databases, data models, and complex queries.
- Implement CI/CD practices, automated testing, and deployment processes for data platforms.
- Ensure data security, governance, access controls, and compliance requirements are met.
- Monitor, troubleshoot, and resolve complex data engineering issues.
- Collaborate with Data Scientists, Business Analysts, and stakeholders to deliver business-ready datasets.
- Perform code reviews, share best practices, and support the development of team capabilities.
- Evaluate and recommend technologies and improvements to enhance platform performance and reliability.
Requirements
Education
- Diploma or bachelor's degree in computer science, Information Technology, Engineering, or a related discipline.
Experience
- At least 8 years of IT experience, including 5 years of hands-on data engineering or data pipeline development.
- Strong experience in Python, PySpark, SQL Server, and data pipeline development.
- Experience with Kubernetes and Docker in enterprise environments.
- Expertise in relational and non-relational data modeling.
- Hands-on experience with lakehouse or data lake architectures, including data partitioning and metadata management.
- Experience with ETL/ELT orchestration tools such as Apache Airflow or similar platforms.
- Experience with CI/CD pipelines, Git, and DevOps practices.Familiarity with NoSQL databases such as MongoDB or Cassandra.
- Strong understanding of data security, governance, and access control frameworks.
- Excellent analytical, problem-solving, communication, and stakeholder management skills.
Preferred Skills
- Experience with Apache Kafka, Apache Flink, or other real-time streaming technologies.
- Knowledge of data mesh, data fabric, or logical data warehouse concepts.
- Familiarity with metadata management and data lineage tools.
- Experience mentoring junior engineers or leading technical initiatives.
- Exposure to Agile delivery methodologies.
Short listed candidates will be notified
www.ambition.com.sg
EA Registration Number: R22106307
Data provided is for recruitment purposes only
Business Registration Number: 200611680D. License Number: 10C5117