Location- KL
We are looking for an experienced Senior Data Engineer to join our Data & Analytics team within the Insurance domain.
This role is ideal for a hands‑on data engineer with strong AWS, Data Lake/Data Warehouse, ETL/ELT, PySpark, Python, SQL, Terraform, and Apache Iceberg experience, with an interest in modern AI-enabled software development.
- Design and develop scalable, secure, and high-performing data pipelines
- Build and optimize ETL/ELT processes across Data Lake and Data Warehouse environments
- Develop batch and near real-time data processing solutions
- Design and maintain Apache Iceberg datasets
- Build and support cloud-native data platforms on AWS
- Monitor, troubleshoot, and optimize data pipelines and platform performance
- Support Disaster Recovery (DR), failover/failback, RTO/RPO, and business continuity activities
- Implement data quality, reconciliation, governance, and metadata management controls
- Support AWS DataZone initiatives and enterprise data governance
- Collaborate with Architects, Business Analysts, Data Analysts, BI Developers, Product Owners, and business stakeholders
- Prepare technical documentation, runbooks, solution designs, and data flow diagrams
- Conduct knowledge transfer sessions and mentor junior engineers
- 3+ years of experience in Data Engineering, Data Warehousing, or Data Platform Engineering
- Strong hands‑on experience with SQL, Python, PySpark, and Terraform
- Experience designing and supporting Enterprise Data Lake & Data Warehouse solutions
- Hands‑on experience with Apache Iceberg
- Strong understanding of ETL/ELT, data modeling, and data integration
- Experience with Terraform / Infrastructure as Code
- Understanding of cloud security, IAM, permissions, and access control
- Experience supporting Disaster Recovery and Business Continuity activities
- Knowledge of Generative AI, Agentic AI, and AI‑assisted software development
- Experience using AI‑powered coding assistants to improve engineering productivity and code quality
- Strong analytical, troubleshooting, communication, and problem‑solving skills
Good to Have
- AWS Certifications such as AWS Certified Data Engineer / Solutions Architect / Developer / Cloud Practitioner
- AWS DataZone and enterprise data governance experience
- Data Lakehouse architecture experience
- DevOps, CI/CD, and cloud automation experience
- Experience in Insurance or Financial Services
AWS | Glue | Redshift | S3 | RDS | Step Functions | CloudWatch | IAM | EventBridge | DataZone | SQL | Python | PySpark | Terraform | Apache Iceberg | Data Lake | Data Warehouse | Power BI | Generative AI