Data Engineer / Cloud Data Architect

Job Summary

We are looking for an experienced Data Engineer / Cloud Data Architect with strong expertise in AWS cloud data platforms, Databricks, IDMC/Informatica and PySpark . The candidate will be responsible for designing and implementing scalable cloud-based data solutions, data pipelines, migration/modernization initiatives, and analytics architectures.

Key Responsibilities

• Design and maintain data architecture, roadmaps, blueprints, and reference architectures .
• Develop scalable AWS-based data analytics and data engineering solutions .
• Lead data migration and modernization initiatives using AWS, Databricks and IDMC.
• Design and optimize ETL/ELT pipelines, data lakes, data warehouses and data integration solutions .
• Work with business and technical stakeholders to translate requirements into scalable data solutions.
• Develop and optimize data pipelines using PySpark/Spark, Databricks and AWS-native services .
• Implement automation, CI/CD and Infrastructure-as-Code practices for cloud data environments.
• Ensure adherence to security, governance, compliance and data management standards .
• Collaborate with Data Engineering, DevOps and other technology teams on solution delivery.
• Support vendor and stakeholder management for data and cloud initiatives.

Must-Have Skills

• 5–10 years of experience in Data Engineering, Data Warehousing, Big Data or Cloud Data solutions.
• Strong hands-on experience with AWS cloud services such as S3, Glue, Redshift, Lambda, Athena, EMR or Kinesis.
• Strong PySpark / Spark experience.
• Hands-on experience with Databricks and/or Informatica IDMC .
• Strong understanding of data lakes, data warehouses, ETL/ELT and data modelling .
• Good knowledge of SQL and Python .
• Experience with data migration, modernization and cloud-based analytics solutions.
• Good understanding of CI/CD, Terraform/CloudFormation, IAM and cloud security .
• Strong stakeholder management and communication skills.

Good-to-Have Skills

• Tableau / Power BI
• Informatica
• Oracle / SQL Server / MySQL / Teradata
• Delta Lake / MLflow
• AWS Glue / Redshift / EMR
• Event-driven architecture and microservices
• Healthcare data governance and compliance
• Tech Manager / Cloud Data Architect experience

Preferred Certifications

• AWS Certified Solutions Architect – Associate/Professional
• Databricks Certified Data Engineer
• Informatica IDMC Certification

Education

Bachelor's/Master's degree in Computer Science, Information Technology, Computer Engineering , or a related field.