Location: Mumbai
Employment Type: Full-Time
Experience: 8+ Years
About the Role
We are looking for an experienced Data Engineering Lead to join our team and lead the data engineering function for a large-scale enterprise analytics platform.
The ideal candidate will have strong expertise in AWS data services, ETL pipelines, data engineering, and production support, along with proven experience leading data engineering teams and managing data platforms at scale.
Key Responsibilities
- Lead and mentor a team of Data Engineers responsible for developing, maintaining, and enhancing enterprise data platforms.
- Design, develop, maintain, and optimize ETL/ELT pipelines and data workflows.
- Own pipeline performance, monitoring, troubleshooting, and optimization.
- Ensure reliability, scalability, and performance of data engineering solutions.
- Manage and resolve production issues within defined SLA timelines.
- Participate in 24x7 production support and P1 incident rotation, including weekend/night on-call support.
- Drive continuous improvements and enhancements across data pipelines and platform components.
- Collaborate with business, technical, and client-facing stakeholders to understand requirements and deliver effective data solutions.
- Create and maintain technical documentation, runbooks, and operational procedures.
- Monitor data quality, pipeline health, and system performance.
- Ensure adherence to engineering best practices, security standards, and operational processes.
Key Technologies
- AWS Glue
- AWS Lambda
- Amazon Redshift
- Amazon Aurora PostgreSQL
- Amazon MSK / Kafka
- AWS SQS
- AWS Transfer Family
- Apache Airflow
- SQL
- Python
Requirements
- 8+ years of experience in Data Engineering with demonstrated leadership experience.
- Strong hands-on expertise with AWS data and analytics services, particularly Glue, Redshift, and Aurora PostgreSQL.
- Strong proficiency in SQL and Python.
- Extensive experience building and managing ETL/ELT pipelines.
- Experience working with Apache Airflow or similar orchestration tools.
- Experience with Kafka/MSK, SQS, or event-driven data architectures.
- Proven experience managing production-grade data pipelines at scale.
- Strong troubleshooting, analytical, and problem-solving skills.
- Experience leading, mentoring, or managing a team of Data Engineers.
- Strong communication and stakeholder-management skills.
- Willingness to work from Mumbai and visit the client site as required.
- Willingness to participate in weekend/night on-call rotations when required.
Good to Have
- Experience working with large-scale enterprise analytics platforms.
- Exposure to Oil & Gas or other large enterprise domains.
- Experience with production support, incident management, and SLA-driven environments.
- AWS certifications related to Data, Analytics, or Solutions Architecture.
What We Offer
- Opportunity to work on large-scale enterprise data platforms.
- Exposure to modern AWS data engineering technologies.
- Leadership and ownership opportunities.
- Learning and professional development opportunities.
- Collaborative and technology-driven work environment.
- Competitive compensation and career growth opportunities.
Interested?
If you are an experienced Data Engineering Lead with strong AWS expertise and a passion for building reliable, scalable data platforms, we would love to hear from you.
Apply now or share your profile with us.
#Hiring #DataEngineering #DataEngineer #DataEngineeringLead #AWS #AWSGlue #Redshift #Python #SQL #Kafka #Airflow #CloudJobs #MumbaiJobs #TechHiring #HiringNow