Lead Software Engineer- Data Engineer
Caterpillar Inc · Chennai, Tamil Nadu, India ·
- Work mode
- Remote
- Seniority
- Lead
- Category
- Data engineering
agileanalyticsapiautomationawsci-cddata-engineeringdata-ingestiondata-modelingmachine-learningmetadata-managementsnowflakeversion-control
Lead a team to design and build scalable AWS and Snowflake data platforms, automate pipelines, and operationalize ML models for Caterpillar’s climate-tech initiatives.
- Architect AWS data platforms
- Build and optimize Snowflake pipelines
- Collaborate with product managers SMEs and stakeholders
- Define CI/CD standards
- Design data ingestion frameworks
- Drive agile execution
- Drive automation continuous improvement
- Enable ingestion from databases APIs files streaming
- Enforce modular design code quality testing version control
- Ensure scalability resiliency operational readiness
- Establish engineering best practices
- Implement CI/CD pipelines
- Implement data modeling governance metadata management
- Lead and mentor data engineering team
- Leverage AWS services for end to end pipelines
- Operationalize ML models and analytics workflows
- Promote reusable ingestion transformation frameworks
- Translate business needs into data solutions
Perks/Benefits:
- Onsite work five days per week
- Relocation available