Lead Data Engineer with Supply chain expertise

Lead Data Engineer with Supply chain expertise

Location: Pune

Experience: 6+ Years

Role Overview

We are looking for a seasoned Lead Data Engineer with 6+ years of core data engineering experience to design and build scalable, real-time and batch data platforms with Supply Chain expertise. The role requires strong expertise in data analytics, python, advanced SQL, complex data transformations, system integrations, and supply chain workflow.

Key Responsibilities

• Design and build real-time, AI based supply chain batch data ingestion pipelines.
• Build complex data transformation, cleansing, enrichment, and reconciliation workflows.
• Integrate data from REST APIs, databases, files, enterprise systems, and streaming sources.
• Develop ETL tools and validation routines for complex supply chain workflows.
• Develop reusable Python and SQL components for ingestion and transformation.
• Implement schema evolution, incremental loads, retries, error handling, and data recovery.
• Understand agentic structure and create data solutions and models for optimisation engines.
• Implement data quality checks, monitoring, logging, alerting, and audit controls.
• Review technical designs and guide data engineers on implementation standards.

Required Skills

• 6+ years of hands-on data engineering experience.
• Strong experience with Supply chain data management and transformation.
• Strong Python and PySpark development skills.
• Advanced SQL skills, including complex joins, and query optimization.
• Strong understanding of ETL and ELT design patterns.
• Experience with REST APIs, JSON, CSV, MongoDB and OLAP engines.
• Experience with developing Agents and Agentic design.
• Strong understanding of data modelling, schema design, partitioning, and schema evolution.
• Experience implementing pipeline observability, data validation, monitoring, and alerting.
• Experience with Git, CI/CD, Docker, and Kubernetes.