Senior Azure Databricks Data Engineer lead
Tata Consultancy Services · Chennai, India ·
- Seniority
- Lead
- Category
- Data engineering
- Experience
- 6+ years
- Company size
- 1000+
Senior Data Engineer lead building complex ETL/ELT solutions on Azure Data Lake, Databricks, and ADF using SQL, PySpark/Scala, with Kafka-based real-time and batch ingestion at scale.
Role: Senior Azure Databricks Data Engineer lead
Experience: 6-10 Years
location: Chennai, Bangalore, Pune, Hyderabad
Requirements:
• 8+ years of experience in data engineering with strong expertise in Azure Data Lake, Databricks, and ADF.
• Hands-on expertise in SQL and PySpark or Scala for building complex ETL/ELT solutions.
• Proven track record with batch & real-time ingestion, Kafka, and large-scale big data processing.
• Experience with relational and NoSQL engines: SQL Server, Oracle, Azure SQL, and Cosmos DB.
• Experience with Informatica PowerCenter, Informatica IDMC, or equivalent cloud data integration tools.