We are looking for a Senior Data Engineer / Technical Lead with 8+ years of hands-on data engineering experience, including technical leadership across production data platforms.
The ideal candidate should have strong expertise in AWS, Databricks, Spark, Python/Java, SQL, dbt and Airflow, along with experience in data governance, security, real-time processing and enterprise-scale data platforms.
Key Responsibilities
- Design, build and operate production-grade data pipelines.
- Provide technical leadership across data engineering initiatives.
- Design solutions and clearly explain technical decisions, trade-offs and rationale.
- Own the complete data engineering lifecycle:
- Architecture & Design
- Development
- Testing
- Security
- Governance
- Deployment
- Production Support
- Build and operate batch and real-time/streaming data pipelines.
- Work with large-scale data environments involving tens to hundreds of TBs.
- Implement data quality, validation and reliability frameworks.
- Manage Databricks governance and access management.
- Ensure data security and compliance across production platforms.
- Conduct technical design reviews and establish engineering standards.
- Provide delivery assurance and support projects moving at pace.
- Work closely with Business Analysts, Architects, Data Scientists and End Users.
- Contribute to effort estimation and commercial discussions.
- Ensure proposed solutions are technically feasible and deliverable.
- Mentor engineers through coaching, feedback and structured development.
- Support production troubleshooting, monitoring and performance optimization.
Required Technical Skills
- 8+ years of hands-on data engineering experience.
- Strong technical leadership experience on production platforms.
- Strong hands-on programming skills in:
- Python
- Java or similar programming languages
- Strong SQL skills.
- AWS
- Databricks
- Apache Spark
- Modern data architecture
- dbt for data transformations
- Airflow or equivalent orchestration tools
- Batch and streaming data pipelines
- Data modelling
- Data quality and validation
- Data governance
- Data security
- Production data systems
- PostgreSQL or SQL Server
- CI/CD pipelines
- Testing frameworks
- Monitoring and observability tools
Enterprise-Scale Experience
Candidates should have experience working with:
- Large-scale enterprise data platforms
- Data volumes ranging from tens to hundreds of TBs
- High-volume production pipelines
- Real-time and batch processing
- Secure and governed data environments
- Production reliability and performance requirements
Leadership & Consulting Skills
- Ability to influence architecture and technical decisions.
- Strong understanding of technical trade-offs and solution rationale.
- Experience conducting design reviews and technical governance.
- Ability to work with multiple stakeholders.
- Strong client-facing and consulting experience.
- Experience contributing to estimation and commercial discussions.
- Ability to mentor and develop engineering teams.
- Strong communication and presentation skills.
Qualifications / Good to Have
- Experience enabling ML, AI or GenAI workloads through strong data foundations.
- Exposure to modern BI and analytics tools.
- Experience working in regulated or security-conscious environments.
- Consulting or client-facing delivery experience.
- Experience with modern cloud data platforms.
- Strong understanding of data architecture and engineering best practices.
Ideal Candidate
A strong candidate will be someone who combines deep hands-on engineering capability with technical leadership.
They should be comfortable designing solutions, writing production code, challenging architectural decisions, managing governance and security, troubleshooting production issues, and mentoring other engineers.
CV Submission
Sanaari Software Solutions Pvt. Ltd.
IT Staffing & Consulting Services
[email protected]
WhatsApp: +91 8008814567