We are looking for a visionary Data Platform Engineer to own, scale, and nurture our platform engineering team and data infrastructure across Databricks and Snowflake ecosystems. You will set the strategic direction for Capita’s Enterprise Data Platform, be the custodians of the platform, mentor team members, and drive the development of robust, scalable foundational data pipelines, transformations, and data models that underpin business insights and operational reporting. You will ensure engineering best practices, data quality, and reliability are maintained across platforms.
Job title:
Lead Data Engineer - Data Platform
Job Description:
- Define and drive the technical roadmap and strategy for the data platform on Databricks and Snowflake, ensuring scalability, security, and cost efficiency.
- Design, implement, and maintain the platform's infrastructure using Infrastructure as Code (IaC) tools such as Terraform or BICEP/ARM.
- Drive platform automation and operational excellence for deployment, environment provisioning, monitoring, and self-service capabilities using Azure DevOps/CI/CD.
- Establish and enforce engineering best practices, including robust code quality, automated testing, observability, and security governance across the platform.
- Mentor and nurture the platform engineering team, promoting a culture of continuous learning and high-quality delivery.
- Collaborate with data engineering teams, security, and senior stakeholders to ensure platform capabilities align with business needs and enterprise standards.
- Monitor and manage cloud resource consumption across Databricks and Snowflake to drive cost efficiency and implement FinOps best practices.
- Establish, monitor, and enforce Service Level Agreements (SLAs) and Non-Functional Requirements (NFRs) for platform performance, availability, and throughput.
- Define and implement data quality enforcement mechanisms and robust access control policies (e.g., RBAC/ABAC) utilising features like Databricks Unity Catalog or Snowflake Roles.
Location:
Pune
,
India
Time Type:
Full time
Contract Type:
Permanent