Databricks Platform Engineer/Administrator
NS Global Corporation · Chennai; Hyderabad; Noida; Mumbai; Kolkata; Nagpur; Warangal; Bangalore; Bhubaneshwar; Maharashtra; Telangana; Odisha ·
- Category
- Devops
- Experience
- 3+ years
NS Global Corporation · Chennai; Hyderabad; Noida; Mumbai; Kolkata; Nagpur; Warangal; Bangalore; Bhubaneshwar; Maharashtra; Telangana; Odisha ·
Role Overview :
We are looking for an experienced Databricks Platform Engineer to manage, maintain, secure, and optimize enterprise-scale Databricks environments hosted on AWS. The ideal candidate will have strong expertise in Databricks administration, Unity Catalog, AWS infrastructure, Terraform automation, platform operations, and cost optimization.
Key Responsibilities :
- Administer Databricks workspaces, clusters, compute policies, jobs, and access controls.
- Manage Unity Catalog, data governance, permissions, and workspace security.
- Monitor platform health, utilization, performance, and capacity.
- Troubleshoot production incidents, perform root cause analysis, and restore services.
- Automate infrastructure provisioning and platform operations using Terraform, Databricks APIs, CLI, Python, and Shell scripting.
- Manage AWS services, networking, IAM, security controls, and monitoring.
- Analyze usage and implement cost optimization and FinOps practices.
- Support deployments, environment promotion, CI/CD integration, and release management.
- Maintain operational runbooks, SOPs, and technical documentation.
- Collaborate with Cloud, Security, Data Engineering, and Architecture teams to ensure platform reliability and compliance.
Mandatory Skills :
- Databricks Administration : Account and workspace administration, cluster management, compute policies, Unity Catalog, access governance.
- AWS Cloud : IAM, S3, VPC, KMS, DynamoDB, MSK, PrivateLink, CloudWatch.
- Infrastructure Automation : Terraform, IaC, Databricks REST APIs, CLI, Python, Shell scripting.
- Platform Operations : Production support, incident management, monitoring, alerting, troubleshooting, capacity planning.
- Cost Optimization : Usage analytics, cost monitoring, resource optimization, FinOps.
- Data Platform : SQL, ETL processes, data pipelines, workflow scheduling.
Candidate Requirements :
- 5+ years of experience in cloud platform engineering, administration, or data platform support.
- Minimum 3+ years of hands-on Databricks Administration experience in production environments.
- Strong experience managing Databricks on AWS, including Unity Catalog and platform governance.
- Proven expertise in Terraform and Databricks API/CLI automation.
- Strong troubleshooting, communication, documentation, and incident management skills.
- Bachelor's degree in Computer Science, IT, Engineering, or a related field.
Mandatory Certifications : Databricks Certification (Administrator/Data Engineer) and AWS Certification (Associate level or above).