Databricks/Unified Data Analytics Platform Engineer
Heaven Nova Talent Solutions · Bangalore ·
- Category
- Data analytics
Heaven Nova Talent Solutions · Bangalore ·
We are looking for an experienced Databricks Unified Data Analytics Platform Engineer to design, develop, and optimize scalable data solutions on the Databricks platform.
The ideal candidate should have hands-on experience with big data technologies, ETL pipelines, cloud platforms, and modern data engineering practices.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using Databricks.
- Build and optimize ETL/ELT workflows for structured and unstructured data.
- Develop data processing solutions using Apache Spark (PySpark/Scala).
- Work with Delta Lake, Databricks SQL, and Unity Catalog.
- Integrate data from multiple sources into enterprise data platforms.
- Optimize data processing performance and ensure high availability.
- Collaborate with data scientists, analysts, and business stakeholders.
- Implement data governance, security, and best practices.
- Troubleshoot and resolve production issues.
Required Skills :
- Strong hands-on experience with Databricks Unified Data Analytics Platform.
- Apache Spark (PySpark/Scala).
- Delta Lake.
- Databricks SQL.
- SQL.
- Python.
- ETL/ELT Development.
- Azure Databricks, AWS Databricks, or GCP Databricks.
- Data Warehousing concepts.
- Git/Version Control.
- Performance Tuning and Optimization.
Preferred Skills :
- Unity Catalog.
- Azure Data Factory (ADF), AWS Glue, or similar ETL tools.
- Apache Kafka.
- Airflow.
- CI/CD pipelines.
- Knowledge of Data Lakehouse architecture.