Databricks Developer - Data Engineering
Chaitra Soft · Hyderabad ·
- Category
- Data engineering
- Experience
- 7+ years
Chaitra Soft · Hyderabad ·
Job Summary:
We are looking for an experienced Databricks Developer with strong expertise in Python, SQL, and Databricks to develop scalable data solutions, build curated datasets, and support self-service analytics using Databricks Genie and AI/BI capabilities.
Key Responsibilities:
- Develop modular Python applications, reusable utilities, APIs, and scalable data solutions on Databricks.
- Build and maintain curated datasets and semantic layers using Databricks SQL and Unity Catalog.
- Configure and optimize Databricks Genie/AI-BI spaces to enable natural-language querying and self-service analytics.
- Manage metadata, instructions, and data definitions to improve the accuracy and quality of natural-language queries.
- Develop and optimize SQL queries and data processing workflows.
- Work with Apache Spark and PySpark for data transformation and processing.
- Implement data governance, access controls, and security best practices using Unity Catalog.
- Debug technical issues, troubleshoot data pipelines, and optimize application and query performance.
- Collaborate with data engineers, analysts, and business stakeholders to deliver reliable data solutions.
Required Skills:
- 5+ years of experience in Python development and data engineering.
- Strong proficiency in Python, SQL, and Databricks.
- Hands-on experience with Databricks SQL and Unity Catalog.
- Experience building APIs, reusable Python modules, and data processing solutions.
- Knowledge of Apache Spark/PySpark and data transformation techniques.
- Exposure to Databricks Genie, AI/BI spaces, and natural-language query configuration.
- Understanding of data governance, metadata management, debugging, and performance optimization.
- Strong analytical, problem-solving, and communication skills.