Data Engineer (Databricks)

We’re looking for an experienced Data Engineer to join our team and work on enterprise-scale data engineering initiatives, building scalable and reliable data pipelines and modern data solutions.

What You’ll Be Doing

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes
• Build and optimize data engineering solutions using Databricks
• Work with large-scale datasets using Apache Spark / PySpark
• Develop complex data transformations using SQL and Python
• Build and maintain reliable batch and/or real-time data pipelines
• Work with Delta Lake and Lakehouse architecture
• Optimize data pipelines and Spark workloads for performance and scalability
• Implement data quality, monitoring, and data governance practices
• Collaborate with Data Architects, Data Scientists, Analysts, Developers, and business stakeholders
• Participate in technical design, code reviews, testing, deployment, and production support
• Help drive data engineering best practices and provide technical guidance to other engineers
• 8–10 years of experience in Data Engineering
• Strong hands-on experience with Databricks – MUST HAVE
• Strong experience with Apache Spark / PySpark
• Strong understanding of data warehousing and data modeling
• Experience working with large-scale/distributed data processing
• Solid experience in ETL/ELT and data pipeline development
• Experience with cloud-based data platforms
• Experience with Git and CI/CD practices
• Strong analytical and problem-solving skills
• Delta Lake / Lakehouse experience
• Unity Catalog
• Delta Live Tables (DLT)
• Azure Data Factory or equivalent cloud data integration tools
• Experience implementing CI/CD for Databricks/data engineering workloads
• Experience with data governance and security