Azure Databricks Data Engineer: Spark, SQL & Python
CareCone Group · Sydney, Australia ·
- Category
- Data engineering
A hands-on data engineer role designing, building, and optimizing high-throughput pipelines on Azure Databricks with Spark, SQL, and Python. Day to day involves scalable ETL/ELT architecture in a modern data lake, real-time integrations, and robust pipelines delivered with CI/CD and observability.
CareCone Group is seeking a hands-on Data Engineer to design, build, and optimize high-throughput data pipelines on Azure Databricks using Spark (Scala) and SQL. The role focuses on scalable ETL/ELT architecture within a modern data lake framework.
The ideal candidate will implement real-time and near real-time data integrations, ensuring robust pipelines with CI/CD and observability. Knowledge of Delta Lake and Azure DevOps is advantageous for efficient delivery.