Azure Databricks Data Engineer — Real-Time ETL Pipelines
CareCone Group · Sydney, Australia ·
- Category
- Data engineering
A hands-on data engineer in Sydney who designs, builds, and optimizes high-throughput real-time ETL/ELT pipelines on Azure Databricks using Spark (Scala) and SQL, applying medallion architecture and Delta Lake practices, with Git/Azure DevOps CI/CD and pipeline observability.
CareCone Group in Sydney is seeking a hands-on Developer/Programmer to design, build, and optimize high-throughput data pipelines on Azure Databricks using Spark (Scala) and SQL. The role focuses on scalable ETL/ELT pipelines with medallion architecture and Delta Lake best practices.
You will implement real-time integrations, operationalize workloads, and manage CI/CD with Git and Azure DevOps, ensuring observability across data pipelines.