Senior Data Engineer, Azure Databricks
About the Role
Our client is a well-established data and integration consultancy with offices across New Zealand and Australia. They're building a Wellington hub and need a Databricks specialist to help lead the way.
You'll deliver data solutions for a range of clients, report to the Data Practice Lead, and work closely with project teams and client stakeholders. This is a hands-on role with a design element. You'll build the solution, and you'll also explain to the client why it was built that way.
What You'll Be Doing
- Building and delivering Lakehouse solutions on Azure Databricks for client projects
- Developing PySpark and SQL pipelines using Medallion architecture principles
- Designing solution architecture and talking clients through your decisions
- Setting up CI/CD pipelines and sound engineering practices across projects
- Writing data quality checks and automated tests so issues are caught before production
- Reviewing existing systems and proposing improvements
- Sharing best practice with team members and client stakeholders
What We're Looking For
- Around 5 to 7 years in data engineering, with deep hands-on Azure Databricks experience
- Strong PySpark and SQL skills
- Solid architecture fundamentals, including Lakehouse and Medallion design
- Experience working with Azure data services such as Azure Data Lake and Azure Data Factory
- Clear, confident communication, including explaining technical choices to non-technical stakeholders
- A track record of end-to-end delivery, from design through to production
Nice to Have
- Python experience
- Microsoft Fabric exposure
- CI/CD experience with Git and Azure DevOps
- Infrastructure as Code experience with Terraform or Bicep
About You
You're a Databricks specialist who likes being close to the build. You've probably worked in an internal data team or a client-facing role, where you owned the outcome and not just a piece of the platform. You're comfortable in front of a client and curious about what's next.
What's on Offer
- Hybrid working, with arrangements shaped around client needs
- Hot-desk space in Wellington as the new hub gets established
- Paid certifications and support for training on Azure and Databricks
- Varied client projects, so you keep building new skills
- Offices across Christchurch, Auckland, Melbourne and Brisbane, and a team that supports your growth
How to Apply
Does this sound like you? We'd love to hear from you. If you're strong in Databricks but don't tick every box, apply anyway. We're happy to talk through where you fit, and we recruit across other levels too.
#SCR-joel-norris