Platform Engineer – Azure Databricks

We are hiring a Platform Engineer to deliver the engineering, operation, and administration of AMCS's Azure Databricks platform and its supporting Azure infrastructure — ensuring it is secure, reliable, and available by design, and that platform capability is delivered as code so teams can build and run data and AI workloads safely on top of it.

What you'll work on

• Provision and maintain Databricks workspaces (dev/test/prod) via the Infrastructure-as-Code — networking, cluster policies, SQL warehouses.

• Administer Unity Catalog: catalogs/schemas/external locations, access control, and data lineage across the platform.

• Build and maintain the CI/CD pipeline for databricks-workspace, structured as a Databricks Asset Bundle (notebooks, job/pipeline definitions, cluster policies), deployed via databricks bundle deploy per environment.

• Configure and enforce security: Entra ID SSO, secret scopes/Key Vault integration, network isolation.

• Monitor and optimize platform cost: DBU consumption, cluster autoscaling/termination policies, job vs. all-purpose cluster usage.

• Partner with the data engineering & analytics team building the dbt project — you're the escalation point when a job fails, a cluster misbehaves, or access/governance needs change.

What we're looking for

Must-have:

• Hands-on experience administering Databricks workspaces in production — cluster policies, SQL warehouses, workspace-level security.

• Experience with Unity Catalog governance (or an equivalent data catalog/governance layer).

• Infrastructure-as-Code experience (Terraform and/or Bicep) provisioning cloud data platform resources.

• Experience with Databricks Workflows/Lakeflow Jobs, including multi-task job dependency design.

• Familiarity with Git-based CI/CD and deploying Databricks Asset Bundles.

• Solid grasp of cloud security fundamentals: identity federation (Entra ID/Azure AD), secrets management, network isolation.

• Comfortable working from cost/usage data to right-size compute rather than over-provisioning by default.

What We Offer

• Hybrid working that keeps you flexible and connected.

• Day 1 healthcare for you and up to three dependents.

• 25 days annual leave.

• Company shuttle service.

• Free onsite meals and unlimited coffee.

• Competitive allowances and wellbeing benefits.

• Global collaboration with teams across our locations.

• Continuous learning to grow your career.

• Build innovative SaaS and AI solutions for a more sustainable future.

Ready to Make an Impact?

At AMCS, your work helps organisations operate more efficiently while contributing to a more sustainable future. If you're passionate about cloud platforms, Azure Databricks, and building secure, scalable technology foundations, we'd love to hear from you.