Azure DevOps

Azure Databricks DevOps Engineer | 6-week contract | Abu Dhabi

My client is looking for an experienced DevOps Engineer with strong Azure Databricks expertise to build and automate releases across development, UAT and production.

Contract: 6 weeks

Rate: Flexible, depending on experience

You must already hold the right to work in the UAE and be available to work onsite in Abu Dhabi for the first 4 weeks. Sponsorship is not available.

Start: Immediate

Location: Abu Dhabi, UAE — onsite for the first 4 weeks

The role:

• Build Azure DevOps YAML pipelines to deploy code, SQL views and Databricks jobs.
• Automate Databricks jobs through REST APIs, running under service principals.
• Manage environment-specific configuration, secrets and Unity Catalog permissions, including access for Microsoft Purview scanning.
• Integrate SQL data quality checks into pipelines to stop failing releases and daily runs.
• Configure failure alerts and produce release documentation, test evidence and rollback steps.

Experience required:

• Solid in DevOps or platform engineering, including 2+ years deploying to Azure Databricks.
• Hands‑on experience with Databricks Jobs, Unity Catalog and SQL warehouses.
• Strong Azure DevOps YAML skills, including variable groups, approval gates and environment-based releases.
• Databricks REST API experience using Python or PowerShell.
• Microsoft Entra ID service principals, OAuth and Databricks secret scopes.
• Spark SQL deployments, Git pull requests and automated pipeline checks.

You must already hold the right to work in the UAE and be available to work onsite in Abu Dhabi for the first 4 weeks. Sponsorship is not available.