Senior Data Platform Engineer – 11884SR

Overview

In this role you will design, build and operate robust cloud data platforms to support data-driven initiatives. You will collaborate with the Data & Analytics team to enable scalable, secure data pipelines across Databricks and Azure Synapse. You will automate infrastructure, governance, and monitoring to ensure reliability and security at scale. This is a hands-on engineering role with a focus on cloud platform engineering, automation, and compliance. Join a team that values practical, end-to-end data platform delivery.

Responsibilities

• Build and manage cloud data platforms with Databricks and Azure Synapse.
• Handle Azure platform engineering tasks: ADLS, Key Vault, networking, RBAC, and private endpoints.
• Implement Infrastructure as Code using Pulumi, Terraform or Bicep.
• Set up and maintain CI/CD pipelines (GitHub Actions and/or Azure DevOps).
• Administer Databricks workspace, Unity Catalog, and governance.
• Implement monitoring and observability using Azure Monitor, Log Analytics and KQL.
• Develop scalable data pipelines with Python / PySpark.
• Focus on security, access management, automation and platform operations.

Key requirements

• Hands-on experience building and managing data platforms in cloud environments.
• Strong focus on cloud infrastructure, automation, security and reliability.
• Experience with Databricks and Azure Synapse (not limited to ADF or Synapse analytics).
• Proficiency with IaC tools (Pulumi, Terraform or Bicep).
• CI/CD experience (GitHub Actions and/or Azure DevOps).
• Databricks workspace administration, Unity Catalog and governance.
• Monitoring and observability tools (Azure Monitor, Log Analytics, KQL).
• Python / PySpark and scalable data pipeline development.

• Databricks
• Azure Synapse
• Azure Data Lake Storage (ADLS)
• Azure Key Vault
• Networking
• RBAC