Data Platform Engineer (Infrastructure & Data Engineering)
INSIGHT INTERNATIONAL Limited · London, UK ·
- Category
- Data engineering
automationazureazure-devopsci-cddatabricksdevopsgithubgithub-actionsinfrastructure-as-codenetworkingterraformunity
A platform engineer role building and maintaining the data platform on Azure: writing Terraform for Azure Databricks and Azure infrastructure, running CI/CD pipelines (Azure DevOps, GitHub Actions), and creating Python/.NET automation, tooling, and shared libraries for data engineers and analysts.
Job Summary (List Format): - Design and maintain CI/CD pipelines: Develop and manage continuous integration and deployment workflows using DevOps tools (Azure DevOps, GitHub Actions) for both infrastructure and application deployments. - Infrastructure as Code (IaC): Write and maintain Terraform code to provision and manage Azure infrastructure and Azure Databricks resources (Unity Catalog, workspaces, networking, compute policies). - Application development and automation: Create and support p…