Azure Data Engineer
Stanley David and Associates · Netherlands ·
- Category
- Data engineering
azureazure-data-factoryazure-devopsci-cddata-governancedata-lakedata-modelingdatabricksdelta-lakedevopseltetllakehousepysparksparksqlterraformunityvault
Build and maintain ETL/ELT pipelines on Azure using Databricks, PySpark, and Delta Lake to move and transform data for analytics and reporting.
Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using Azure Databricks and PySpark
- Work with Azure services: ADF, ADLS, Azure SQL, Synapse, Key Vault
- Implement Delta Lake and manage data lake house architecture
- Collaborate with data architects, analysts, and business stakeholders
- Deploy solutions using CI/CD pipelines (Azure DevOps preferred)
Required Skills
- Strong experience with Azure Databricks, PySpark, Spark SQL
- Hands-on with Azure Data Factory, Delta Lake, ADLS Gen2
- Proficient in SQL, data modeling, and data governance principles
- Experience with devops and Terraform
- Familiarity with Lakehouse architecture and Unity Catalog (bonus)