Position Summary:
The Azure Cloud Engineer – Data Platform will help design, build, automate, secure, and operate the Microsoft cloud services and integration components that move data across enterprise systems and into the enterprise data platform. This role bridges cloud platform engineering and data delivery, supporting both the Azure foundations and the managed Microsoft services that enable reliable data flows.
You will partner with data engineers, data architects, cybersecurity, infrastructure teams, application teams, and business stakeholders to implement secure connectivity, reusable ingestion and orchestration patterns, and supportable environments across Microsoft Azure and Microsoft Fabric. The role will configure and operate the platform capabilities used by data engineers while also building data-movement pipelines and integrations where Microsoft services managed are the appropriate solution.
You will apply cloud engineering, data integration, infrastructure-as-code, networking, identity, monitoring, and DevOps practices to ensure enterprise data workloads are deployed consistently and operated with high standards of availability, security, performance, cost efficiency, and supportability.
Essential duties and responsibilities:
- Help design, deploy, configure, and maintain Azure and Microsoft Fabric platform services supporting enterprise data ingestion, integration, storage, analytics, and reporting workloads.
- Provision and configure Microsoft data services, including Microsoft Fabric, Azure Data Factory, Azure Data Lake Storage, Azure SQL, Azure Functions, Azure Key Vault, Azure Monitor, and Log Analytics.
- Build and support data-movement and orchestration pipelines using Microsoft Fabric Data Factory, Azure Data Factory, Dataflows Gen2, and related managed Microsoft services.
- Configure and maintain connections, gateways, integration runtimes, linked services, managed private endpoints, triggers, schedules, and other components required for reliable data flows.
- Enable secure connectivity between Microsoft Fabric, Azure services, on-premises systems, enterprise applications, software-as-a-service platforms, databases, files, application programming interfaces, and external data providers.
- Use and contribute to reusable ingestion and integration patterns for common source types, including parameterized pipelines, connectors, configuration, error handling, retry, logging, and alerting.
- Partner with data engineers and data architects to translate data solution requirements into secure, scalable, and supportable platform configurations and integration workflows.
- Build and support development, testing, quality assurance, and production environments for data platform workloads and data integrations.
- Use and contribute to reusable infrastructure-as-code modules using Bicep, Terraform, ARM templates, or similar technologies.
- Develop and support continuous integration and continuous deployment processes for Azure resources, Microsoft Fabric items, pipelines, notebooks, and platform configuration using Azure DevOps or GitHub Actions.
- Automate resource provisioning, environment configuration, platform administration, pipeline deployment, monitoring, and operational support activities using established standards and patterns.
- Support the configuration of Azure networking components required by data workloads and partner with infrastructure teams on virtual networks, subnets, network security groups, private endpoints, private DNS, firewalls, gateways, and hybrid connectivity.
- Configure and support Microsoft Entra ID groups, role-based access control, managed identities, service principals, workload identities, and application registrations following established security standards.
- Implement secure management of credentials, secrets, certificates, and encryption keys using Azure Key Vault.
- Apply established Azure Policy, resource-lock, tagging, diagnostic-setting, security-baseline, and cloud-governance standards to data platform resources.
- Support Microsoft Fabric capacities, workspaces, gateways, connections, deployment pipelines, and environment-promotion practices.
- Monitor Azure services, Microsoft Fabric workloads, pipelines, gateways, connections, capacity utilization, data-flow health, and cost trends.
- Configure operational logging, dashboards, alerts, and notifications using Azure Monitor, Log Analytics, Application Insights, and Microsoft Fabric monitoring capabilities.
- Troubleshoot infrastructure, identity, networking, connectivity, deployment, pipeline, gateway, performance, capacity, and availability issues, escalating or partnering with specialized teams when appropriate.
- Participate in incident response, root-cause analysis, problem management, change management, backup, recovery, resiliency, and corrective-action planning for critical data platform services.
- Create and maintain platform architecture diagrams, integration diagrams, configuration standards, deployment documentation, operational procedures, recovery instructions, and support runbooks.
- Communicate professionally with technical and non-technical stakeholders at all levels within and outside of the organization.
Supervisory Responsibilities: None
Education and Experience:
- Bachelor’s degree or equivalent combination of education and experience.
- 3+ years of relevant experience in cloud engineering, data platform engineering, data integration, or a related field.
Qualifications:
- Ability to work independently and cooperatively to solve moderately complex cloud platform and data integration problems.
- Hands-on experience supporting Microsoft Azure services in a development, testing, or production environment.
- Hands-on experience building or supporting data-movement and orchestration pipelines with Microsoft Fabric Data Factory, Azure Data Factory, or a comparable integration service.
- Experience connecting two or more common source types, such as relational databases, files, application programming interfaces, software-as-a-service applications, cloud services, or on-premises systems.
- Experience configuring or supporting Microsoft Fabric or Azure data services such as Azure Data Factory, Azure Data Lake Storage, Azure SQL, Lakehouse, Warehouse, or OneLake.
- Working knowledge of Microsoft Entra ID, role-based access control, managed identities, service principals, application registrations, and Azure Key Vault.
- Working knowledge of cloud networking concepts such as DNS, routing, firewalls, network security groups, private endpoints, gateways, and hybrid connectivity.
- Familiarity with infrastructure-as-code technologies such as Bicep, Terraform, or ARM templates.
- Familiarity with Azure DevOps, GitHub Actions, or another continuous integration and continuous deployment platform.
- Experience using Git-based source control, branching, peer review, release management, and environment-promotion practices.
- Experience scripting or automating technical tasks using PowerShell, Azure CLI, Python, or similar languages.
- Experience monitoring and troubleshooting cloud services or data integrations using Azure Monitor, Log Analytics, Application Insights, Microsoft Fabric monitoring, or similar tools.
- Understanding data platform concepts, including ingestion, orchestration, data lakes, Lakehouse’s, warehouses, transformation, analytics, and reporting.
- Working knowledge of reliable integration patterns, including parameterization, scheduling, dependency management, error handling, logging, and alerting.
- Effective communication, documentation, collaboration, and problem-solving skills for working with technical and non-technical stakeholders in an agile environment.
Preferred:
- Experience administering Microsoft Fabric capacities, workspaces, gateways, connections, deployment pipelines, Lakehouse, Warehouse, or OneLake.
- Experience supporting production data platforms or integrations with defined availability, performance, backup, recovery, data-freshness, and support requirements.
- Experience with advanced hybrid networking, private connectivity, or cross-environment data integration.
- Experience with Microsoft Purview, Microsoft Defender for Cloud, Microsoft Sentinel, or related governance and security technologies.
- Familiarity with SQL, Python, PySpark, notebooks, or related data-processing technologies.
- Experience designing reusable infrastructure-as-code modules, integration frameworks, or deployment patterns.
- Microsoft Azure, Microsoft Fabric, DevOps, security, networking, or Terraform certifications.