Data Platform Engineer

• 5+ years of experience in DevOps, platform engineering, or site reliability engineering roles
• 3+ years of hands-on experience with Microsoft Azure cloud services and Azure DevOps
• Strong experience with Microsoft Fabric or related Microsoft data platforms (PowerBI, Azure Synapse Analytics, Azure Data Factory)
• Expertise in Infrastructure as Code tools(terraform, Ansible, ARM templates, Cloud Formation)
• Proficiency in scripting and programming languages including Python, PowerShell, Bash, and SQL
• Deep understanding of CI/CD principles and tools (AzureDevOps, GitHub Actions)
• Experience with containerization and orchestration technologies (Docker, Kubernetes) and cloud services (AKS, EKS, GKE)
• Experience with cloud blob data services (Azure Storage, AWS S3, GCP Cloud Storage) and cloud managed relational databases (Azure SQL, Amazon RDS, GCP Cloud SQL)
• Strong knowledge of data warehousing, data lakes, lake house architectures, and ETL/ELT processes
• Hands-on experience with monitoring and observability tools(Azure Monitor, Prometheus, Grafana, ELK Stack, Datadog)
• Understanding of storage ACLs, network security, encryption, identity management, and cloud security best practices
• Experience deploying and managing Microsoft Fabric workspaces, capacities, and items
• Knowledge of One Lake architecture, shortcuts, mirroring, maintenance, and security
• Familiarity with Fabric REST APIs and SDK for automation and integration
• Experience with Fabric Git integration and deployment pipelines
• Knowledge of Power BI administration and deployment best practices
• Proficiency in designing scalable ETL/ELT architectures and data pipeline orchestration strategies
• Knowledge of Delta Lake, Parquet for optimization techniques such as partitioning/clustering
• Deep understanding of data lakehouse architecture, medallion patterns, and data mesh organizational frameworks

Responsibilities

Platform Engineering & Architecture

• Design, build, and maintain the Microsoft Fabric data platform infrastructure, including OneLake, Data Warehouse, Lakehouse, Data Factory pipelines, Real-Time Intelligence, and Power BI environments
• Implement and manage platform architecture supporting data engineering, data science, analytics, and business intelligence workloads across the organization
• Develop and maintain Infrastructure as Code (IaC) solutions using Terraform, Azure Resource Manager templates, or similar tools for consistent, repeatable deployments
• Architect multi-region, scalable solutions within Microsoft Fabric to support global humanitarian operations
• Design and implement OneLake storage structure, shortcuts, mirroring configurations, and data lake optimization strategies

CI/CD & Deployment Automation

• Build and maintain comprehensive CI/CD pipelines for Microsoft Fabric workspaces using Azure DevOps
• Implement automated deployment strategies utilizing Fabric REST APIs, Git integration, Fabric deployment pipelines, and fabric-cicd tools
• Manage source control integration with Microsoft Fabric workspaces, establishing branching strategies and deployment workflows across development, test, and production environments
• Automate infrastructure provisioning, configuration management, and deployment processes for all Fabric components
• Develop and maintain deployment rules, parameterization strategies, and environment-specific configurations

Platform Maintenance & Operations

• Perform ongoing maintenance of Microsoft Fabric platform components including capacity management, workspace administration, and item lifecycle management
• Monitor platform health, performance metrics, and resource utilization using Azure Monitor, Prometheus, Grafana, or integrated Fabric monitoring capabilities
• Implement comprehensive observability and alerting framework covering logs, metrics, and traces across the entire data platform
• Conduct regular platform updates, patches, and upgrades while minimizing disruption to users and maintaining system stability
• Manage disaster recovery procedures, backup strategies, and business continuity planning for critical data assets
• Optimize platform performance through capacity planning, resource allocation, and cost management strategies

Security, Governance & Compliance

• Implement and enforce security controls using Microsoft Purview for data governance, classification, and protection across the Fabric ecosystem
• Configure and maintain role-based access controls (RBAC), row-level security, column-level security, and OneLake folder/table-level permissions
• Establish and enforce data sensitivity labeling, information protection policies, and data loss prevention (DLP) measures
• Integrate Microsoft Entra authentication, manage service principals, and implement managed identities for secure platform access
• Ensure compliance with global regulatory frameworks including GDPR, HIPAA, and ISO standards through automated controls and auditing
• Implement network security measures including conditional access, private endpoints, customer-managed encryption keys, and secure data sharing protocols
• Monitor and respond to security incidents, conducting regular security assessments and vulnerability management

Automation & Scripting

• Develop automation scripts using Python, PowerShell, Bash, and Azure CLI for routine operational tasks and platform management
• Create custom tooling and utilities to enhance platform capabilities and improve developer experience
• Automate data pipeline orchestration, monitoring, alerting, and incident response workflows