Job Description
Position: Microsoft Fabric Core Lead Engineer
Experience: 10+ Years
Location: Hyderabad, Pune, Bengaluru, Coimbatore
Notice Period: Immediate Joiners
Roles & Responsibilities
Position Summary
The Microsoft Fabric Core Lead Engineer is responsible for leading the design, development, implementation, and support of enterprise-scale data and analytics solutions using Microsoft Fabric. The role provides technical leadership, drives architecture decisions, mentors engineering teams, and ensures successful delivery of scalable, secure, and high-performing data platforms.
Roles & Responsibilities
Technical Leadership
- Lead the end-to-end implementation of Microsoft Fabric solutions across enterprise programs.
- Define technical architecture, engineering standards, and best practices for Microsoft Fabric adoption.
- Provide technical leadership to a team of data engineers and developers.
- Review solution designs, code, and deployment strategies to ensure quality and scalability.
Microsoft Fabric Architecture
- Design and implement enterprise data platforms using Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Real-Time Intelligence, Data Engineering, and Power BI.
- Architect scalable, cloud-native data solutions supporting analytics, AI, and business intelligence workloads.
- Establish reusable design patterns and reference architectures.
Data Engineering & Integration
- Design and develop robust ETL/ELT pipelines using Microsoft Fabric Data Factory and Spark Notebooks.
- Integrate structured, semi-structured, and unstructured data from cloud and on-premises systems.
- Implement data transformation, cleansing, validation, and orchestration processes.
- Optimize data ingestion strategies for performance and reliability.
Data Modeling & Analytics
- Design dimensional models, Lakehouse architectures, and enterprise data warehouses.
- Develop semantic models and datasets for Power BI reporting and self-service analytics.
- Collaborate with business teams to translate analytical requirements into scalable data solutions.
Performance Optimization
- Optimize Spark workloads, SQL Warehouse performance, and OneLake storage utilization.
- Implement partitioning, indexing, caching, and workload optimization strategies.
- Monitor platform performance and proactively resolve bottlenecks.
Security & Governance
- Implement enterprise security using Microsoft Entra ID, RBAC, and Fabric workspace security.
- Define governance policies for data quality, lineage, cataloging, auditing, and compliance.
- Ensure adherence to enterprise security, privacy, and regulatory standards.
DevOps & Automation
- Implement CI/CD pipelines using Azure DevOps or GitHub.
- Automate deployment of Microsoft Fabric artifacts across Development, QA, UAT, and Production environments.
- Manage source control, release management, and deployment automation.
AI & Advanced Analytics
- Enable AI, Machine Learning, and Copilot capabilities within Microsoft Fabric.
- Support Data Science workloads using Spark, notebooks, and ML models.
- Collaborate with AI teams to operationalize predictive analytics and intelligent data solutions.
Production Support & Operations
- Lead production deployments and post-production support activities.
- Monitor platform health, troubleshoot incidents, and ensure SLA compliance.
- Implement disaster recovery, backup, and business continuity strategies.
Stakeholder Management
- Collaborate with enterprise architects, product owners, business stakeholders, and cross-functional teams.
- Participate in architecture review boards and technical governance meetings.
- Communicate technical solutions and project status to senior leadership.
Team Leadership & Mentoring
- Mentor junior and senior engineers on Microsoft Fabric technologies and engineering best practices.
- Conduct code reviews, design reviews, and technical knowledge-sharing sessions.
- Drive continuous improvement initiatives and foster engineering excellence.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- 10+ years of experience in Data Engineering, Data Warehousing, or Cloud Data Platform development.
- 4+ years of hands-on experience with Microsoft Azure Data Platform technologies.
- 2+ years of hands-on experience with Microsoft Fabric in enterprise implementations.
- Strong expertise in SQL, PySpark, Python, and Spark optimization.
- Experience with Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI, and Real-Time Intelligence.
- Experience with Azure Data Lake Storage (ADLS), Azure DevOps, GitHub, and CI/CD pipelines.
- Strong knowledge of dimensional data modeling, ETL/ELT architecture, and data governance.
- Experience leading technical teams and delivering large-scale enterprise data modernization programs.
Preferred Skills
- Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
- Microsoft Certified: Fabric Data Engineer Associate (DP- 700)
- Microsoft Azure Data Engineer Associate (DP-203)
- Experience with Databricks, Synapse Analytics, Azure AI Services, or Microsoft Purview.