Senior Data Engineer

The Senior Data Engineer is responsible for designing, developing, and optimizing scalable data solutions on the Microsoft Fabric platform. This role leads the development of data pipelines, Lakehouse architectures, and data integration frameworks to support enterprise analytics, reporting, and AI initiatives. The individual collaborates closely with business stakeholders, architects, and analytics teams to deliver reliable, high-quality data products. The role also drives data governance, performance optimization, and best practices while mentoring junior engineers and contributing to data platform modernization, automation, and continuous improvement initiatives across the organization.

• Design, develop, and maintain scalable, secure, and high-performance data pipelines using Microsoft Fabric, Data Factory, Spark Notebooks, and Lakehouse architectures.
• Lead the integration of structured and unstructured data from enterprise applications, databases, APIs, cloud services, and third-party systems into OneLake.
• Architect and implement Medallion (Bronze, Silver, Gold) data models and data transformation frameworks to support analytics and reporting requirements.
• Lead data migration and modernization initiatives from legacy platforms to Microsoft Fabric while ensuring data quality, governance, and business continuity.
• Optimize Fabric workloads, Spark processing, Warehouse queries, and storage utilization to improve performance and reduce operational costs.
• Collaborate with Data Architects, BI Developers, Business Analysts, and business stakeholders to translate requirements into scalable technical solutions.
• Develop and maintain reusable frameworks, accelerators, and automation solutions to improve engineering productivity.
• Monitor and troubleshoot production data pipelines and proactively address performance, reliability, and scalability issues.
• Create and maintain technical documentation, architecture diagrams, operational runbooks, and solution designs.
• Support advanced analytics, AI, and machine learning initiatives by building and maintaining curated data assets.

Required
• Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related field.
• 5+ years of experience in data engineering, data integration, or data platform development.
• At least 2+ years of hands-on experience with Microsoft Fabric, Azure Data Services, or equivalent cloud data platforms.

Preferred
• Microsoft Fabric Data Engineer Associate (DP-700) certification.
• Experience with enterprise-scale data modernization and migration projects.
• Experience working in Agile/Scrum delivery environments.
• Experience with DevOps, CI/CD, and Infrastructure as Code practices.