We are looking for an experienced Data Engineer who will be responsible for designing, building,
and maintaining scalable data pipelines and solutions on Microsoft Fabric platforms. The ideal
candidate will have solid programming skills, strong knowledge of data processing frameworks,
and hands-on capability in optimizing data workflows.
Key Responsibilities:
• Design and implement end-to-end Microsoft Fabric solutions, including data integration, transformation, and analytics.
• Proficiency in Microsoft Fabric’s Notebook for developing Apache Spark jobs.
• Hands-on experience with Python, PySpark and SparkSQL/TSQL for data transformations.
• Experience working with File Transfer Services - FTS (GoAnywhere preferred - automated and secure data movement across environments)
• Advanced SQL skills and proficiency in data integration techniques, ETL/ELT processes, and data pipeline architectures.
• Extensive knowledge of MS Fabric components like: Lakehouses, OneLake, Data Pipelines, Real-Time Analytics, Power BI Integration, Semantic Model.
• Familiarity with Azure services such as Azure Synapse, Azure Data Lake, and Azure SQL.
Requirements
Mandatory Skills:
• Expertise in Microsoft Azure/Fabric data services.
• Strong proficiency in Python and SQL.
• Hands-on experience with PySpark for distributed data processing.
• Solid understanding of ETL/ELT development and data pipeline orchestration.