Senior Data Engineer
User Experience Researchers Pte.Ltd · Cyberjaya, Selangor, Malaysia ·
- Seniority
- Senior
- Category
- Data engineering
Senior Data Engineer migrating BI solutions to MS Fabric, designing Medallion architectures, and developing features using SparkSQL, T-SQL, and PySpark.
We are seeking a highly skilled Senior Data Engineer to participate in the migration of existing BI solutions to MS Fabric, as well as in their future development and support. The ideal candidate will demonstrate high performance and the ability to work autonomously while collaborating closely with the core team.
Key responsibilities include:
- Migration of tables from existing Microsoft SQL Server databases to Fabric
- Migration of semantic models from SSAS to Fabric
- Internal testing and documentation of migrated solutions
- Designing of the new solution structure on Bronze, Silver, Gold & Platinum layers (Medallion architecture)
- Development of new features on all solution layers
ESSENTIAL (MUST HAVE) SKILLS:
- Advanced experience with Fabric components, namely – Lakehouses, Warehouses, Pipelines & Notebooks (SparkSQL)
- Very good knowledge of T-SQL
- Good knowledge of PowerBI/Fabric semantic models and DAX
- Knowledge of PySpark
- Knowledge of Azure DevOps versioning and deployment
FOLLOWING SKILLS ARE ADVANTAGE:
- Experience with Azure Log Analytics - defining & querying
- Experience with metadata driven development approach
- Experience with SSAS Tabular models
- Experience with DAX performance tuning
- Experience with Power BI reports development