Praesignis · Gauteng, South Africa ·
A senior data engineer designs, builds, and supports scalable data solutions on Microsoft Fabric, developing ingestion, transformation, and integration pipelines (Data Pipelines, Dataflows Gen2, OneLake/Lakehouse/Warehouse) while writing production code in C# and Python, SQL/PySpark processing, shell scripts, and Power BI semantic model support.
Acveti · India
Perficient · Colombia
icmasiapacific · Auckland, New Zealand, New Zealand
Pearson Carter · Wellington, New Zealand
Wearelookingforanexperienced Senior Data Engineerwithstronghands-onexperiencein Microsoft Fabric,dataengineeringandsoftwaredevelopment. Thesuccessfulcandidatemustbecomfortablewritingcodeandhavepracticalprogrammingexperienceusing C#and Python.
Thecandidatemusthaveastrongunderstandingofmoderndataengineeringprinciplesandbeabletodesign,develop,optimiseandsupportscalabledatasolutionsusing Microsoft Fabric.
Responsibilities Design,developandmaintainmoderndataengineeringsolutionsusing Microsoft Fabric. Developandmaintaindataingestion,transformationandintegrationpipelines. Workwith One Lake, Lakehouseand Fabric Warehouse. Developandoptimise Data Pipelinesand Dataflows Gen2. Writeandmaintainproduction-qualitycodeusing Pythonand C#. Developandmaintain Shellscriptstoautomatedataprocessing,filetransfers,jobschedulingandoperationaltasks. Use SQLand,whereapplicable, Py Spark/Sparkfordataprocessingandtransformation. Developdatamodelsandsupport Power BIandsemanticmodels. Monitor,troubleshootandoptimisedatapipelinesanddataworkloads. Investigateandresolvedataquality,performanceandintegrationissues. Ensuredatasolutionsarereliable,scalable,secureandfitforpurpose. Translatebusinessrequirementsintotechnicaldatasolutions. Collaboratewith Data Engineers, BIDevelopers, Architectsandbusinessstakeholders. Supporttheimplementationofbestpracticesacrossdataengineering,developmentanddeployment.
Requirements 5+years'experiencein Data Engineeringorarelatedtechnicaldatarole. 3+years'stronghands-onexperiencewith Microsoft Fabric. Valid Microsoft Certified: Fabric Data Engineer Associate(DP-700)certification–Essential. Strongprogrammingandsoftwaredevelopmentexperience. Provenhands-onexperiencewritingcodeusing C#and Python. Hands-onexperiencewith Shell Scripting. Strong SQLskills. Experiencewith One Lake, Lakehouseand Fabric Warehouse. Experiencedeveloping Fabric Data Pipelinesand Dataflows Gen2. Strongunderstandingof ETL/ELT,datamodellinganddatawarehousing. Experiencewith Power BIandsemanticmodels. Experiencewith Azure/cloud-baseddataplatforms. Strongtroubleshootingandproblem-solvingskills. Abilitytoworkindependentlyandengageeffectivelywithtechnicalandbusinessstakeholders.
Certification–Essential Microsoft Certified: Fabric Data Engineer Associate(DP-700)–Validcertificationrequired.
Advantageous Azure Data Engineeringexperience. Py Spark/Spark. Azure Data Factory, ADLSor Synapse. CI/CDand Dev Opsexperience. Datagovernance,securityanddataquality. Experienceworkingin Agileenvironments. #J-18808-Ljbffr
Core Technology Systems Limited · Poland