Senior Data Engineer – Microsoft Fabric (Snowflake or Databricks)
We’re growing our data engineering practice and need a Senior Data Engineer who can own delivery as well as build. This person will lead project squads – running stand-ups, managing scope, keeping RAID up to date, and reporting to stakeholders – while also being hands‑on in Microsoft Fabric. Snowflake or Databricks is a nice‑to‑have. This role is for someone who can keep a data project on track, on budget, and visible to the business.
Note: the role requires the candidate to be Sydney-based, able to work a minimum of 4 days per week in the office, and to have full working rights in Australia.
Core Responsibilities:
- Lead delivery for a small data squad: plan iterations, run ceremonies, manage scope and risks, maintain RAID, and provide regular status updates to stakeholders.
- Work with architects/consultants on solution design, estimation and SoWs; demo increments to business/exec users.
- Design and build scalable data models and pipelines on Microsoft Fabric (OneLake, Lakehouse, Pipelines, Dataflows Gen2, Semantic Models) and at least one of Snowflake or Databricks.
- Implement notebook/dbt transformations (tests, docs, exposures) and enforce best practices (modularity, lineage, CI checks).
- Set up CI/CD for data projects (Git, Azure DevOps or GitHub Actions).
- Optimise performance and cost (Fabric capacities, pipeline runtimes; Snowflake warehouses or Databricks clusters).
- Ensure security and governance (RLS/column security, PII handling, Purview/lineage).
- Keep documentation, patterns, and reusable components current for the practice.
Required Qualifications:
- 5–10+ years in data engineering in consulting or complex enterprise environments.
- Sydney-based and able to work a minimum of 4 days per week in the office.
- Must have full working rights in Australia.
- Proven experience leading project workstreams/small teams – sprint planning, stakeholder comms, status reporting, risk management.
- Strong hands‑on with Microsoft Fabric and at least one of Snowflake or Databricks.
- Solid CI/CD for data, strong SQL and Python, familiarity with Parquet/Delta/Iceberg.
- Excellent communication skills – able to talk to both engineers and business.
Nice to have
- AWS data stack, Terraform/Bicep, AWS DMS.
- Data governance & lineage (Purview), RLS/CLS, masking.
- Testing/observability tools (Great Expectations, Soda, Monte Carlo/Revefi).
- Power BI/Tableau, DAX/Tabular.
- Formal PM experience or having acted as a project lead on data deliveries.
What you’ll get in return:
Work with marquee Australian clients on modern stacks (Snowflake, Fabric, Databricks). Real ownership with support from senior architects and practice leads. Flexible hybrid work and a supportive culture.