Senior Data Engineer / Consultant - Databricks
icmasiapacific · Any Location, New Zealand, New Zealand ·
- Work mode
- Hybrid
- Seniority
- Senior
- Category
- Data engineering
icmasiapacific · Any Location, New Zealand, New Zealand ·
ABOUT ADAPTIV
Adaptiv is a Kiwi success story specialising in Integration, Data, AI and Cloud Consulting. We help organisations unlock greater value from their data through modern integration and analytics solutions built on technologies including Databricks, Microsoft Azure, Microsoft Fabric, MuleSoft, Boomi and Solace.
Based in our Grey Lynn/Ponsonby offices, we offer a collaborative, people-first culture where curiosity, initiative and continuous learning are valued. We combine strong technical capability with a practical, down-to-earth approach and are looking for people who share that mindset.
We are ideally seeking candidates based in Auckland. We will also consider people located in Christchurch, Wellington or elsewhere in New Zealand who are able to travel when required.
ABOUT THE ROLE
We are looking for experienced Senior Data Engineers / Consultants to join our growing Data Practice.
These are hands-on consulting roles focused on delivering modern Databricks and Azure-based data solutions across a variety of client environments. You will work closely with clients, architects and delivery teams to design, build, deploy and optimise scalable data platforms that deliver meaningful business outcomes.
Success in this role requires strong engineering capability together with the confidence to engage directly with stakeholders, understand business requirements and translate them into practical, supportable data solutions.
As a senior member of the team, you will also contribute to solution design, mentor other engineers and help strengthen the frameworks, standards and reusable delivery practices supporting Adaptiv’s continued growth.
WHAT YOU’LL BE DOING
• Design, build and optimise production data pipelines across Lakehouse and data warehouse environments.
• Develop high-quality data transformations using Python, PySpark and SQL for analytics, reporting and AI/ML workloads.
• Deliver solutions using Azure Databricks, Delta Lake, notebooks, workflows and Medallion Architecture.
• Work with Lakeflow Spark Declarative Pipelines, formerly Delta Live Tables, where appropriate.
• Implement governance and security practices using capabilities such as Unity Catalog.
• Build and maintain automated deployment processes using Git, Databricks Asset Bundles and CI/CD pipelines.
• Work with orchestration technologies such as Databricks Workflows, Azure Data Factory or Apache Airflow.
• Implement automated testing, monitoring, data-quality and operational-support practices.
• Lead technical discussions and translate business requirements into practical engineering outcomes.
• Collaborate with architects and delivery teams on solution design, estimation and delivery planning.
• Communicate delivery progress, risks and technical decisions clearly to clients and internal stakeholders.
• Mentor junior and intermediate engineers and support knowledge sharing across the Data Practice.
• Contribute to the continuous improvement of engineering frameworks, templates and delivery standards.
WHAT YOU’LL BRING
• Significant commercial Data Engineering experience, ideally gained across complex enterprise environments.
• Strong recent hands-on experience delivering production solutions using Databricks.
• Demonstrated capability across Python, PySpark and SQL.
• Experience building Lakehouse, data warehouse or cloud-native data platforms.
• Practical experience with Delta Lake, notebooks, workflows and Medallion Architecture.
• Experience with modern Databricks capabilities such as Lakeflow/Delta Live Tables, Unity Catalog or Databricks Asset Bundles.
• Strong understanding of data modelling, scalable pipeline design and engineering-performance optimisation.
• Experience using Git, CI/CD and DevOps practices to deploy data solutions across environments.
• Experience implementing testing, monitoring, reconciliation or automated data-quality frameworks.
• Strong stakeholder engagement and communication capability.
• Experience gathering requirements and translating them into technical designs and delivery plans.
• Experience mentoring engineers or providing technical leadership while remaining hands-on.
• Relevant Databricks certification or a demonstrated commitment to ongoing professional development.
Experience with Microsoft Fabric and the wider Azure Data Platform would be advantageous but is not essential where strong Databricks engineering capability is demonstrated.
ABOUT YOU
• You are a strong communicator who enjoys working directly with clients and stakeholders.
• You are self-motivated, organised and focused on successful delivery.
• You are comfortable balancing multiple priorities and working through ambiguity.
• You are curious, adaptable and committed to continuous learning.
• You have a strong problem-solving mindset and take ownership of delivery outcomes.
• You are professional, collaborative and enjoy contributing to a high-performing team.
WHY JOIN ADAPTIV?
• Join a high-performing, collaborative and supportive team.
• Deliver solutions using modern technologies including Databricks, Azure and Microsoft Fabric.
• Work across varied client environments and meaningful data-transformation programmes.
• Access genuine opportunities for career growth and technical development.
• Contribute to the development of Adaptiv’s growing Data Practice.
• Work from modern offices across Auckland, Christchurch, Wellington, Melbourne and Brisbane.
• Make a visible impact across client projects and the wider business.
Applicants must already hold the appropriate right to work in New Zealand.
If you are looking to combine hands-on Databricks engineering with consulting, stakeholder engagement and technical leadership, we would love to hear from you.