Data Engineer / Databricks Platform Administrator

• AGSVA Security clearance required (Baseline - minimum)

We are working with a leading global technology organisation to find a highly skilled Data Engineer / Databricks Platform Administrator to join their Data & AI team. This hybrid role combines Databricks platform engineering and administration with hands‑on data engineering delivery responsibilities.

You will play a key role in establishing and operating a secure, scalable, enterprise‑grade Databricks platform on AWS while also contributing to data pipeline development, governance initiatives, and engineering best practices.

Key Responsibilities

• Design, build, and implement Databricks workspaces on AWS from the ground up.
• Configure and manage Unity Catalog, metastores, catalogs, schemas, storage credentials, and access controls.
• Design secure network architectures using AWS VPCs, Private Link, network isolation, and enterprise security best practices.
• Implement and manage IAM roles, instance profiles, and cloud access models.
• Develop and maintain Infrastructure-as-Code solutions using Terraform or equivalent tooling.
• Establish CI/CD pipelines for platform configuration, deployment, and governance controls.
• Define and enforce cluster policies, workspace standards, and operational guardrails.

Required Skills & Experience

• Strong hands‑on experience administering Databricks environments.
• Experience implementing and managing Unity Catalog and Databricks governance frameworks.
• Experience building and supporting production‑grade data pipelines.
• Strong Python and SQL development skills.
• Strong AWS experience including: VPC Private Link IAM S3 Networking and security architecture
• Strong Infrastructure-as-Code experience using Terraform (preferred) or equivalent tools.
• Experience implementing CI/CD pipelines for infrastructure and platform deployments.

Additional Requirements

Security Clearance Requirement: Given the secure nature of this role, we are seeking candidates who are Australian Citizens with an active security clearance.

This requirement ensures that all team members are cleared to handle sensitive information and contribute to maintaining the highest standards of security in operations.

Why Join?

They offer a dynamic, inclusive, and collaborative work environment that values your growth and well-being.

As a part of their team, you will enjoy:

• Competitive Salary Package: Attractive remuneration that rewards your expertise.
• Flexible Work Arrangements: Options for remote work, hybrid models, and a strong work-life balance.
• Learning and Development: Access to world‑class training programs, certifications, and mentorship opportunities to advance your skills.
• Career Growth: Defined career pathways with opportunities to work on impactful projects for global clients.
• Health and Wellness: Comprehensive health insurance, wellness programs, and mental health support.
• Paid Time Off: Generous leave policies, including parental leave and additional paid holidays.
• Diversity and Inclusion: A commitment to fostering a diverse and inclusive workplace where everyone feels valued and empowered.