Azure Data Engineer

Job Description

Are you ready to be a part of a team that's redefining ultra-secure cloud solutions?Join a team that’s shaping the future of cloud and cybersecurity.

At Showtime Consulting, we don’t just build ultra-secure cloud solutions—we enable organisations to thrive in the most challenging high-threat environments. If you’re truly passionate about innovation, security, and making a real impact, you’re in the right place.

We deliver security where it matters most—protecting national infrastructure, defence, and mission-critical operations. Our solutions are trusted by leading organisations, and our team is at the forefront of innovation in ultra-secure cloud and cross-domain security.

Our people are specialists in secure cloud, defence technology, and insider risk mitigation. We thrive in high-stakes environments, where cybersecurity isn’t just a requirement—it’s mission-critical. If you’re ready to contribute to industry-leading projects and grow in a company that values trust, innovation, and resilience, explore our open roles today.

Open RolesWe Are Always Looking For Talented Individuals.
Explore Our Current Opportunities And Find A Role That Matches Your Expertise.

Sydney

Company Description

Showtime Consulting is a leading provider of Shielded Cloud and Digital Solutions across Australia and New Zealand. We specialise in delivering secure, enterprise-scale technology solutions across cloud, infrastructure, cybersecurity, business applications, data, and digital transformation programs.

We partner with government and enterprise organisations to build high-performing technology teams that deliver scalable, secure, and future-ready business solutions.

The Role

We are seeking an experienced Data Engineer to design, build, and support enterprise-scale data platforms and data integration solutions within Microsoft Azure environments.

This role is suited to a hands-on data professional with strong experience across data engineering, data warehousing, cloud-based analytics platforms, and modern data architectures. You will work closely with business stakeholders, solution architects, analysts, and development teams to deliver high-quality, trusted, and scalable data solutions that support reporting, analytics, and business decision-making.

You will play a key role in designing and optimising data pipelines, improving data quality, implementing governance controls, and driving best practices across the data ecosystem.

Key Responsibilities

• Design, develop, and maintain scalable and reliable data pipelines and ETL/ELT processes.
• Build and support Azure-based data platforms and enterprise data solutions.
• Develop data integration frameworks to ingest, transform, and deliver data from multiple source systems.
• Implement and support solutions using Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure SQL.
• Design and optimise data warehouse and lakehouse architectures.
• Develop data transformation logic using Python, PySpark, and SQL.
• Create and maintain reusable data engineering frameworks, pipelines, and automation processes.
• Perform data modelling activities to support reporting, analytics, and operational requirements.
• Manage large-scale structured and unstructured datasets across cloud platforms.
• Monitor, troubleshoot, and optimise data pipelines to ensure performance, reliability, and scalability.
• Conduct root cause analysis and resolve complex data-related issues.
• Implement data validation, reconciliation, and quality assurance processes.
• Develop monitoring and alerting mechanisms to proactively identify data issues.
• Support data migration and modernisation initiatives.
• Collaborate with business and technical stakeholders to gather and analyse requirements.
• Translate business requirements into scalable technical solutions and data models.
• Implement and maintain data governance, security, and compliance controls.
• Ensure adherence to enterprise standards, privacy requirements, and data management policies.
• Produce technical documentation, data dictionaries, solution designs, and operational runbooks.
• Contribute to continuous improvement initiatives and cloud data platform best practices.
• Work within Agile delivery teams and participate in sprint planning, stand-ups, reviews, and retrospectives.

What You'll Need

• Minimum 5 years' experience in Data Engineering, Data Warehousing, or a related data-focused role.
• Demonstrated experience designing, developing, and maintaining scalable data pipelines and integration solutions.
• Strong hands-on experience with the Microsoft Azure Data Platform, including:
  • Azure Data Factory (ADF)
  • Azure Databricks
  • Azure Data Lake Storage (ADLS)
  • Azure Synapse Analytics
  • Azure SQL
• Strong experience with SQL development, performance tuning, database optimisation, and query troubleshooting.
• Proven experience in data modelling for enterprise data platforms and analytics solutions.
• Strong understanding of ETL/ELT methodologies and modern cloud-based data architectures.
• Experience developing solutions using Python, PySpark, and/or Scala.
• Experience managing data quality, validation, monitoring, reconciliation, and issue resolution processes.
• Strong understanding of data governance, security, privacy, and compliance requirements.
• Experience working with large and complex datasets in enterprise environments.
• Ability to produce high-quality technical documentation and solution designs.
• Strong stakeholder engagement and communication skills.
• Experience working within Agile and cross-functional delivery teams.

Preferred Skills

• Experience designing modern cloud-native data platforms and lakehouse architectures.
• Knowledge of data governance frameworks, master data management, and metadata management practices.
• Experience with DevOps, CI/CD pipelines, and infrastructure-as-code practices.
• Strong analytical and problem-solving skills.
• Ability to work collaboratively with technical and non-technical stakeholders.
• Experience supporting enterprise reporting, analytics, and business intelligence initiatives.
• Exposure to government, regulated, or highly secure environments is highly regarded.

Why Join Us?

• Deliver large-scale Azure data and analytics transformation programs.
• Work with leading cloud technologies including Azure Databricks, Synapse Analytics, and Data Factory.
• Partner with architects, data specialists, and business leaders on strategic initiatives.
• Contribute to modern data platform, governance, and analytics uplift programs.
• Join a consulting culture focused on innovation, technical excellence, and continuous improvement.
• Access exciting projects across government and enterprise organisations throughout Australia and New Zealand.

We Are Always Looking For Top Talent In Cybersecurity, Cloud, And Defence Tech.

Build solutions that protect defence, national security, and enterprise clients.

At Showtime Consulting, We Hire And Develop The Best Minds In Cybersecurity.Our Values Shape Everything We DoSecurity

Essential for protecting sensitive information and ensuring the company's technology cannot be compromised.

Critical for building trust with stakeholders and maintaining ethical standards in all operations, especially in such sensitive sectors.

Necessary for staying ahead of technological advancements and threats, ensuring solutions are cutting-edge and effective.

Demonstrates dedication to the mission, the safety and security of clients' data, and the success of their operations.

Important for providing reliable and consistent service, which is crucial for defense and intelligence operations that depend on continuity and dependability.

Fuels the drive to excel, innovate, and overcome challenges. It's the emotional investment in the mission and the work, which can inspire teams and lead to exceptional outcomes.

Secure Your Cloud, Empower Your Mission with S.H.I.E.L.DThe power of ultra-secure cloud solutions tailored to your unique needs. Experience unmatched security, efficiency, and agility with Showtime Consulting's S.H.I.E.L.D framework.Pioneers of SHIELDEDCloud Solutions
Protecting Operations in Hostile and Sensitive Environments #J-18808-Ljbffr