Data Engineers
Softtest pays pty ltd · Adelaide, SA, Australia ·
- Work mode
- Remote
- Experience
- 3+ years
analyticsazureazure-synapseci-cddata-engineeringdata-governancedata-lakedata-modelingdata-pipelinesdevopspythonsql
Australian Citizens residing in Australia only respond.
Must be able to obtain Baseline.
Overview
At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia.
Role Responsibilities and Duties:
- Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack.
- Develop scalable architecture practices for pipeline designs.
- Lead data migration and integration for critical change programs.
- Ensure data integrity and align engineering tasks with program objectives.
- Mentor team members and drive new data engineering practices adoption.
- Monitor and improve data service performance and costs.
- Maintain documentation and adhere to data governance policies.
- Research and innovate within the Azure data engineering field.
Qualifications/Experience:
- Bachelors degree in computer science, Engineering, or a related field.
- Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate.
- 3+ years of experience in data engineering with a focus on Azure services.
- Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines.
- Demonstrated ability to design and implement scalable data architectures.
- Experience in data migration and managing large-scale data pipelines.
- Familiarity with DevOps practices and tools within the Azure ecosystem.
- Strong technical skills in SQL, Python, and R
- Proficiency in data modelling including reuse and scalability patterns
- Knowledge of Azure Monitor, Azure Security, and compliance frameworks.
- Ability to work with cross-functional teams and lead technical projects.
- Experience building data profiling, data cleansing and data engineering frameworks
Address Each Selection criteria to support your application(one page summary)
Essential criteria
1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description.
Desirable criteria
- The extent to which the proposed fees represent value for money to the CER.