Cloud & Data Engineer at Peritos Solutions in Queensland, Australia — designs, automates, and supports AWS and Azure cloud infrastructure and modern data platforms across customer and internal projects. Day-to-day spans IaC (Terraform), networking, security, CI/CD, DevOps, and building ETL/ELT data pipelines using SQL, Python, and PySpark.
We are looking for a Cloud & Data Engineer with hands-on experience across AWS and Microsoft Azure to design, implement, automate, and support cloud infrastructure and modern data platforms. The role combines cloud engineering, DevOps, data engineering, security, and cost optimisation, working across customer projects and internal solutions.
Key Responsibilities
- Design, deploy, and manage cloud environments across AWS and Azure.
- Implement cloud infrastructure using Infrastructure as Code (IaC) such as Terraform, AWS CloudFormation, Bicep, or ARM templates.
- Configure networking including VPC/VNet, subnets, routing, security groups/NSGs, load balancers, VPNs, DNS and private endpoints.
- Implement secure identity and access using AWS IAM, Microsoft Entra ID, RBAC, roles and policies.
- Build and maintain compute solutions using EC2, Lambda, ECS/EKS, Azure VMs, Functions and AKS.
- Implement storage solutions using Amazon S3, EBS, Azure Blob Storage, ADLS Gen2 and Azure Files.
- Support cloud migrations and application modernisation initiatives.
- Perform AWS Well-Architected and Azure architecture reviews covering security, reliability, performance, operational excellence and cost.
- Configure monitoring, logging and alerting using CloudWatch, CloudTrail, Azure Monitor, Log Analytics and Application Insights.
- Implement backup, disaster recovery, high availability and business continuity solutions.
- Analyse cloud consumption and recommend cost optimisation and FinOps improvements.
- Design and develop scalable data ingestion and transformation pipelines.
- Build batch and near-real-time data processing solutions.
- Work with structured, semi-structured and unstructured datasets.
- Develop ETL/ELT pipelines using services such as:
- AWS Glue, Lambda, S3, Athena, Redshift, RDS and Step Functions
- Design data lake and lakehouse architectures.
- Develop data transformation processes using SQL, Python and PySpark.
- Implement data quality, validation, reconciliation and monitoring processes.
- Optimise data pipelines and queries for performance and cost.
- Support reporting and analytics platforms including Power BI and QuickSight.
- Implement appropriate data security, encryption, access controls and governance.
DevOps & Automation
- Build and maintain CI/CD pipelines using Azure DevOps, GitHub Actions, AWS CodePipeline or similar platforms.
- Automate cloud provisioning, deployment and operational activities.
- Work with Git-based branching, release and deployment processes.
- Implement environment management across Development, Test/UAT and Production.
- Support containerised workloads using Docker, Kubernetes, EKS and AKS.
- Implement automated security and compliance checks within deployment pipelines.
- Troubleshoot cloud infrastructure, deployment and application issues.
Security & Governance
- Apply AWS and Azure cloud security best practices.
- Implement least-privilege access and secure secrets management.
- Configure encryption, logging, monitoring and security controls.
- Support cloud governance, tagging, policies and compliance requirements.
- Assist with security assessments, vulnerability remediation and DevSecOps initiatives.
- Support implementation of AWS Control Tower/Security Hub/GuardDuty and Azure Policy/Defender for Cloud where applicable.
Required Technical Skills
- Strong hands-on experience with AWS and/or Microsoft Azure, with practical exposure to both preferred.
- AWS: EC2, S3, IAM, VPC, Lambda, RDS, CloudWatch, CloudTrail and Glue.
- Azure: VMs, Storage, VNet, Entra ID, Azure SQL, Data Factory, ADLS, Functions and Azure Monitor.
- Strong knowledge of SQL.
- Working knowledge of Python and/or PySpark.
- Experience with Terraform or another Infrastructure as Code technology.
- Experience building CI/CD pipelines.
- Understanding of REST APIs and system/data integration.
- Good understanding of cloud networking and security.
- Experience troubleshooting production cloud and data workloads.
- Microsoft Fabric, Databricks, Synapse or Redshift experience.
- Generative AI services such as Amazon Bedrock or Azure AI Foundry/Azure OpenAI.
- AWS Well-Architected Framework and Azure Cloud Adoption Framework knowledge.
- Power BI or Amazon QuickSight.
- FinOps and cloud cost optimisation.
- Experience working in consulting or customer-facing cloud projects.
Preferred Certifications
- AWS Certified Solutions Architect / Data Engineer / DevOps Engineer.
- Microsoft Azure Data Engineer or Fabric certification.
- Terraform Associate or equivalent certification.
- Strong analytical and troubleshooting skills.
- Ability to independently own technical deliverables.
- Good written and verbal communication.
- Ability to translate business requirements into technical solutions.
- Comfortable working across multiple customer environments and technologies.
- Strong documentation and knowledge-transfer skills.
- Ability to work collaboratively with architects, developers, data engineers, security teams and customer stakeholders