Data Engineer
Ethos BeathChapman · Sydney, Australia ·
- Category
- Data engineering
A Data Engineer joins a financial services company in Sydney to build and maintain their AWS data platform (Redshift, S3, Athena, Glue), develop Spark jobs for batch and real-time processing, and create AI agents to automate data engineering tasks, occasionally contributing to reporting, data modelling, and platform engineering.
Are you an experienced Data Engineer? Do you have experience with AWS services and Spark?
I'm currenly working on an exciting opportunity for an experienced Data Engineer to join a FS company in Sydney working on their AWS data platform, you'd be working on services like Redshift, S3, Athena, and Glue, as well as building Spark jobs for batch and real-time data processing.
They are very forward thinking when it comes to AI so you would also be building AI agents to automate processes and increase productivity. Due to the nature of the team you will be asked to wear muliple hats and so will sometimes contribute to taks within data reporting, data modelling, platform engineering etc.
What's Required
- - Strong experience on AWS services
- - Spark experience for data processing, ideally in Scala
- - Experience with Power BI or a similar reporting tool
- - Experience building AI agents to perform data engineering tasks would be beneficial
This role sits within an existing team and will work closely with data analytics and platform engineering teams.