Senior Data Engineer -GCP
Xpt Software Australia Pty · New South Wales, Australia ·
- Seniority
- Senior
- Category
- Data engineering
Xpt Software Australia Pty · New South Wales, Australia ·
Talent Insights · Sydney, Australia
Talent Insights Group · Sydney NSW
ncsaustralia · Brisbane, QLD, au
Simple Machines · London, United Kingdom
Senior Data Engineer (10+ years) building large-scale data platforms on Google Cloud using BigQuery, Dataflow, Pub/Sub, Dataproc, and Cloud Storage. Day to day involves designing high-performance batch and real-time ETL/ELT pipelines with Python, SQL, Apache Beam or Spark, shaping warehouse/lakehouse architecture, and leading and mentoring teams with stakeholders.
Must Have Skills:<\/span><\/b>
<\/p>
ï· <\/span><\/span>Advanced
GCP Data Engineering Expertise : Strong hands -on experience with GCP services
such as BigQuery, Dataflow, Pub/Sub, Dataproc, and Cloud Storage for building
large -scale data platforms.<\/span><\/b>
<\/p>
ï· <\/span><\/span>Data
Architecture & Modeling <\/span><\/b>:<\/span><\/b> <\/span>Deep understanding of data warehousing, dimensional modeling,
and lakehouse architectures<\/b> to support analytics and reporting.<\/span>
<\/p>
ï· <\/span><\/span>Leadership
& Stakeholder Collaboration <\/span><\/b>:<\/span><\/b> <\/span>Proven ability to lead engineering initiatives, mentor teams,
and collaborate with business, analytics, and architecture stakeholders<\/b> to deliver data solutions.<\/span>
<\/p>
ï· <\/span>Expertise<\/b> <\/span>Scalable Data Pipeline Development <\/span><\/b>:<\/span><\/b> <\/span>Expertise in designing and implementing high -performance
ETL/ELT pipelines<\/b> (batch and real -time) using Python, SQL, and frameworks
like Apache Beam or Spark.<\/span>
<\/p>
<\/span>
<\/p><\/td><\/tr>
Nice to Have Skills:<\/span><\/b>
<\/p>
ï· <\/span>Experience with <\/b><\/span>Containerization & Kubernetes <\/span><\/b>:<\/span><\/b> <\/span>Experience with Docker and Kubernetes
(GKE)<\/b> for deploying and managing scalable data platforms.<\/span>
<\/p>
ï· <\/span>Knowledge of <\/b><\/span>Streaming & Real -Time Processing <\/span><\/b>:<\/span><\/b> <\/span>Familiarity with Kafka, Pub/Sub streaming,
and event -driven architectures<\/b> for real -time data processing.<\/span>
<\/p>
ï· <\/span><\/span>Multi -Cloud
Experience <\/span><\/b>:<\/span><\/b> <\/span>Exposure to AWS
or Azure<\/b> environments for building and integrating cross -cloud data
solutions.<\/span>
<\/p>
ï· <\/span><\/span>Machine
Learning & Advanced Analytics Integration :<\/span><\/b> Experience supporting ML pipelines (Vertex
AI) or analytics workflows<\/b> to enable data science and AI use cases.<\/span>
<\/p><\/td><\/tr>
Minimum Years of Experience:10<\/span><\/b>
<\/p><\/td><\/tr>
Top 3 responsibilities you
would expect the Subcon to shoulder and execute<\/span><\/b>
<\/span>ï· <\/span>Drive Customer Engagement Strategy
Execution:<\/b>
Design and execute customer engagement plans, ensuring consistent
communication, improved customer experience, and alignment with business
objectives.<\/span><\/p>
ï· <\/span>Manage Customer Relationships &
Satisfaction:<\/b>
Act as the primary point of contact for key customers, proactively address
concerns, gather feedback, and ensure high levels of customer satisfaction
and retention.<\/span>
<\/p><\/td><\/tr><\/tbody><\/table>
Ingrity · Sydney, Australia