We are seeking a Senior GCP Data Engineer with 4-8 Years experience to design, build, and operate scalable batch and real-time data pipelines on Google Cloud Platform (GCP).
The ideal candidate has strong foundations in cloud-native data engineering, is highly self-driven, accountable, and excels as a collaborative team player in Agile environments.
Key Responsibilities
- Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP
- Build and optimize data pipelines using Python
- Implement streaming solutions using Pub/Sub and Dataflow
- Develop and manage batch workflows using Cloud Composer
- Design and optimize data models and queries in BigQuery
- Work with large-scale, low-latency data stores such as Bigtable
- Ensure data quality, reliability, performance, and scalability
- Manage source code, reviews, and collaboration using GitHub
- Build and maintain CI/CD pipelines using GitHub Actions
- Collaborate with product, platform, and analytics teams in an Agile setup
Required Skills & Qualifications
- Strong hands-on experience with Google Cloud Platform (GCP)
- Proven expertise in batch and real-time data pipelines
- Strong programming experience in Python
- Hands-on experience with BigQuery, Bigtable, Pub/Sub, Dataflow, and Cloud Composer
- Solid understanding of data modeling, ETL/ELT, and distributed data systems
- Proficiency with GitHub and GitHub Actions–based CI/CD
- Experience working in Agile environments
- Strong knowledge of data security and access management
Nice to Have
- Experience with data governance, lineage, and observability tools
- Exposure to large-scale analytics or enterprise data platforms
Primary Skills : GCP. Bigdata, PySpark, GCP, Bigquery, Composer, Python
Seondary Skills : SQL, Spark/Python,
Good to Have : Gen AI