GCP Data Engineer
Berribot · Bengaluru, India ·
- Employment
- Full time
- Category
- Data engineering
- Experience
- 3+ years
Berribot · Bengaluru, India ·
HCLTech · Chennai, India
Impetus · Bangalore Bazaar, India
Questhiring · Haryana, India
Tata Consultancy Services Limited · Toronto, Canada
Berribot is hiring experienced GCP Data Engineers (6–10 yrs total, 3+ yrs on GCP) to design BigQuery data warehouses, build batch/streaming pipelines with Dataflow, Dataproc/Spark and Pub/Sub, and deliver cost-optimized, orchestrated data platforms for BFSI clients. Core stack: GCP (BigQuery, Dataproc, Dataflow), PySpark, Python/SQL, and Cloud Composer (Airflow).
We're Hiring | GCP Data Engineer | Pan India | TS We are looking for experienced GCP Data Engineers to join our growing team. The ideal candidate should have strong hands-on experience in BigQuery-based data warehousing, Dataproc/Spark processing, and orchestrated, cost-efficient pipelines to deliver scalable analytics and AI-ready data products for BFSI clients. Location Pan India Experience 6–10 Years (role-dependent), including 3+ years hands-on GCP Employment Type Full-time Key Responsibilities Strong experience and understanding of Data Warehouse and Data Lake platform architecture and design. Design and develop scalable batch and streaming pipelines on GCP using Dataflow, Dataproc (Spark), Pub/Sub, and Cloud Functions. Build and optimise cloud data warehouse solutions on BigQuery, including partitioning, clustering, and query cost optimisation. Migrate and modernise legacy workloads (Hadoop, Teradata, on-prem ETL) to GCP using Dataproc, BigQuery, and Data Fusion. Develop ELT/ETL workflows with Python, Java, Scala, and PySpark; orchestrate pipelines using Cloud Composer (Airflow). Implement data security and governance via Cloud IAM, and build reusable data validation and reconciliation frameworks. Tune Spark and BigQuery workloads for performance and cost, achieving measurable runtime and storage improvements. Set up CI/CD and automation for GCP data assets using Git-based pipelines and infrastructure-as-code. Collaborate with architects and client teams on solutioning, PoCs, demos, and production cutover. Mandatory Skills Google Cloud Platform (BigQuery, Dataproc, Dataflow) Pub/Sub, Cloud Functions, Data Fusion, Data Transfer PySpark/Spark, Python, SQL (Java/Scala a plus) Cloud Composer (Airflow) orchestration Data warehouse & pipeline design + performance tuning Cloud IAM — data security & access governance Good to Have Legacy migration (Hadoop/Teradata/on-prem ETL) GCP Kubernetes Engine (GKE), Cloud Storage CI/CD, Git, infrastructure-as-code (Terraform) Data validation/DVT frameworks & automation BI & analytics — Looker, Power BI, Tableau Exposure to Vertex AI/GenAI on GCP Your Next Career Opportunity Awaits! Apply now and get a faster recruitment process. Click here to apply https://berribot.com/opportunities
Innova ESI · Bangalore Bazaar, India