Software Engineer - Cloud Data Pipelines (R/Python)
Infinity Quest UK · UK ·
- Category
- Software engineering
This engineer designs, builds, and maintains cloud data pipelines that containerize, deploy, and orchestrate custom R and Python analytical scripts at scale. Day-to-day work centers on GCP or Azure managed services (Cloud Run/Functions, BigQuery, Data Factory, Databricks), workflow orchestration with Airflow/Prefect, and ensuring data quality and performance.
We are seeking a Software Engineer to design, build, and maintain robust data pipelines that ingest, process, and execute custom R and Python scripts at scale. You will work within our cloud infrastructure ( Google Cloud Platform or Azure ) to automate data workflows, ensure high performance, and integrate advanced analytical models into production environments. Key Responsibilities Execute R/Python Workloads: Containerize, deploy, and orchestrate custom R and Python scripts to run reliably in …