Data Engineer (M/F)
Magellan · Lille, France ·
- Category
- Data engineering
Builds and maintains cloud-based data pipelines (GCP/AWS) to collect, process, and store data, ensuring quality and interoperability for data science/analytics teams.
Industrialising Data platforms (pipelines, ETL, quality, governance) on GCP or AWS cloud environments represents a structural workstream for data-driven organisations. This role targets a confirmed Data Engineer, capable of working in coordination with Data Scientists and Analysts teams.
YOUR MISSIONS
- Design and develop robust data pipelines: collection, processing, storage.
- Optimise data flows to improve efficiency and performance.
- Manage SQL and NoSQL database infrastructures in a GCP or AWS Cloud environment following CI/CD principles.
- Integrate data by developing ETL processes and ensuring interoperability between different systems and sources.
- Guarantee data quality: implement quality and consistency checks, cleansing and validation processes.
- Liaise with the entire Data team (Scientists and Analysts) to support and address business needs.