Data Engineer Luxurynsight
Luxurynsight · Paris, France ·
- Category
- Data engineering
- Experience
- 5+ years
Luxurynsight · Paris, France ·
accenturefederalservices · Suitland, MD
McDonald's
Zego · London
Propel · Toronto, Ontario, Canada
Propel Holdings · Toronto, Canada
A data engineer builds, maintains, and scales Luxurynsight's end-to-end data pipeline — from crawling and ingesting social media and events data to transformation, orchestration, and reliable data delivery — using Snowflake, dbt, Airflow, Celery, Kubernetes, AWS, and Datadog. Day to day involves designing Airflow DAGs, evolving dbt models, and improving pipeline reliability and data quality.
Our full data pipeline starts with the crawling and ingestion of massive volumes of social media & physical events data, which are then analyzed by our computer vision models. These predictions mapped to fashion trends and aggregated into time series that feed the metrics and forecasts at the core of our product.
The Data Engineering team owns this entire pipeline: from crawling and ingestion, through transformation and orchestration, to making reliable, well-structured data available to the rest of the company, Data Science, Product, and beyond. We’re responsible for the health, scalability, and evolution of the data stack that everything else at Heuritech is built on.
Our stack is built around Snowflake, dbt, Airflow, Celery, K8s, AWS, and Datadog.
As a Data Engineer, your mission will be to build, maintain, and scale the systems that turn raw crawled data into trustworthy, usable data for the whole company. This includes:
designing and maintaining Airflow DAGs and orchestration logic
building and evolving dbt models and transformations in our Snowflake data warehouse
improving the reliability, monitoring, and data quality of our pipelines
working on the crawling stack that feeds our pipeline, and its infrastructure
contributing to internal tools that make data more accessible across teams
exploring and prototyping new tools or architectures to improve how we orchestrate and process data
You’ll have real ownership over the projects you’re staffed on, with the autonomy to shape the approach and drive improvements as you see fit.
You have several years of experience in Data Engineering or Software Engineering with a strong data focus (ideally 3-5+ years). You’re comfortable owning the full lifecycle of a data pipeline from ingestion to orchestration to modeling and you have a good instinct for making data systems robust, observable, and easy to maintain. You’ve worked with large volumes of data and know how to think about scalability, both on the software and infrastructure side. You’re able to move from prototype to industrialized, production-grade solutions, and you know how to structure, test, and document your code so others can build on it.
You take ownership and work autonomously, given a project, you know how to engage with stakeholders, gather the requirements you need, and lead it end-to-end from initial scoping to implementation and communication of the results. We place a lot of value on initiative, we’re looking for someone who naturally spots problems and proposes solutions on their own. As we're an international company, you're comfortable communicating in English, both written and spoken.