Faire, a wholesale marketplace, is hiring a Staff Data Infrastructure Engineer in Kitchener to build CDC/streaming ingestion (CockroachDB/MySQL into Kafka, then Iceberg on S3) and own platform reliability, SLOs, and on-call. Core stack: Airflow, Spark, Databricks, Snowflake, Kafka, Python, SQL, AWS, Terraform.
Faire · boards.greenhouse.io · checked today
Faire is a technology wholesale platform built on the belief that the future is local. Independent retailers around the globe collectively represent a multi-hundred-billion-dollar wholesale market that has historically been fragmented and offline. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe.
Skills, with evidence
- Airflow / orchestration Experience operating Airflow at scale and working with managed ingestion like Fivetran. must have
- Experience with data quality and observability in practice, including data contracts, SLAs, and tools like Anomalo or Monte Carlo. must have
- Idempotency & backfills You'll be responsible for the hard details like ordering, deduplication, late data, schema changes, and backfills. must have
- Python Solid Python plus at least one of Kotlin, Java, Scala, or Go. must have
- SQL Strong SQL, and good instincts for how to model data so analysts and data scientists can actually use it. must have
- You know what goes wrong with ordering, duplicates, snapshots, and schema evolution because you've dealt with it. must have
- Spark Strong Spark skills, and experience running Databricks and Snowflake against shared storage. must have
- Streaming Deep experience with change data capture and streaming ingestion from operational databases through Kafka. must have
- AWS Experience shipping infrastructure on AWS with Terraform. must have · not practised here
- Terraform Experience shipping infrastructure on AWS with Terraform. must have · not practised here
- Warehousing Build the CDC and streaming ingestion layer: CockroachDB changefeeds and MySQL binlogs into Kafka, then into Iceberg tables on S3.
- Own reliability for the platform: SLOs, on-call, incident reviews, and the follow-through so the same thing doesn't break twice.
- Incremental loads Build the CDC and streaming ingestion layer: CockroachDB changefeeds and MySQL binlogs into Kafka, then into Iceberg tables on S3.
- Machine learning At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe. not practised here