Lead Data Engineer
Location: London (Hybrid)
Salary: 80,000-115,000
Hexwired has partnered with an exciting AI start-up developing an intelligent automation platform that is transforming the B2C service. They're now looking for a Lead Data Engineer to design and build the data infrastructure that will power the next generation of their AI platform.
As one of the first senior data hires, you'll take ownership of the company's data architecture, building scalable pipelines, real-time data processing systems and AI-ready infrastructure while helping shape the future engineering team.
Key Responsibilities
- Design and build scalable batch and real-time data pipelines.
- Develop data ingestion, transformation and storage solutions for operational and AI workloads.
- Build and optimise vector search, retrieval systems and ML data pipelines.
- Ensure data reliability, governance, monitoring and observability across the platform.
- Work closely with AI, backend and product teams to support model training, inference and product development.
- Optimise large-scale datasets and database performance.
- Help define engineering standards and mentor future data engineers.
Requirements
- 7+ years' experience in Data Engineering or Backend Engineering.
- Strong Python development experience.
- Experience building distributed data platforms and scalable pipelines.
- Excellent knowledge of PostgreSQL (or similar relational databases) and NoSQL databases.
- Experience with vector databases such as Qdrant, Milvus or pgvector.
- Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars.
- Strong understanding of data modelling, storage architecture and performance optimisation.
Desirable
- Experience working on AI or Machine Learning platforms.
- Knowledge of cloud platforms (AWS, Azure or GCP).
- JavaScript/Node.js experience.
- Event-driven architecture and stream processing experience.
- Previous experience within a high-growth start-up environment.
What's on Offer
- Competitive salary with equity options.
- The opportunity to shape the data architecture of a rapidly growing AI business.
- Work directly alongside founders and senior engineers.
- High levels of ownership, autonomy and technical influence.
- The chance to build technology that is transforming an entire industry.
If you're an experienced Data Engineer looking to play a key role in building the foundations of an innovative AI platform, we'd love to hear from you. Apply today by contacting Hexwired Recruitment.