Data Engineer at Clariti AI (a B2B SaaS serving retail banks) who builds, optimises, and deploys price-optimisation ML ETL/ELT pipelines and scales the data infrastructure. Core stack: Python (pandas/numpy), Azure cloud, PySpark, MySQL, Docker/Kubernetes, and orchestrators like Airflow/Dagster; hybrid in London up to two days a week.
Basic understanding of DAGs (Directed Acyclic Graphs) and their role in pipeline orchestration
Professional experience with PySpark, MySQL, Docker, and Kubernetes is desirable
Experience with best-practice pipeline orchestration software such as Airflow or Dagster is desirable
Experience migrating code from prototype notebooks to .py while maintaining logic and transparency is desirable
Experience owning a project across the whole software product lifecycle, from data infrastructure to model development and deployment to front-end integration, is desirable
Experience in pricing analytics and/or optimisation, ideally in retail banking, is desirable
Experience producing PowerPoint presentations or reports and presenting to clients or colleagues is desirable
Willingness to get involved in all parts of the business is desirable
An entrepreneurial spirit and drive to work in an early-stage start-up that directly rewards impact is desirable
We cannot sponsor visas, so only applicants with the permanent right to work in the UK will be considered
Responsibilities:
Build, optimise, and deploy price optimisation machine learning ETL/ELT pipelines and data processes
Improve and adapt our data infrastructure and code base as we scale, including collaboration, security, scalability, efficiency, automation, and auditability
Interact with new clients on client pitches and work with existing clients to onboard our software, offering engineering and pricing expertise
Help us improve the production quality of our software as we scale
Streamline and automate data refresh processes
Improve our data security
Build and deploy machine learning models
Get involved with client pitches
Work in London up to two days a week and travel to clients occasionally
Technologies:
AI
Airflow
AWS
Azure
Cloud
Docker
ETL
GCP
Kubernetes
Machine Learning
MySQL
Python
PySpark
Security
numpy
pandas
Backend
React
jQuery
More:
We are Clariti AI, a B2B SaaS company providing price optimisation software to retail banks. We help banks make pricing decisions on products like mortgages and savings, guiding clients to recommendations that can generate millions of pounds or euros in additional revenue. We are a bootstrapped and already profitable company with a growing client base in the UK and Ireland and a strong pipeline of new clients, with revenues expected to increase significantly in the next year. This is an exciting time to join us as an early joiner in a fast-scaling startup, where you will have multiple opportunities to grow, work with a small team, and take ownership of meaningful projects. We offer a highly competitive salary, a compelling profit share scheme with potential to own a significant stake in the business, equity options, flexible working hours, work anywhere for up to two months a year, regular performance-based promotions and pay increases, and 25 days of annual leave increasing to 30 days after two years.