Backend Engineer API

You will build the API that serves models to developers worldwide. You will own the end-to-end high-throughput inference system, including model-serving infrastructure, request routing, SDK development, rate limiting, observability, and efficient scaling.

Responsibilities

• Build the API serving models to developers
• Own high-throughput, low-latency inference systems
• Develop model-serving infrastructure and request routing
• Develop SDKs and rate limiting
• Maintain observability, availability, and efficient scaling

Requirements

• Expert knowledge of Rust or C++
• Experience designing, implementing, and maintaining reliable horizontally scalable distributed systems
• Knowledge of service observability and reliability practices
• Experience operating PostgreSQL, ClickHouse, and MongoDB

Benefits

• Equity
• Healthcare coverage
• Dental coverage
• Cash plan
• Income protection
• Life insurance
• Discounts and perks