Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home
Parallel Partners · San Francisco, California ·
- Work mode
- Remote
- Seniority
- Senior
- Category
- Product
A 100% remote, hands-on Senior Technical Product Manager who defines requirements and evaluation frameworks for AI agent features, working directly with ML, backend, and mobile engineers to balance quality, latency, cost, and reliability and ship trustworthy AI behavior.
Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home
We are looking for a Senior Technical Product Manager. This is a deeply technical, hands-on role. The Senior Technical Product Manager will work directly with engineers on systems design, evaluation, and trade-offs-defining requirements, but shaping how the system works for global users. The Senior Technical Product Manager will work at the intersection of user needs, model capability, and system constraints, and are responsible for turning AI potential into real, reliable behavior in a real-world application. Artificial Intelligence (AI) and Machine Learning (ML) experience are required for this position. This position is 100% Remote.
MUST BE WILLING TO TAKE A 60 MINUTE CODING ASSESSMENT.
Senior Technical Product Manager Responsibilities:
- Research and define end-to-end Artificial Intelligence (AI) system requirements from capability to behavior to user impact.
- Translate model capabilities, data constraints, and evaluation results into clear product and system decisions.
- Make hard trade-offs across quality, latency, cost, reliability, and User Experience (UX).
- Work closely with Machine Learning (ML), backend, and mobile engineers on system design, evaluation, and iteration.
- Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback.
- Drive execution with clear specs, strong judgment, and disciplined prioritization.
- Ensure systems ship quickly, safely, and reliably, with strong feedback loops.
- Own product quality end-to-end, including correctness, predictability, and user trust.
Outcomes:
- Product strategy clearly aligns AI capabilities with user needs and company priorities.
- Artificial Intelligence (AI) features deliver real value, are understandable, predictable, and trusted by users.
- Decisions balance quality, speed, cost, and reliability effectively under uncertainty.
- Roadmaps and priorities are clear, with fast iteration based on real user feedback.
- Teams are aligned, focused, and able to execute Artificial Intelligence (AI) product goals with minimal friction.