AI Quality Assurance Expert (m/f/d)

Role Summary

The AI Quality Assurance Expert is responsible for ensuring the accuracy, reliability, safety, compliance, and operational performance of AI solutions across MANN+HUMMEL, supporting reliable business decision-making and trusted deployment of AI-enabled solutions.

Your Challenge

• Ensure accuracy, reliability, performance, and compliance of AI models and systems across development, testing, deployment, operational use, and feature enhancement
• Develop and execute test plans and validation frameworks for AI products, ML solutions, LLM applications, and agentic systems
• Design and operate automated tests integrated into MLOps and LLM delivery pipelines
• Define acceptance criteria and quality gates for AI systems, including functional quality, robustness, consistency, explainability, and operational readiness
• Design and maintain telemetry, observability, and monitoring for AI behavior, including drift detection, anomaly detection, output degradation, and compliance incident tracking
• Maintain traceable validation evidence, documentation, and audit ready records for test execution, deviations, decisions, and approvals
• Collaborate with cross-functional stakeholders to align quality requirements, test scope, release readiness, and ongoing improvement actions

Your Profile

• Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, Information Technology, Artificial Intelligence, or a related field
• Professional Experience:
  • 5-10 years of relevant experience in software testing, quality assurance, test automation, or validation of digital products
  • Experience in validating systems such as ML or LLM-based solutions is strongly preferred
• Expertise:
  • Clear and effective communication with cross-functional teams, including senior business stakeholders and Product Owners
  • Strong planning, prioritization, and documentation skills
  • High attention to detail and quality orientation
• AI-specific skills:
  • Deep understanding of ML lifecycle, LLM architectures, agentic systems, and model validation concepts
  • Familiarity with AI/data stack and MLOps tooling
  • Understanding of common AI risks such as hallucination, drift, bias, prompt injection, and unreliable automation behavior
• Technical Skills:
  • Working proficiency in Python, with the ability to review, understand, and assess Python‑based test, validation, and evaluation code
  • Proficiency with test and automation frameworks
  • Experience with version control, defect tracking, and structured test documentation
• Language skills: Very good English skills; German is a plus
• Personality:
  • Cross-team stakeholder collaboration
  • Ability to balance speed, risk, and quality in a dynamic technology environment
  • Quality oriented with continuous improvement mindset

Diversity and inclusion are part of our DNA. We filter exclusively for the best talent. We therefore welcome applications from all people regardless of age, gender, origin, ancestry, disability, or other legally protected grounds.

If you have any questions about this job posting, please contact our recruiting team. You can reach us at [email protected]. Please include the job title and location of the position you are interested in in your email. Please also note that for data protection reasons, we cannot accept applications by email; please use our online form exclusively for this purpose.

Social Benefits

• You will work with a high degree of independence and decision-making freedom
• Performance-based pay and comprehensive benefits
• 35 hours per week with flexitime or trust-based working hours (depending on the position) plus 30 days of vacation
• Option for hybrid working (4 days in Ludwigsburg, 1 day mobile). (For children under 12 years of age, the following still applies: 3 days in Ludwigsburg, 2 days mobile)
• Everyone has talent: Our talent management process supports you in your professional development
• Company restaurant
• Places in a private daycare center in the vicinity (both for children under and over 3 years of age)
• A modern company pension plan to supplement your statutory pension insurance
• Additional private health insurance (e.g., supplementary dental insurance)
• A large number of discounts in our corporate benefits portal (e.g., on vacations, fashion, insurance, etc.)
• Mobility offers: subsidy for the Deutschlandticket, JobRad leasing, and e-charging stations in the free parking garage with company charging rates