Job Description: Senior QA Lead – AI & Automation (10+ Years)
Role Overview
We are looking for a Senior QA Lead with strong expertise in AI-based application testing and API automation to lead quality initiatives across our AI-driven products, including a Meeting Assistant (Agentic AI) and Legal SDL platform. This role will drive QA strategy, ensure high-quality releases, and build scalable automation frameworks.
Key Responsibilities
• Define and own the overall QA strategy across AI-driven products
• Lead end-to-end testing for Agentic AI systems (meeting assistant, conversational workflows)
• Drive API-first automation strategy and ensure high test coverage
• Validate AI/ML components including prompts, responses, and model behavior
• Establish test frameworks, CI/CD integration, and quality gates
• Collaborate with Product, Engineering, and AI teams to ensure testability and quality
• Manage test planning, execution, reporting, and release sign-offs
• Mentor QA engineers and build a high-performing QA team
• Define metrics, dashboards, and quality KPIs
Required Skills & Experience
• 10+ years of experience in Software QA / Testing
• Strong expertise in API Automation (Postman, RestAssured, PyTest, etc.)
• Hands-on experience in UI Automation (Selenium, Playwright, Cypress)
• Experience in AI/ML testing (LLMs, chatbots, conversational AI)
• Understanding of:
o Prompt validation & response evaluation
o Hallucination detection
o Model output validation
• Strong knowledge of test management practices and tools (JIRA, qTest, TestRail, ADO)
• Experience in CI/CD pipelines (Jenkins, GitHub Actions, etc.)
• Strong debugging and root cause analysis skills
Good to Have
• Experience with Agentic AI systems
• Exposure to NLP / LLM evaluation frameworks
• Performance testing of AI systems
• Knowledge of cloud platforms (AWS/Azure)
Leadership Expectations
• Ability to own QA delivery across multiple products
• Strong stakeholder communication
• Proactive quality ownership and decision-making
Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.