At NiCE, we don’t limit our challenges. We challenge our limits. Always. We’re ambitious. We’re game changers. And we play to win. We set the highest standards and execute beyond them. And if you’re like us, we can offer you the ultimate career opportunity that will light a fire within you.
So, what’s the role all about?
We are looking for a strong AI QA Automation Lead with high technical skills to build methodology, provide vision and direction, and lead quality & automation throughout the organization. This role operates at the intersection of traditional software quality and AI-powered development: owning quality not just for code written by humans, but for systems designed, generated, and executed by AI agents.
How will you make an impact?
- Serve as the quality leader for an entire domain, accountable for product quality across human-written, AI-generated, and agent-executed software
- Actively track the domain’s quality tasks, analyze the testing needs, and define QA activities and ownership
- Continuously analyze and challenge existing testing coverage
- Plan, develop, and execute test strategy across our Cloud Analytics platform , extending to AI-powered and agentic system components
- Review and approve tests cases and complex system scenarios
- Prepare and present data-driven quality insights, KPIs, risks, and trends to leadership through regular domain level reporting.
- Lead domain-level RCA reviews for customer-facing bugs and major incidents; detect trends and drive systemic improvements.
- Own post-deployment quality monitoring, drive sanity completion and rapid triage of production issues within the domain.
- Lead Quality assurance efforts that align with product objectives to ship products rapidly and with confidence
- Help the teams design the performance, concurrency and latency test scenarios and metrics
- Lead risk-based test strategy with product and engineering — define acceptance criteria and quality gates that support high delivery velocity without sacrificing customer-impacting quality
- Implement and evolve QA processes to get effective test signals and scale testing efforts across our services
- Define acceptance criteria for non-deterministic systems using golden-set evaluation, behavioral contracts, and statistical confidence thresholds
- Define adversarial and edge-case testing methodologies for AI features: prompt injection resistance, boundary condition handling, and graceful degradation
- Partner with engineering and DevOps teams to leverage automation for scalable solutions to prevent regressions and ensure reliability of product
- Track and improve CI/CD pipeline health across environments — expanding automation coverage, hardening test stability, and ensuring every environment produces trustworthy test signals.
- Plan and lead NFR testing
- Define guidelines and best practices for our automation and manual testing procedures
- Coordinate cross-organization/cross-region testing activities
Have you got what it takes?
Education:
- BSc in Computer Science/Software Engineering or equivalent
- 3 years QA Automation leadership experience: Team leader/Manager
- At least 4 years of automation experience
- Hands-on experience working within an agentic SDLC including AI-assisted code generation, agent-driven development workflows, and the quality, review, and governance practices that keep AI-accelerated delivery safe and reliable.
- Experience building AI-enabled automation workflows (e.g. Claude/OpenAI APIs, prompt patterns for test generation, repo-aware RAG, scripts/services that turn AI output into runnable tests)
- Experience with large scale production distributed systems and proven experience with designing and implementing tests for such systems
- Experience with systems that work with structured and unstructured data and with AI services and models
- Demonstrated technical leadership across teams — driving standards, roadmap execution, and stakeholder alignment
- Ability to define QA processes across development groups
- Hands on experience with CI/CD and Test-Driven Development
- Excellent communication skills (written and verbal) and interpersonal skills
- Experience with full software development lifecycle using Agile Development processes
- Experience designing evaluation harnesses for non-deterministic AI systems
- Cloud experience (AWS/Azure/GCP) and Infrastructure-as-Code
Agentic AI & LLM Proficiency
- Deep, hands-on understanding of agentic AI patterns: tool use, multi-agent orchestration, planning loops, memory architectures, and human-in-the-loop design
- Expert-level prompt engineering including chain-of-thought, few-shot, RAG, and structured output techniques applied to code and test generation
- Experience designing evaluation harnesses for non-deterministic AI systems — statistical confidence, behavioral consistency, and regression detection
- Familiarity with agent frameworks (LangChain, LlamaIndex, AutoGen, CrewAI, or equivalents) and their tradeoffs in production quality pipelines
Technical Depth
- Expert in Python and TypeScript; proficient in at least one compiled language (Java, Go, C#)
- Deep knowledge of modern test frameworks across UI, API, and contract layers: Playwright, Stryker, pytest, REST Assured, Pact
- Strong CI/CD architecture skills: Jenkins, GitHub Actions, pipeline-as-code, artifact management
- Proficient with cloud-native infrastructure: Docker, Kubernetes, AWS, serverless execution environments
What’s in it for you?
Join an ever-growing, market disrupting, global company where the teams – comprised of the best of the best – work in a fast-paced, collaborative, and creative environment! As the market leader, every day at NICE is a chance to learn and grow, and there are endless internal career opportunities across multiple roles, disciplines, domains, and locations. If you are passionate, innovative, and excited to constantly raise the bar, you may just be our next NiCEr!
Enjoy NiCE-FLEX!
At NiCE, we work according to the NiCE-FLEX hybrid model, which enables maximum flexibility: 2 days working from the office and 3 days of remote work, each week. Naturally, office days focus on face-to-face meetings, where teamwork and collaborative thinking generate innovation, new ideas, and a vibrant, interactive atmosphere.
Requisition ID: 11279
Reporting into: Vice President, Head of Engineering, Platform Research
Role Type: Individual Contributor
#LI-Hybrid
About NiCE
NICE Ltd. (NASDAQ: NICE) software products are used by 25,000+ global businesses, including 85 of the Fortune 100 corporations, to deliver extraordinary customer experiences, fight financial crime and ensure public safety. Every day, NiCE software manages more than 120 million customer interactions and monitors 3+ billion financial transactions.
Known as an innovation powerhouse that excels in AI, cloud and digital, NiCE is consistently recognized as the market leader in its domains, with over 8,500 employees across 30+ countries.
NiCE is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, age, sex, marital status, ancestry, neurotype, physical or mental disability, veteran status, gender identity, sexual orientation or any other category protected by law.