Senior GenAI Quality Engineer / Solution Analyst

Salary: $8,000 – $9,000 per month

Summary

We are looking for a Senior GenAI Quality Engineer / Solution Analyst to design, test and validate enterprise GenAI applications across UI, APIs, data, integrations and agentic workflows.

Job Responsibilities

• Design and execute end-to-end testing for UI, APIs, integrations and GenAI/agentic applications.

• Test LLM and agent behaviour, including prompts, multi-turn conversations, tool calls, workflows and failure handling.

• Validate GenAI responses for accuracy, relevance, grounding, consistency and safe handling.

• Perform functional, integration, regression, exploratory and negative testing.

• Design and execute API testing covering authentication, validation, error handling and system integrations.

• Analyse logs, traces, API payloads and system data to identify issues and root causes.

• Develop and maintain test scenarios, test data and test automation.

• Work with developers, architects, product owners and business teams to identify quality risks and improve solutions.

• Translate business requirements into functional requirements, acceptance criteria and test scenarios.

• Support solution design and review system flows, integrations and potential risks.

• Provide quality and release recommendations based on testing results and identified risks.

Requirements

• 5–8 years of experience in Software Quality Engineering, Test Engineering or a similar role.

• Strong experience in web application, API and integration testing.

• Hands-on experience with Postman, REST Assured, pytest, Playwright, Cypress, Selenium or equivalent tools.

• Good programming knowledge in Java, Python, JavaScript or TypeScript.

• Experience testing distributed systems, APIs and enterprise integrations.

• Experience with Git, CI/CD and defect management tools.

• Good understanding of test automation, regression testing and risk-based testing.

• Experience analysing logs, API requests/responses and system failures.

• Good understanding of LLM/GenAI applications, RAG, prompts, embeddings and AI agents.

• Strong analytical and problem-solving skills with good stakeholder communication.

• Able to work in a fast-paced environment with evolving requirements.

Good to Have

• Banking or financial services experience.

• Experience with Langfuse, LangSmith, OpenTelemetry, Elastic or Splunk.

• Knowledge of Kubernetes, OpenShift, AWS or containerised applications.

• Experience in GenAI security, prompt injection or adversarial testing.

• Experience with performance, accessibility or security testing.