The Senior Test Engineering Lead is responsible for the independent quality assurance sign-off that gates every platform release. While a signed backtest confirms model measurement accuracy, it does not validate platform functionality. This role is accountable for verifying that the platform performs correctly, reliably, and at scale.
A key aspect of the role is validating performance through full-corpus historical replay rather than synthetic load testing. Since the platform's purpose is to serve historical state at scale, testing must accurately reflect real-world historical workloads.
Key Responsibilities
Test Strategy & Planning
- Define test strategy, environments, tooling, and test data for the platform, engine, and user-facing services.
- Establish quality standards and release readiness criteria.
Functional, Integration & Contract Testing
- Design and execute testing for APIs, services, and integrations.
- Validate service contracts across organizational boundaries.
Regression Automation
- Build and maintain an automated regression suite.
- Integrate testing into CI/CD pipelines so quality gates actively govern releases.
Performance & Load Validation
- Design and execute performance testing using full-corpus historical replay.
- Validate scalability and responsiveness of the point-in-time platform and graph-as-of service.
Data Integrity & Leakage Prevention
- Develop automated checks that detect and prevent future-data leakage into scoring paths.
- Partner with the AI Validation Lead to design assertions and maintain ownership of their CI implementation.
Release Sign-Off
- Provide the independent test and performance approval required for production promotion.
- Block releases when quality, stability, or performance standards are not met.
Defect Management
- Raise, triage, prioritize, and track defects through resolution.
Knowledge Transfer
- Deliver test suites, environments, documentation, and operational runbooks.
Required Qualifications
- Senior SDET, Test Engineering Lead, or similar experience on complex data platforms with ownership of release gates.
- Advanced Python test automation expertise (PyTest or equivalent), including framework development.
- Strong CI/CD pipeline design experience and implementation of enforced quality gates.
- Proven experience performance testing data-intensive platforms, particularly using real historical workload replay.
- Expertise in API, integration, and contract testing across distributed services.
- Experience with containerized testing environments, Docker, and cloud platforms.
- Strong understanding of data quality, schema validation, and pipeline verification.
- Demonstrated ability to make independent release decisions and formally recommend against deployment when necessary.
Preferred Qualifications
- Experience testing machine learning, analytics, or AI-driven platforms.
- Knowledge of streaming architectures and replay-based systems.
- Familiarity with graph databases and query performance optimization.
- Experience leading client-facing testing programs, transitions, and operational handovers.
Why QualityAI?
QualityAI is an AI-first quality engineering company helping enterprises deploy and scale complex systems with greater confidence. Operating across data, models, platforms, infrastructure, and operational environments, the company provides assurance and engineering expertise that helps organizations ensure systems perform reliably in real-world conditions.
Formerly Qualitest, QualityAI supports global enterprises across regulated and technology-driven industries, combining deep engineering heritage with AI-enabled delivery, operational assurance, and lifecycle expertise to help clients achieve certainty at go-live.
- Be a part of a company who strives to support for diversity and inclusion in the workplace – we are one, we are many at QualityAI. Celebrate culture, share knowledge with engineers from around the globe, and inspire each other through our differences.
- Local and global opportunities – we offer you internal rotation and international mobility opportunities to grow your career.
- Clear view of your career and progression with the company – QualityAI is growing massively (since Jan 2021 – added more than 2000 engineers) and giving you the opportunity to grow with us.
- Work hard and play harder with our flexible and casual culture. Take a break from work and join an employee event, or enjoy the amenities and games provided from one of our Employees Centers.
- Never stop experimenting and learning with QualityAI Tech academy: 3000+ training courses, mentorship programs, technical tribes, sponsored certifications, leadership programs and much more
- Earn bonuses via our Client Referral and Employee Referral Program’s. Refer and earn – tap your network for net-worth.
If you like what you have read, send us your resume and let’s start talking!
Intrigued to find more about us? Visit our website at
If you like what you have read, send us your resume and let’s start talking!