Our client is seeking an AI QA Engineer to ensure reliable, safe, and high-quality AI and data-driven systems in fast-paced, experimental projects.
Requirements
* 3-6+ years of experience in QA, SDET, or evaluation-focused ML/AI testing, preferably with nondeterministic or probabilistic systems.
* Strong Python scripting skills for test automation, scenario evaluation, and defect detection.
* Experience with ML evaluation tools, LLM/RAG testing, or model benchmarking suites.
* Familiarity with vector databases, retrieval systems, multi-agent workflows, and AI pipelines.
* Understanding of CI/CD pipelines, DevOps tooling, and observability platforms.
* Ability to validate data correctness, embeddings, retrieval accuracy, and ranking/precision metrics.
* Strong instincts for edge cases, risk modes, adversarial failures, and failure-mode analysis.
* Curious, systematic, and detail-oriented mindset, with high ownership and discipline.
* Excellent communication skills for clear, actionable defect reporting.
Roles and Responsibilities
* Define and own the end-to-end QA strategy across UI, backend, data, and AI components.
* Design and implement test plans covering functional, non-functional, and behavioral requirements.
* Build automated and manual evaluation suites for LLMs, retrieval systems, and agent workflows.
* Conduct scenario-based tests, regression tests, and red-team exercises to uncover edge cases and risks.
* Validate data quality, embedding correctness, retrieval accuracy, and monitor for model drift or hallucinations.
* Define metrics, logs, dashboards, and alerts to monitor AI behavior, latency, cost, and errors.
* Detect and escalate reliability, bias, and performance issues early in the delivery cycle.
* Manage defect triage workflows, categorize failures across UI, API, data, and model layers, and ensure clear reproduction documentation.
* Integrate automated tests into CI/CD pipelines to catch regressions early.
* Support pods in delivering safe, reliable, and stable AI behavior for all experimental and production features.
For more information – please apply for this job or send your CV directly and we will contact you to provide further details.
Cavendish (Recruitment) Professionals Ltd are proud to be an equal opportunity employer and we believe that inclusivity begins with the candidate experience. All qualified applicants will receive consideration for employment regardless of gender, race, age, sexual orientation, religion, or belief.

Our client is looking for an experienced Senior QA Lead Engineer to drive quality strategy, lead distributed QA teams, and ensure high-performance delivery across complex, large-scale systems. Requirements 6+ years of experience in QA
View job & applyOur client is expanding their technology team and is seeking a Lead Full Stack Developer to drive the development of scalable digital products, strengthen engineering capabilities, and support business growth initiatives. Role and
View job & applyOur client is seeking a Senior AI/ML Engineer to lead the development and deployment of advanced machine learning models and AI-driven solutions. This is a unique opportunity to join an innovative team focused on pushing the boundaries of applied
View job & applyOur client is seeking a Senior Data Scientist - GenAI to develop and deploy cutting-edge generative AI models that drive innovation and business impact. Join a forward-thinking team at the forefront of next-generation AI solutions. Role and
View job & applyOur client is a global tech company looking for a Full Stack AI Engineer to join their team on a 12 month remote contract. This is an opportunity to work on cutting-edge AI-driven products in a highly collaborative, product-focused
View job & applyOur client is a global tech company looking for a Full Stack AI Engineer to join their team on a 12 month remote contract. This is an opportunity to work on cutting-edge AI-driven products in a highly collaborative, product-focused
View job & applyOur client is a global innovation-led organisation looking for a Senior AI Engineer to join their cutting-edge AI Incubator team on a 12 month contract. Skills and Requirements: Degree in Computer Science, Data Science, Machine Learning, or a
View job & applyOur client is a global innovation-led organisation looking for a Senior AI Engineer to join their cutting-edge AI Incubator team on a 12 month contract. Skills and Requirements: Degree in Computer Science, Data Science, Machine Learning, or a
View job & applyOur client is a global technology organisation looking for an Agentic AI Architect to design and deliver a next-generation AI-driven SDLC on a 12 month remote contract. Skills and Requirements: 7+ years in software engineering/architecture with 3+
View job & applyOur client is a global technology organisation looking for an Agentic AI Architect to design and deliver a next-generation AI-driven SDLC on a 12 month remote contract. Skills and Requirements: 7+ years in software engineering/architecture with 3+
View job & apply