ISTQB Artificial Intelligence (AI) Tester

ISTQB AI Testing (CT-AI) V2.0

Boost your capability to evaluate AI-based systems by strengthening your understanding of artificial intelligence and deep learning, with a clear focus on testing AI systems and leveraging AI within your testing processes.

Become a certified AI tester!

The ISTQB® Certified Tester – AI Testing (CT-AI) course builds practical capability in testing AI-based systems and applying AI to strengthen your testing approach. Aligned to the ISTQB CT-AI v2.0 syllabus, it gives you a clear view of today’s AI landscape and emerging trends—so you can plan, design and execute effective tests for machine learning and generative AI solutions.

By the end of the course, you will be able to apply AI to support and improve software testing activities, test AI-based systems (including machine learning and generative AI) while accounting for probabilistic behaviour, non-determinism and data dependency, design meaningful risk-based test cases for AI solutions, and contribute confidently to an AI-focused test strategy and quality engineering approach.

Course Overview

Introduction to Artificial Intelligence and AI-based systems.
Quality Characteristics for AI-Based Systems.
Acceptance Criteria for AI-Based Systems.
Introduction to Machine Learning.
Data for Machine Learning.
ML Functional Performance Metrics for Classification.
Neural Networks and AI-specific testing considerations.
Testing AI-Based Systems.
Testing Generative AI and Large Language Models.
Test Levels for Machine Learning Systems.
Input Data Testing for Machine Learning Systems.
Model Testing for Machine Learning Systems.
Machine Learning Development Testing.
Test strategy considerations for AI-based systems.
Practical methods and techniques for evaluating AI quality, performance, reliability and risk.

Target Audience

Anyone involved in testing AI-based systems and/or AI for testing.
Testers, test analysts, data analysts, test engineers, test consultants, test managers, user acceptance testers, and software developers.
Anyone who wants a basic understanding of testing AI-based systems and/or AI for testing.
Project managers, quality managers, software development managers, business analysts, operations team members, IT directors, and management consultants working with an AI-based system.
Data scientists, ML engineers and professionals contributing to AI-enabled product development.

Course Pre-requisites

The candidate must hold the ISTQB Foundation certificate to undertake the ISTQB AI Tester course. A minimum of 12 months’ previous testing experience is also recommended. This experience is beneficial but not required by the ISTQB.

Learning Outcomes

Explain today’s AI landscape (ML and Generative AI) and where it creates business value.
Distinguish AI-driven products from traditional software to set realistic quality expectations.
Interpret how models learn (including neural networks) to target testing where it matters most.
Assess AI quality risks: transparency, explainability, fairness, robustness, safety and trustworthiness.
Define clear AI acceptance criteria and use them to judge real system behaviour.
Validate training, test and live data to reduce defects, bias and performance volatility.
Detect and respond to bias, data drift and data quality issues before they impact customers.
Calculate and interpret key ML performance metrics to evidence release readiness.
Design multi-level tests for ML systems to improve reliability from component to production.
Evaluate model resilience under edge cases, changing inputs and adversarial conditions.
Apply fit-for-purpose testing across data prep, training, validation, deployment and monitoring.
Manage probabilistic and non-deterministic behaviour with practical risk mitigations.
Test Generative AI and LLM outputs for accuracy, consistency, safety and policy compliance.
Identify common GenAI failure modes (hallucination, prompt injection, data leakage) and test for them.
Contribute to an AI test strategy and select techniques that increase confidence and reduce delivery risk.

What is included with this course?

Inclusion	Instructor Led Training
3 Days’ Training		3 days of live online training with a certified industry professional.
Course Manual		Comprehensive course manual.
Revision Questions		End of each module revision questions.
Practice Exam		Full mock exam.
Skills Development		Course content that is designed to grow competencies and support career development through interactive and engaging learning.

Trusted by Professionals

“The course was interactive and used real-life examples,
I will recommend this course to others to help prepare them for their exams. Instructiveness and examples made concepts very clear. I will apply my e-learnings in my day-to-day work and test AI based solutions”

Samresh Bhardwaj

ISTQB Artificial Intelligence (AI) Tester – Live Online

“The instructor used hands-on examples and shared several recent news stories related to AI, which made the session highly engaging. Their presentation style was dynamic and helped maintain interest throughout and provided valuable insights into various AI testing methods, which I plan to apply in my work. I would definitely recommend it, as AI is increasingly integrated into our products and can significantly enhance everyday tasks through improved efficiency.”

Nadya Veretnova
QUEENSLAND DEPARTMENT OF TRANSPORT AND MAIN ROADS
ISTQB Artificial Intelligence (AI) Tester – Live Online

“The instructor used hands-on examples and shared several recent news stories related to AI, which made the session highly engaging. Their presentation style was dynamic and helped maintain interest throughout. The course provided valuable insights into various AI testing methods, which I plan to apply in my work. I would definitely recommend it, as AI is increasingly integrated into our products and can significantly enhance everyday tasks through improved efficiency.”

Anonymous
TEST LEAD
ISTQB Artificial Intelligence (AI) Tester – Live Online

Request A Free Info Pack

Get Expert Course Advice

Want to establish a solid foundation for your testing career? Find out how you can gain the skills and knowledge you need as a testing professional with this industry standard qualification.