iSQI Certified Tester AI Testing CT-AI Exam Questions

Page: 1 / 14
Total 120 questions
Question 1

"AllerEgo" is a product that uses sell-learning to predict the behavior of a pilot under combat situation for a variety of terrains and enemy aircraft formations. Post training the model was exposed to the real-

world data and the model was found to be behaving poorly. A lot of data quality tests had been performed on the data to bring it into a shape fit for training and testing.

Which ONE of the following options is least likely to describes the possible reason for the fall in the performance, especially when considering the self-learning nature of the Al system?

SELECT ONE OPTION

The difficulty of defining criteria for improvement before the model can be accepted.

The fast pace of change did not allow sufficient time for testing.

The unknown nature and insufficient specification of the operating environment might have caused the poor performance.



Answer : A, A


Question 2

Which ONE of the following options is an example that BEST describes a system with Al-based autonomous functions?

SELECT ONE OPTION



Answer : D

AI-Based Autonomous Functions:An AI-based autonomous system is one that can respond to its environment without human intervention. The other options either involve human decisions or do not use AI at all.

Reference:ISTQB_CT-AI_Syllabus_v1.0, Sections on Autonomy and Testing Autonomous AI-Based Systems.


Question 3

Which statement regarding the use of training, validation, and test data sets is correct?

Choose ONE option (1 out of 4)



Answer : D

The ISTQB CT-AI syllabus (Section3.2 -- Model Evaluation) specifies the correct usage oftraining,validation, andtestdatasets. It emphasizes that thetest dataset must be representative of the real operational dataand must beequivalent in distribution to the training and validation sets, ensuring a fair and unbiased evaluation. Option D precisely matches this requirement.

Option A contradicts the syllabus because validation and test sets servedifferent purposes: validation is for tuning, test is for final evaluation. Combining them undermines the reliability of results. Option B is incorrect because even with limited data, the syllabus recommends maintaining a test set or using techniques such ascross-validationrather than eliminating testing. Option C is wrong because equal distribution (33/33/33) isnot recommended; typically, the training set is much larger (e.g., 70--80%).

Thus, OptionDis the only statement aligned with the syllabus' guidance.


Question 4

You are developing a ''flower'' ML model... Which of the following describes an objection that you can NEGLECT in your risk assessment?

Choose ONE option (1 out of 4)



Answer : D

The ISTQB CT-AI syllabus explains that reusing pre-trained models is strongly related tosimilarity between the original task and the new task. Section1.8 -- Pre-trained Models and Transfer Learningstates that reuse is effective when the new task is similar to the original one, such as adapting a cat-classifier to classify dog breeds. The syllabus warns about risks related toinput differences,data preparation inconsistencies,inherited shortcomings, andexplainability issues. These are legitimate objections (matching options A, B, and C) because large differences in image inputs or patterns can undermine transfer learning; misclassification risk can increase; and explainability often decreases when reusing pre-trained models .

However,output differences are NOT a valid concernhere. Both the leaf-based and flower-based ML models classifythe same plant species, meaning theiroutputs are identical. The syllabus does not identify output mismatch as a transfer-learning risk. Real risks concerninputs,bias inheritance,model transparency, andtraining differences---not output labels. Therefore, OptionDdescribes an objection that can be safelyneglected, because output classes are the same and do not hinder reuse.


Question 5

Which of the following characteristics of AI-based systems make it more difficult to ensure they are safe?



Answer : C

The syllabus states that non-determinism is one of the key challenges for ensuring safety in AI-based systems:

'The characteristics of AI-based systems that make it more difficult to ensure they are safe... include: complexity, non-determinism, probabilistic nature, self-learning, lack of transparency, interpretability and explainability, and lack of robustness.'

(Reference: ISTQB CT-AI Syllabus v1.0, Section 2.8, page 25 of 99)


Question 6

Which of the following statements about reinforcement learning is correct?

Choose ONE option (1 out of 4)



Answer : C

Section1.6.3 -- Reinforcement Learningof the ISTQB CT-AI syllabus states that reinforcement learning (RL) is based on anagent interacting with an environment, performing actions, and receivingrewards or penalties. The core concept is thereward function, which guides the agent's learning process. The syllabus emphasizes that training in RL isdriven by rewards, and the agent aims to maximize cumulative reward over time. Therefore, OptionCdirectly reflects the correct description: the agent learns by being rewarded for successful actions .

Option A is incorrect because RL doesnotuse labeled data; that applies to supervised learning. Option B contradicts the syllabus definition: RL fundamentallyrequiresinteraction with the environment. Option D is incorrect because the reward function isdefined by humans, not learned by the agent; the agent learns apolicy, not the reward function itself.

Thus, OptionCis the only statement consistent with RL as defined in the syllabus.


Question 7

Which of the following is a technique used in machine learning?



Answer : A

Decision trees are a foundational algorithm used in supervised machine learning. The syllabus describes:

'A decision tree is a tree-like ML model whose nodes represent decisions and whose branches represent possible outcomes.'

(Reference: ISTQB CT-AI Syllabus v1.0, Section 3.4)


Page:    1 / 14   
Total 120 questions