Amazon AWS Certified AI Practitioner AIF-C01 Exam Questions

Answer : D

The verified answer is D. Bilingual Evaluation Understudy (BLEU) score. The company wants to evaluate whether the chatbot's generated language matches a target communication style that includes creative spelling and shortened words. AWS AI Practitioner guidance lists BLEU, ROUGE, and BERTScore as relevant metrics for assessing foundation model performance. AWS Prescriptive Guidance describes BLEU as a metric-based evaluation method that measures n-gram overlap and focuses on precision. Because the requirement is about matching a particular style of generated language against reference examples, BLEU is the best fit among the given options.

F1 score is incorrect because it is primarily used for classification-style problems where precision and recall are combined into one score. It is not the correct metric for evaluating generated text style.

BERTScore is incorrect in this specific question because BERTScore focuses on semantic similarity using contextual embeddings. That can be useful when paraphrases should be accepted, but the question emphasizes surface language style: creative spelling, shortened words, and target-audience wording. Those are closer to token and phrase overlap against reference-style responses.

ROUGE is incorrect because ROUGE is commonly used for summarization and measures overlap with reference text, especially recall-oriented overlap. The scenario is not primarily asking whether the chatbot preserved all important content from a source document. It is asking whether the generated response matches a language style.

BLEU is therefore the best answer because it can compare the generated chatbot output to reference examples written in the desired teenage language style and measure how closely the model's wording overlaps with those references.

Answer : A

The correct answer is A because temperature controls the randomness of a language model's output. A higher temperature increases diversity by making the model more likely to explore less probable tokens, while a lower temperature results in more deterministic and repetitive outputs.

From AWS documentation:

'The temperature parameter in LLMs adjusts the randomness of generated responses. Higher values (e.g., 0.8--1.0) produce more creative and diverse output, while lower values (e.g., 0.1--0.3) make output more focused and repetitive.'

Explanation of other options:

B . Batch size is related to training efficiency, not output diversity.

C . Learning rate affects the training convergence rate, not inference-time output variety.

D . Optimizer type is a training configuration that influences how the model learns during training, not diversity during inference.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock -- Parameter Tuning Guide

AWS Machine Learning Specialty Guide -- LLM Inference Parameters

Answer : D

The company wants to enhance the response quality of an LLM for complex problem-solving tasks requiring detailed reasoning and step-by-step explanations. Chain-of-thought prompting encourages the LLM to break down the problem into intermediate steps, providing a clear reasoning process before arriving at the final answer, which is ideal for this requirement.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

'Chain-of-thought prompting improves the reasoning capabilities of large language models by encouraging them to break down complex tasks into intermediate steps, providing a step-by-step explanation that leads to the final answer. This technique is particularly effective for problem-solving tasks requiring detailed reasoning.'

(Source: AWS Bedrock User Guide, Prompt Engineering Techniques)

Detailed

Option A: Few-shot promptingFew-shot prompting provides a few examples to guide the LLM but does not explicitly encourage step-by-step reasoning or detailed explanations.

Option B: Zero-shot promptingZero-shot prompting relies on the LLM's pre-trained knowledge without examples, making it less effective for complex tasks requiring detailed reasoning.

Option C: Directional stimulus promptingDirectional stimulus prompting is not a standard technique in AWS documentation, likely a distractor, and does not address step-by-step reasoning.

Option D: Chain-of-thought promptingThis is the correct answer. Chain-of-thought prompting enhances response quality for complex tasks by guiding the LLM to reason step-by-step, providing detailed explanations.

AWS Bedrock User Guide: Prompt Engineering Techniques (https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-engineering.html)

AWS AI Practitioner Learning Path: Module on Generative AI Prompting

Amazon Bedrock Developer Guide: Advanced Prompting Strategies (https://aws.amazon.com/bedrock/)

Below are the corrected and formatted questions based on the provided input, following the specified format. Each question is aligned with the main topics from the AWS AI Practitioner certification, and answers are provided with comprehensive explanations referencing official AWS documentation or study guides. Since the exact AWS AI Practitioner documents are not publicly available in full, I will rely on authoritative AWS documentation, whitepapers, and blogs available as of May 17, 2025, to ensure accuracy. If specific document excerpts are unavailable, I will use the most relevant AWS resources and clearly note the references.

Answer : B

Amazon Bedrock provides an option to enable invocation logging to capture and store the input and output data of the models used. This is essential for monitoring and auditing purposes, particularly when handling customer data.

Option B (Correct): 'Enable invocation logging in Amazon Bedrock': This is the correct answer as it directly enables the logging of all model invocations, ensuring transparency and traceability.

Option A: 'Configure AWS CloudTrail' is incorrect because CloudTrail logs API calls but does not provide specific logging for model inputs and outputs.

Option C: 'Configure AWS Audit Manager' is incorrect as Audit Manager is used for compliance reporting, not specific invocation logging for AI models.

Option D: 'Configure model invocation logging in Amazon EventBridge' is incorrect as EventBridge is for event-driven architectures, not specifically designed for logging AI model inputs and outputs.

AWS AI Practitioner Reference:

Amazon Bedrock Logging Capabilities: AWS emphasizes using built-in logging features in Bedrock to maintain data integrity and transparency in model operations.

Answer : A, C

The verified answers are A. Model evaluation and C. AI model service cards. The question is specifically about explainability and transparency with model selections before a generative AI application goes to production. AWS AI Practitioner guidance identifies model selection as part of the foundation model lifecycle and includes evaluation as a required activity in that lifecycle. AWS also lists model-selection factors such as model type, performance requirements, capabilities, constraints, compliance, modality, latency, model complexity, customization, and input/output length. This means model evaluation directly supports responsible selection because it provides measurable evidence that a model meets the application's business, technical, and governance requirements.

AI model service cards are also correct because AWS describes AI Service Cards as responsible AI documentation that improves transparency. AWS states that AI Service Cards provide information about intended use cases, limitations, responsible AI design choices, and performance optimization best practices for AWS AI services and models. AWS also links these cards to responsible AI areas such as fairness, bias, explainability, robustness, governance, transparency, privacy, and security. That directly addresses the company's concern about transparency when choosing models.

Guardrails is not the best answer here. Guardrails are important for safety controls, denied topics, content filtering, and responsible runtime behavior, but the question focuses on explainability and transparency in model selection, not output filtering. Data encryption is incorrect because encryption protects data confidentiality at rest or in transit; it does not explain model behavior or document model limitations. Automated reasoning is also not the best match. It can support formal validation of specific policy-based logic, but it is not the primary AWS tool or technique for transparent model selection. Therefore, model evaluation and AI model service cards are the two techniques/tools that best address the stated requirement.

Answer : B

AWS documentation identifies ROUGE as a standard evaluation metric for text summarization tasks. ROUGE measures the overlap of n-grams, sequences, or word pairs between a machine-generated summary and a human-written reference summary, making it ideal for automated evaluation.

In this scenario, the company needs a metric that directly compares generated summaries with human references. ROUGE scores quantify how much of the reference content is captured by the model output, which aligns with AWS recommendations for evaluating summarization quality.

The other metrics are not appropriate. F1 score is typically used for classification tasks. Perplexity measures language model confidence but does not compare outputs to reference summaries. Frchet Inception Distance is used for image generation tasks, not text.

AWS consistently recommends ROUGE for summarization evaluation, making it the correct choice.

Answer : A

Comprehensive and Detailed Explanation (AWS AI documents):

AWS Responsible AI principles stress the importance of fairness, robustness, and accountability, which begin with the quality of the data used to train models. A responsible dataset should:

Be diverse, representing different populations, environments, and conditions to reduce bias

Be sourced from reputable and appropriate sources, ensuring data quality and ethical use

Have balanced categories, preventing the model from favoring one class over others and reducing the risk of discriminatory outcomes

These characteristics help ensure that the resulting image classification model behaves fairly, performs reliably across groups, and aligns with AWS Responsible AI best practices.

Why the other options are incorrect:

B focuses on dataset size rather than quality, balance, or representativeness.

C increases the risk of bias and poor generalization.

D limits diversity and does not inherently ensure fairness or accountability.

AWS AI Study Guide Reference:

AWS Responsible AI principles: fairness and data quality

AWS guidance on dataset selection and preparation for responsible ML