AIF-C01 Amazon Web Services AWS Certified AI Practitioner Exam Free Practice Exam Questions (2026 Updated)

The verified answers are A. Model evaluation and C. AI model service cards. The question is specifically about explainability and transparency with model selections before a generative AI application goes to production. AWS AI Practitioner guidance identifies model selection as part of the foundation model lifecycle and includes evaluation as a required activity in that lifecycle. AWS also lists model-selection factors such as model type, performance requirements, capabilities, constraints, compliance, modality, latency, model complexity, customization, and input/output length. This means model evaluation directly supports responsible selection because it provides measurable evidence that a model meets the application’s business, technical, and governance requirements.

AI model service cards are also correct because AWS describes AI Service Cards as responsible AI documentation that improves transparency. AWS states that AI Service Cards provide information about intended use cases, limitations, responsible AI design choices, and performance optimization best practices for AWS AI services and models. AWS also links these cards to responsible AI areas such as fairness, bias, explainability, robustness, governance, transparency, privacy, and security. That directly addresses the company’s concern about transparency when choosing models.

Guardrails is not the best answer here. Guardrails are important for safety controls, denied topics, content filtering, and responsible runtime behavior, but the question focuses on explainability and transparency in model selection, not output filtering. Data encryption is incorrect because encryption protects data confidentiality at rest or in transit; it does not explain model behavior or document model limitations. Automated reasoning is also not the best match. It can support formal validation of specific policy-based logic, but it is not the primary AWS tool or technique for transparent model selection. Therefore, model evaluation and AI model service cards are the two techniques/tools that best address the stated requirement.

AWS documentation identifies hallucinations as a known limitation of generative AI models, particularly when used in business and production environments. Hallucinations occur when a model generates outputs that are unrelated, incorrect, fabricated, or unsupported by the input data or provided context. These outputs often appear confident and fluent, which can make them difficult to detect without additional validation.

Generative AI models, including large language models, operate using probabilistic token prediction based on patterns learned during training. AWS explains that these models do not have true reasoning or factual grounding unless explicitly provided with context or external knowledge. As a result, when prompts are ambiguous, incomplete, or outside the model’s training distribution, the model may produce responses that are irrelevant or misleading.

This behavior presents a risk for business use cases such as customer support, reporting, or decision-making systems. AWS highlights hallucinations as a key challenge that must be mitigated through techniques such as Retrieval Augmented Generation (RAG), prompt engineering, human review, and output validation.

The other options are not correct. Interpretability refers to the ability to understand model decisions, not incorrect outputs. Data bias relates to skewed or unfair training data. Nondeterminism refers to variability in outputs, not relevance or correctness.

AWS consistently categorizes hallucinations as a primary disadvantage of generative AI, making this the correct answer.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

In Amazon Bedrock evaluations, Completeness measures how thoroughly a model or agent response addresses all aspects of the user prompt.

AWS evaluation guidance for LLM-as-a-judge explains that:

Completeness focuses on coverage of prompt requirements

It is especially useful for evaluating multi-part questions

It is a built-in qualitative metric in agent evaluation workflows

Why the other options are incorrect:

ROUGE (A) measures text overlap, mainly for summarization.

Following instructions (C) evaluates adherence, not coverage.

Refusal (D) measures appropriate refusal behavior.

AWS AI document references:

Amazon Bedrock Model Evaluation

LLM-as-a-Judge Metrics

Evaluating Agent Responses on AWS

Creating an Amazon Bedrock knowledge base allows the integration of external or private data sources with a foundation model (FM) like Amazon Titan. This integration helps supplement the model with relevant data from the company ' s private data sources to enhance its responses.

Option C (Correct): " Create an Amazon Bedrock knowledge base " : This is the correct answer as it enables the company to incorporate private data into the FM to improve its effectiveness.

Option A: " Use a different FM " is incorrect because it does not address the need to supplement the current model with private data.

Option B: " Choose a lower temperature value " is incorrect as it affects output randomness, not the integration of private data.

Option D: " Enable model invocation logging " is incorrect because logging does not help in supplementing the model with additional data.

AWS AI Practitioner References:

Amazon Bedrock and Knowledge Integration: AWS explains how creating a knowledge base allows Amazon Bedrock to use external data sources to improve the FM’s relevance and accuracy.