AIF-C01 Amazon Web Services AWS Certified AI Practitioner Exam Free Practice Exam Questions (2026 Updated)

The correct answer is C because Amazon Bedrock ' s model evaluation feature allows users to compare outputs from different foundation models using human evaluation or automatic metrics. It enables the creation of structured evaluations where human reviewers (in this case, scientists) can assess model responses based on custom criteria like relevance, coherence, or accuracy.

From AWS documentation:

" Amazon Bedrock provides model evaluation capabilities that support both automatic and human evaluation. You can define custom evaluation prompts and collect assessments from reviewers to compare foundation model outputs for tasks such as summarization, text generation, and more. "

This solution is ideal for research workflows requiring domain experts to provide feedback on LLM-generated content.

Explanation of other options:

A. Amazon Personalize is used for building recommendation systems, not for evaluating model output.

B. Amazon Rekognition is used for analyzing images and videos (e.g., moderation, facial recognition), not textual output.

D. Amazon Comprehend provides NLP services like sentiment analysis, but sentiment is not sufficient for full quality evaluation of research paper generation.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Developer Guide – Model Evaluation Overview

AWS Generative AI Best Practices

AWS ML Specialty Study Guide – Evaluation and Feedback Loops in LLMs

The verified answer is B. F1 score. This is a classic imbalanced classification problem. Only 5% of customers make purchases, so a model can achieve 95% accuracy by predicting “will not purchase” for nearly everyone. That looks good numerically but fails the business purpose because the model rarely identifies actual buyers. AWS documentation describes F1 as a balanced measure that takes class balance into account and defines it as the harmonic mean of precision and recall.

AWS machine learning documentation also explains that F1 is commonly used for classification tasks and that a high F1 score indicates the model performs well for both precision and recall. If precision or recall is weak, the F1 score drops, which helps expose problems that accuracy hides.

Option A is incorrect because overall accuracy is already misleading in the scenario. The model’s 95% accuracy is probably caused by the majority class: customers who do not buy. Accuracy does not show whether the model identifies the minority class, which is the actual buyer group.

Option C is incorrect because training time for each epoch measures training efficiency, not prediction quality. A model can train quickly and still fail to identify buyers.

Option D is incorrect because cost per inference request is an operational cost metric. It does not evaluate whether the model correctly identifies purchasing customers.

Because the dataset is imbalanced and the model misses the minority class, the company should use F1 score instead of accuracy.

The airline company aims to build a conversational AI assistant using large language models (LLMs) and a knowledge base to create a text-based chatbot with minimal development effort. Retrieval Augmented Generation (RAG) on Amazon Bedrock is an ideal solution because it combines LLMs with a knowledge base to provide accurate, contextually relevant responses without requiring extensive model training or custom development. RAG retrieves relevant information from a knowledge base and uses an LLM to generate responses, simplifying the development process.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" Retrieval Augmented Generation (RAG) in Amazon Bedrock enables developers to build conversational AI applications by combining foundation models with external knowledge bases. This approach minimizes development effort by leveraging pre-trained models and integrating them with data sources, such as FAQs or databases, to provide accurate and contextually relevant responses. "

(Source: AWS Bedrock User Guide, Retrieval Augmented Generation)

Detailed Explanation:

Option A: Train models on Amazon SageMaker Autopilot.SageMaker Autopilot is designed for automated machine learning (AutoML) tasks like classification or regression, not for building conversational AI with LLMs and knowledge bases. It requires significant data preparation and is not optimized for chatbot development, making it less suitable.

Option B: Develop a Retrieval Augmented Generation (RAG) agent by using Amazon Bedrock.This is the correct answer. RAG on Amazon Bedrock allows the company to use pre-trained LLMs and integrate them with a knowledge base (e.g., flight schedules or FAQs) to build a chatbot with minimal effort. It avoids the need for extensive training or coding, aligning with the requirement for least development effort.

Option C: Create a Python application by using Amazon Q Developer.While Amazon Q Developer can assist with code generation, building a chatbot from scratch in Python requires significant development effort, including integrating LLMs and a knowledge base manually, which is more complex than using RAG on Bedrock.

Option D: Fine-tune models on Amazon SageMaker Jumpstart.Fine-tuning models on SageMaker Jumpstart requires preparing training data and customizing LLMs, which involves more effort than using a pre-built RAG solution on Bedrock. This option is not the least effort-intensive.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Amazon Neptune is a fully managed graph database service optimized for storing and querying highly connected data.

AWS guidance highlights that graph databases are ideal for:

Fraud detection

Relationship analysis

Pattern discovery across entities such as users, transactions, and accounts

Amazon Neptune supports popular graph models and enables ML-driven investigations by efficiently traversing relationships, which is critical for fraud pattern analysis.

Why the other options are incorrect:

OpenSearch (A) is optimized for search and log analytics.

Aurora (B) is a relational database, not graph-based.

MemoryDB (D) is an in-memory data store for low-latency workloads.

AWS AI document references:

Amazon Neptune Overview

Graph-Based Fraud Detection on AWS

Using Graph Databases for Investigations

The verified answer is B. Pre-training. The scenario describes the first major training stage for a large language model, where the model starts with randomly initialized weights and learns broad language patterns from a very large corpus of unlabeled or self-supervised text data. AWS describes large language models as very large deep learning models that are pre-trained on vast amounts of data. In this stage, the model is not yet being customized for a narrow business task; instead, it learns general-purpose linguistic and semantic representations from large-scale text.

AWS machine learning guidance explains that pre-training teaches the model broad linguistic and semantic patterns, including grammar, context, world knowledge, reasoning, and token prediction, using self-supervised learning approaches such as masked language modeling or causal language modeling. That exactly matches the question’s description: random weight initialization followed by fitting the model to a large web dataset using a language-modeling objective. This is the core training process used to create a foundation model or LLM before later adaptation.

Option A. Fine-tuning is incorrect because AWS defines fine-tuning as training a pretrained model on a new dataset rather than training from scratch. Fine-tuning adapts an existing model for a specific task or domain and usually requires less data and less training time than pre-training.

Option C. Model selection is incorrect because model selection refers to choosing an appropriate model or architecture, not training the model weights from random initialization. Option D. Deployment is also incorrect because AWS describes deployment as the stage where a trained model is made available for inference or predictions, such as through SageMaker inference endpoints.

Therefore, because the company is training an LLM from initial weights on a large web corpus using a language-modeling objective, the stage is pre-training.

Amazon OpenSearch Service (formerly Amazon Elasticsearch Service) has introduced capabilities to support vector search, which allows companies to build vector database applications. This is particularly useful in machine learning, where vector representations (embeddings) of data are often used to capture semantic meaning.

Scalable index management and nearest neighbor search capability are the core features enabling vector database functionalities in OpenSearch. The service allows users to index high-dimensional vectors and perform efficient nearest neighbor searches, which are crucial for tasks such as recommendation systems, anomaly detection, and semantic search.

Here is why option C is the correct answer:

Scalable Index Management: OpenSearch Service supports scalable indexing of vector data. This means you can index a large volume of high-dimensional vectors and manage these indexes in a cost-effective and performance-optimized way. The service leverages underlying AWS infrastructure to ensure that indexing scales seamlessly with data size.

Nearest Neighbor Search Capability: OpenSearch Service ' s nearest neighbor search capability allows for fast and efficient searches over vector data. This is essential for applications like product recommendation engines, where the system needs to quickly find the most similar items based on a user ' s query or behavior.

AWS AI Practitioner References:

According to AWS documentation, OpenSearch Service ' s support for nearest neighbor search using vector embeddings is a key feature for companies building machine learning applications that require similarity search.

The service uses Approximate Nearest Neighbors (ANN) algorithms to speed up searches over large datasets, ensuring high performance even with large-scale vector data.

The other options do not directly relate to building vector database applications:

A. Integration with Amazon S3 for object storage is about storing data objects, not vector-based searching or indexing.

B. Support for geospatial indexing and queries is related to location-based data, not vectors used in machine learning.

D. Ability to perform real-time analysis on streaming data relates to analyzing incoming data streams, which is different from the vector search capabilities.

Fine-tuning is the process of training a pre-trained LLM with a labeled dataset specific to a desired task—in this case, mapping user messages to JSON outputs. Fine-tuning leverages supervised learning to specialize the model’s outputs.

C is correct:

“Fine-tuning is a supervised learning approach in which a model is further trained on a custom, labeled dataset to adapt to a specific use case.”

(Reference: Amazon Bedrock Fine-Tuning, AWS Certified AI Practitioner Study Guide)

A is incorrect—unsupervised learning does not use labeled data.

B (continued pre-training) uses unlabeled data.

D (RLHF) uses reward signals and human feedback, not direct labeled input/output pairs.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

BLEU is a widely used metric for evaluating machine translation by comparing machine-generated translations against reference (human) translations.

In this scenario:

Both systems are evaluated on the same dataset

The goal is to compare model output against human output

AWS ML evaluation guidance describes BLEU as suitable for relative comparison of translation quality across systems.

Why the other options are incorrect:

Absolute quality (A, C) is difficult to measure without human judgment.

BERTScore (D) is more computationally complex and less standard for operational comparisons.

AWS AI document references:

Evaluating Machine Translation Models

NLP Model Evaluation Metrics

Comparing AI and Human Translations

Amazon CloudWatch is designed for real-time monitoring of applications and infrastructure. It supports metrics and logs for ML model performance and resource utilization. According to the AWS Certified AI Practitioner Study Guide:

“Amazon CloudWatch is a monitoring service that provides data and actionable insights to monitor your ML workloads and applications in real time, ensuring performance and scalability.”

Amazon SageMaker Ground Truth Plus is a managed data labeling service that includes human-in-the-loop (HITL) validation. This solution ensures high accuracy by involving human reviewers to validate the annotations and reduce the risk of incorrect annotations.

Amazon SageMaker Ground Truth Plus:

It allows for the creation of high-quality training datasets with human oversight, which minimizes errors in labeling and increases accuracy.

Human-in-the-loop workflows help verify the correctness of annotations, ensuring that generated images for protective eyewear meet high-quality standards.

Why Option A is Correct:

High Accuracy: Human-in-the-loop validation provides the ability to catch and correct errors in annotations, ensuring high-quality data.

Minimized Risk of Incorrect Annotations: Human review adds a layer of quality assurance, which is especially important in use cases like generating precise images for protective eyewear.

Why Other Options are Incorrect:

B. Amazon Bedrock: Does not offer a knowledge base for data augmentation; it focuses on running foundation models.

C. Amazon Rekognition: Provides image recognition and analysis, not a solution for minimizing annotation errors.

D. Amazon QuickSight: A data visualization tool, not relevant to image annotation or generation tasks.

Thus, A is the correct answer for generating high-accuracy images with minimized annotation risks.

The best solution is Amazon Bedrock Knowledge Bases, which allows for the seamless integration of structured and unstructured internal documents—such as PDFs, CSVs, and extracted image text—into a retrieval-augmented generation (RAG) pipeline. According to AWS documentation, Bedrock Knowledge Bases offer a no-code or low-code setup to link your enterprise data with foundation models for context-aware responses, without needing to fine-tune or retrain models. The system indexes documents in an Amazon S3 bucket, creates embeddings, and stores them in a vector store. At inference time, the model retrieves relevant context and incorporates it into its response. This approach provides dynamic and up-to-date responses while maintaining data privacy, with minimal operational overhead. Unlike fine-tuning or building a model from scratch in SageMaker, which requires considerable compute resources and model management, Bedrock Knowledge Bases are serverless and easy to configure. It is designed exactly for internal knowledge AI assistants.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Developer Guide – Knowledge Bases

AWS Generative AI Best Practices – RAG Patterns for Enterprise Search

Guardrails for Amazon Bedrock provide mechanisms to filter and control the content generated by models to comply with privacy and policy requirements. Using guardrails ensures that sensitive or personal information is not included in the model ' s responses. Additionally, integrating Amazon CloudWatch alarms allows for real-time notification when a policy violation occurs.

Option C (Correct): " Use Guardrails for Amazon Bedrock to filter content. Set up Amazon CloudWatch alarms for notification of policy violations " : This is the correct answer because it directly addresses both the prevention of policy violations and the requirement to receive notifications when such violations occur.

Option A: " Use Amazon Macie to scan the model ' s output for sensitive data " is incorrect because Amazon Macie is designed to monitor data in S3, not to filter real-time model outputs.

Option B: " Configure AWS CloudTrail to monitor the model ' s responses " is incorrect because CloudTrail tracks API activity and is not suited for content moderation.

Option D: " Implement Amazon SageMaker Model Monitor to detect data drift " is incorrect because data drift detection does not address content moderation or privacy compliance.

AWS AI Practitioner References:

Guardrails in Amazon Bedrock: AWS provides guardrails to ensure AI models comply with content policies, and using CloudWatch for alerting integrates monitoring capabilities.

The correct answer is A because Amazon SageMaker Canvas is designed specifically for users with little or no machine learning or programming experience. It provides a visual interface to build ML models by simply uploading data, performing analysis, and generating predictions using a no-code environment.

From the AWS documentation:

" Amazon SageMaker Canvas enables business analysts and other users to generate accurate ML predictions using a visual, point-and-click interface without writing code or having prior ML experience. "

This feature allows the user to:

Import datasets (e.g., HR data)

Automatically explore the data

Select the prediction column (e.g., attrition)

Train the model

Generate and export predictions

Explanation of other options:

B. SageMaker Clarify is used to detect bias and explain ML predictions but not to build models or make predictions without code.

C. SageMaker Model Monitor monitors model quality in production but doesn’t build or train models.

D. SageMaker Data Wrangler is used for data preprocessing and transformation but still requires some technical configuration.

Referenced AWS AI/ML Documents and Study Guides:

Amazon SageMaker Canvas Developer Guide

AWS Certified Machine Learning Specialty Study Guide – AutoML and No-Code Tools Section

AWS Machine Learning Blog: “Predict Employee Attrition with SageMaker Canvas”

Data augmentation for imbalanced classes is the correct technique to address bias in input data affecting image generation.

Data Augmentation for Imbalanced Classes:

Involves generating new data samples by modifying existing ones, such as flipping, rotating, or cropping images, to balance the representation of different classes.

Helps mitigate bias by ensuring that the training data is more representative of diverse characteristics and scenarios.

Why Option A is Correct:

Balances Data Distribution: Addresses class imbalance by augmenting underrepresented classes, which reduces bias in the model.

Improves Model Fairness: Ensures that the model is exposed to a more diverse set of training examples, promoting fairness in image generation.

Why Other Options are Incorrect:

B. Model monitoring for class distribution: Helps identify bias but does not actively correct it.

C. Retrieval Augmented Generation (RAG): Involves combining retrieval and generation but is unrelated to mitigating bias in image generation.

D. Watermark detection for images: Detects watermarks in images, not a technique for addressing bias.

Amazon Augmented AI (Amazon A2I) is designed to enable human review workflows for machine learning predictions where human judgment is required. AWS documentation states that A2I allows organizations to integrate human reviewers into AI workflows to review low-confidence predictions or samples selected by business rules. This directly aligns with the requirement to involve employees in validating and improving translation outputs.

In this scenario, the translation model produces a confidence score, which is a common trigger used by Amazon A2I to route predictions to human reviewers. AWS explicitly describes that A2I supports use cases such as natural language processing, translation, content moderation, and document processing, where automated models may need human oversight to ensure accuracy and quality.

Amazon A2I provides managed workflows, reviewer task interfaces, and audit trails that allow employees to review, correct, and validate model outputs. The feedback collected through A2I can then be used to improve future model training, increasing translation quality over time.

The other options do not meet the requirement. Amazon SageMaker Clarify focuses on bias detection and explainability, not human review workflows. Amazon SageMaker Model Monitor is used to detect data drift and model performance degradation in production, not to involve humans in validating predictions. Amazon Bedrock Agents are designed to orchestrate tasks and interactions with foundation models, not to manage human-in-the-loop review processes.

AWS positions Amazon A2I as a core service for implementing human-in-the-loop machine learning, making it the correct solution for incorporating employees into a structured translation review process.

Moderation APIs, such as Amazon Rekognition’s Content Moderation API, can help filter and block inappropriate or unwanted images from being returned by a chatbot. These APIs are specifically designed to detect and manage undesirable content in images.

Option A (Correct): " Implement moderation APIs " : This is the correct answer because moderation APIs are designed to identify and filter inappropriate content, ensuring the chatbot does not return unwanted images.

Option B: " Retrain the model with a general public dataset " is incorrect because retraining does not directly prevent inappropriate content from being returned.

Option C: " Perform model validation " is incorrect as it ensures model correctness, not content moderation.

Option D: " Automate user feedback integration " is incorrect because user feedback does not prevent inappropriate images in real-time.

AWS AI Practitioner References:

AWS Content Moderation Services: AWS provides moderation APIs for filtering unwanted content from applications.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

The temperature parameter controls randomness in model outputs.

AWS generative AI guidance explains:

Higher temperature → more randomness and creativity

Lower temperature → more deterministic and predictable outputs

To increase diversity and creativity, the temperature should be increased.

Why the other options are incorrect:

Lower Top K (B) reduces output diversity.

Response length (C) affects size, not creativity.

Prompt length (D) does not directly control randomness.

AWS AI document references:

Inference Parameters for Foundation Models

Controlling Creativity in LLMs

Text Generation Configuration on AWS

Amazon Transcribe is the AWS service that converts speech to text, enabling the generation of subtitles (closed captions) for audio and video content automatically.

C is correct:

“Amazon Transcribe is an automatic speech recognition (ASR) service that makes it easy for developers to add speech-to-text capability to applications.”

This feature supports creating subtitles and transcripts for media files.

(Reference: Amazon Transcribe Overview, AWS AI Practitioner Official Study Guide)

A (Comprehend) is for NLP/text analytics.

B (Polly) is text-to-speech.

D (Translate) translates text, but does not create subtitles from audio/video.

Use Case 1:

The company’s chatbot needs predictions from the LLM to understand users ' intent with minimal latency.

→ Answer: Real-time inference

Chatbots require low-latency, immediate responses to user input. Real-time inference is ideal for these interactive use cases.

Use Case 2:

A data processing job needs to query the LLM to process gigabytes of text files on weekends.

→ Answer: Batch transform

Batch transform is designed for asynchronous, high-throughput jobs where latency is not critical. It’s ideal for scheduled or large-scale processing like weekend batch jobs on large datasets.

Use Case 3:

The company’s engineering team needs to create an API that can process small pieces of text content and provide low-latency predictions.

→ Answer: Real-time inference

An API requiring fast response time for small content sizes is best served by real-time inference to meet latency requirements.