AIF-C01 Amazon Web Services AWS Certified AI Practitioner Exam Free Practice Exam Questions (2025 Updated)

When a model performs well on the training data but poorly in production, it is often due to overfitting. Overfitting occurs when a model learns patterns and noise specific to the training data, which does not generalize well to new, unseen data in production. Increasing the volume of data used in training can help mitigate this problem by providing a more diverse and representative dataset, which helps the model generalize better.

Option C (Correct): "Increase the volume of data that is used in training": Increasing the data volume can help the model learn more generalized patterns rather than specific features of the training dataset, reducing overfitting and improving performance in production.

Option A: "Reduce the volume of data that is used in training" is incorrect, as reducing data volume would likely worsen the overfitting problem.

Option B: "Add hyperparameters to the model" is incorrect because adding hyperparameters alone does not address the issue of data diversity or model generalization.

Option D: "Increase the model training time" is incorrect because simply increasing training time does not prevent overfitting; the model needs more diverse data.

AWS AI Practitioner References:

Best Practices for Model Training on AWS: AWS recommends using a larger and more diverse training dataset to improve a model's generalization capability and reduce the risk of overfitting.

Amazon Comprehend toxicity detection is a managed NLP service that can analyze text for harmful or toxic language using pre-trained models—no need for labeled data or custom training.

B is correct: Comprehend’s toxicity detection API is designed for this use case, works out-of-the-box, and requires no data labeling or model training.

A (Rekognition) is for image and video content moderation.

C would require labeled data for training.

D (Polly) is for text-to-speech, not content moderation.

“Amazon Comprehend can detect toxicity in text with pre-trained models, requiring no labeled training data.”

(Reference: Amazon Comprehend Toxicity Detection, AWS AI Practitioner Official Guide)

Comprehensive and Detailed Explanation From Exact Extract:

In a RAG (Retrieval Augmented Generation) architecture, there are steps that can be optimized using offline batch processing, particularly for operations that do not require real-time updates:

A. Generation of content embeddings:When new content is published, it can be processed in batches to generate embeddings (vector representations) offline. These embeddings are then used at query time for similarity search. As new documents come in daily, batch processing is ideal for generating embeddings for all new content together.

“Content/document embeddings are typically generated offline, as this operation can be computationally expensive and does not need to happen in real-time.”

(Reference: AWS GenAI RAG Blog, Amazon Bedrock RAG Pattern)

C. Creation of the search index:After generating the content embeddings, these are indexed in a vector database or search service. This indexing is also typically performed in batch as part of the offline pipeline.

“Building or updating the vector index is often performed as a batch operation, reflecting the latest state of the content repository.”

(Reference: AWS RAG Pattern Whitepaper)

B, D, and E are real-time steps. Embeddings for user queries (B), retrieval of relevant content (D), and response generation (E) must be processed in real-time to provide an interactive experience.

According to the AWS Certified AI Practitioner documentation, explainable AI (XAI) refers to methods and techniques that make the behavior and predictions of machine learning models more understandable and transparent to users and stakeholders. In financial use cases, especially when decisions such as credit limits are made, regulatory and ethical concerns demand transparency about how such decisions are reached.

Option B is correct because applying explainable AI techniques (such as SHAP, LIME, or Amazon SageMaker Clarify) allows organizations to provide customers with clear insights into which data points or factors contributed to the model's decision. This aligns with best practices for responsible AI as defined in the AWS documentation, which states:

"Explainable AI increases transparency and trust in machine learning applications by helping users and regulators understand the decision process behind model predictions."

(Reference: AWS AI/ML Best Practices – Explainable AI, AWS AI Practitioner Exam Guide)

Option A suggests switching to a rule-based system, which is not practical for complex problems addressed by generative AI and may reduce model performance.

Option C (just a UI) does not inherently provide transparency into the model’s reasoning, unless paired with explainability techniques.

Option D (accuracy over transparency) does not address the company’s requirement for transparency.

To implement a large language model (LLM) responsibly, the firm should focus on fairness and mitigating bias, which are critical for ethical AI deployment.

A. Include Fairness Metrics for Model Evaluation:

Fairness metrics help ensure that the model's predictions are unbiased and do not unfairly discriminate against any group.

These metrics can measure disparities in model outcomes across different demographic groups, ensuring responsible AI practices.

C. Modify the Training Data to Mitigate Bias:

Adjusting training data to be more representative and balanced can help reduce bias in the model's predictions.

Mitigating bias at the data level ensures that the model learns from a diverse and fair dataset, reducing potential harms in deployment.

Why Other Options are Incorrect:

B. Adjust the temperature parameter of the model: Controls randomness in outputs but does not directly address fairness or bias.

D. Avoid overfitting on the training data: Important for model generalization but not directly related to responsible AI practices regarding fairness and bias.

E. Apply prompt engineering techniques: Useful for improving model outputs but not specifically for mitigating bias or ensuring fairness.

The company wants to fine-tune an ML model on Amazon Bedrock using sensitive data stored in private databases within a VPC, ensuring the data remains within its private network. AWS PrivateLink provides a secure, private connection between a VPC and AWS services like Amazon Bedrock, allowing data to stay within the company’s network without traversing the public internet. This meets the requirement for maintaining data privacy during fine-tuning.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

"AWS PrivateLink enables you to securely connect your VPC to Amazon Bedrock without exposing data to the public internet. This is particularly useful for fine-tuning models with sensitive data, as it ensures that data remains within your private network."

(Source: AWS Bedrock User Guide, Security and Networking)

Detailed Explanation:

Option A: Restrict access to Amazon Bedrock by using an AWS Identity and Access Management (IAM) service role.While IAM service roles control access to Amazon Bedrock, they do not address the requirement of keeping data within the private network during data transfer. This option is insufficient.

Option B: Restrict access to Amazon Bedrock by using an AWS Identity and Access Management (IAM) resource policy.IAM resource policies define permissions for Bedrock resources but do not ensure that data stays within the private network. This option is incorrect.

Option C: Use AWS PrivateLink to connect the VPC and Amazon Bedrock.This is the correct answer. AWS PrivateLink creates a secure, private connection between the VPC and Amazon Bedrock, ensuring that sensitive data does not leave the private network during fine-tuning, as required.

Option D: Use AWS Key Management Service (AWS KMS) keys to encrypt the data.While AWS KMS can encrypt data, encryption alone does not guarantee that data remains within the private network during transfer. This option does not fully meet the requirement.

When you have a labeled dataset and need to scale a generative AI solution for more complex or diverse product categories, fine-tuning the foundation model with your dataset is the best approach for consistent, accurate tagging.

D is correct:

“Fine-tuning a foundation model with your labeled data allows the model to generalize to new categories and improve tagging accuracy for your inventory.”

(Reference: Amazon Bedrock Fine-Tuning, AWS Generative AI)

A (zero-shot) and B (prompt templates) do not leverage the labeled data or scale as accurately.

C (continued pre-training) uses unlabeled data, not labeled.

When a model is trained on a dataset containing confidential or sensitive data, the model may inadvertently learn patterns from this data, which could then be reflected in its inference responses. To ensure that a model does not generate responses based on confidential data, the most effective approach is to remove the confidential data from the training dataset and then retrain the model.

Explanation of Each Option:

Option A (Correct): "Delete the custom model. Remove the confidential data from the training dataset. Retrain the custom model."This option is correct because it directly addresses the core issue: the model has been trained on confidential data. The only way to ensure that the model does not produce inferences based on this data is to remove the confidential information from the training dataset and then retrain the model from scratch. Simply deleting the model and retraining it ensures that no confidential data is learned or retained by the model. This approach follows the best practices recommended by AWS for handling sensitive data when using machine learning services like Amazon Bedrock.

Option B: "Mask the confidential data in the inference responses by using dynamic data masking."This option is incorrect because dynamic data masking is typically used to mask or obfuscate sensitive data in a database. It does not address the core problem of the model beingtrained on confidential data. Masking data in inference responses does not prevent the model from using confidential data it learned during training.

Option C: "Encrypt the confidential data in the inference responses by using Amazon SageMaker."This option is incorrect because encrypting the inference responses does not prevent the model from generating outputs based on confidential data. Encryption only secures the data at rest or in transit but does not affect the model's underlying knowledge or training process.

Option D: "Encrypt the confidential data in the custom model by using AWS Key Management Service (AWS KMS)."This option is incorrect as well because encrypting the data within the model does not prevent the model from generating responses based on the confidential data it learned during training. AWS KMS can encrypt data, but it does not modify the learning that the model has already performed.

AWS AI Practitioner References:

Data Handling Best Practices in AWS Machine Learning: AWS advises practitioners to carefully handle training data, especially when it involves sensitive or confidential information. This includes preprocessing steps like data anonymization or removal of sensitive data before using it to train machine learning models.

Amazon Bedrock and Model Training Security: Amazon Bedrock provides foundational models and customization capabilities, but any training involving sensitive data should follow best practices, such as removing or anonymizing confidential data to prevent unintended data leakage.

Amazon Bedrock provides large language models (LLMs) that are optimized for natural language understanding and text summarization tasks, making it the best choice for creating concise summaries of user reviews. Time-series forecasting, classification, and image analysis (Rekognition) are not suitable for summarizing textual data. References: AWS Bedrock Documentation.

The scenario where a student copies content from generative AI to write essays represents the challenge of plagiarism in responsible AI use.

Plagiarism:

Occurs when someone uses content generated by AI (or any source) without proper attribution, claiming it as their own.

This is a key challenge with generative AI models, which can produce human-like text that might be misused for academic or other purposes.

Why Option C is Correct:

Represents Unauthorized Use: Copying content directly from AI without attribution is a clear case of plagiarism.

Ethical Concern: Highlights the ethical considerations around using AI-generated content responsibly.

Why Other Options are Incorrect:

A. Toxicity: Refers to harmful or offensive content generation, not content copying.

B. Hallucinations: When AI generates incorrect or nonsensical information, not plagiarism.

D. Privacy: Involves the misuse or exposure of personal information, not copying content.

Decreasing the number of tokens in the prompt reduces the cost associated with using an LLM model on Amazon Bedrock, as costs are often based on the number of tokens processed by the model.

Token Reduction Strategy:

By decreasing the number of tokens (words or characters) in each prompt, the company reduces the computational load and, therefore, the cost associated with invoking the model.

Since the model is performing well with few-shot prompting, reducing token usage without sacrificing performance can lower monthly costs.

Why Option B is Correct:

Cost Efficiency: Directly reduces the number of tokens processed, lowering costs without requiring additional adjustments.

Maintaining Performance: If the model is already performing well, a reduction in tokens should not significantly impact its performance.

Why Other Options are Incorrect:

A. Fine-tuning: Can be costly and time-consuming and is not needed if the current model is already performing well.

C. Increase the number of tokens: Would increase costs, not lower them.

D. Use Provisioned Throughput: Is unrelated to token costs and applies more to read/write capacity in databases.

Creating a prompt template that teaches the LLM to detect attack patterns is the most effective way to reduce the risk of the model being manipulated through prompt engineering.

Prompt Templates for Security:

A well-designed prompt template can guide the LLM to recognize and respond appropriately to potential manipulation attempts.

This strategy helps prevent the model from performing undesirable actions or exposing sensitive information by embedding security awareness directly into the prompts.

Why Option A is Correct:

Teaches Model Security Awareness: Equips the LLM to handle potentially harmful inputs by recognizing suspicious patterns.

Reduces Manipulation Risk: Helps mitigate risks associated with prompt engineering attacks by proactively preparing the LLM.

Why Other Options are Incorrect:

B. Increase the temperature parameter: This increases randomness in responses, potentially making the LLM more unpredictable and less secure.

C. Avoid LLMs not listed in SageMaker: Does not directly address the risk of prompt manipulation.

D. Decrease the number of input tokens: Does not mitigate risks related to prompt manipulation.

The ML model shows 90% recall on training data but only 40% recall on unseen testing data, indicating a significant performance drop. This discrepancy suggests the model has learned the training data too well, including noise and specific patterns that do not generalize to new data, which is a classic sign of overfitting.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

"Overfitting occurs when a model performs well on training data but poorly on unseen test data, as it has learned patterns specific to the training set, including noise, that do not generalize. A large gap between training and testing performance metrics, such as recall, is a common indicator of overfitting."

(Source: Amazon SageMaker Developer Guide, Model Evaluation and Overfitting)

Detailed Explanation:

Option A: The model is overfitting on the training data.This is the correct answer. The significant drop in recall from 90% (training) to 40% (testing) indicates the model is overfitting, as it performs well on training data but fails to generalize to unseen data.

Option B: The model is underfitting on the training data.Underfitting occurs when the model performs poorly on both training and testing data due to insufficient learning. With 90% recall on training data, the model is not underfitting.

Option C: The model has insufficient training data.Insufficient training data could lead to poor performance, but the high recall on trainingdata (90%) suggests the model has learned the training data well, pointing to overfitting rather than a lack of data.

Option D: The model has insufficient testing data.Insufficient testing data might lead to unreliable test metrics, but it does not explain the large performance gap between training and testing, which is more indicative of overfitting.

To securely use large language models (LLMs) on Amazon Bedrock, companies should design clear and specific prompts to avoid unintended outputs and ensure proper configuration of AWS Identity and Access Management (IAM) roles and policies with the principle of least privilege. This approach limits access to sensitive resources and minimizes the potential impact of security incidents.

Option A (Correct): "Design clear and specific prompts. Configure AWS Identity and Access Management (IAM) roles and policies by using least privilege access": This is the correct answer as it directly addresses both security practices in prompt design and access management.

Option B: "Enable AWS Audit Manager for automatic model evaluation jobs" is incorrect because Audit Manager is for compliance and auditing, not directly related to secure LLM usage.

Option C: "Enable Amazon Bedrock automatic model evaluation jobs" is incorrect because Bedrock does not provide automatic model evaluation jobs specifically for security purposes.

Option D: "Use Amazon CloudWatch Logs to make models explainable and to monitor for bias" is incorrect because CloudWatch Logs are used for monitoring and not directly for making models explainable or secure.

AWS AI Practitioner References:

Secure AI Practices on AWS: AWS recommends configuring IAM roles and using least privilege access to ensure secure usage of AI models.

To comply with multiple regulatory frameworks, the company must ensure data protection and threat detection. Data protection involves safeguarding sensitive customer information, while threat detection identifies and mitigates security threats to the application.

Option C (Correct): "Data protection": This is correct because data protection is critical for compliance with privacy and security regulations.

Option B (Correct): "Threat detection": This is correct because detecting and mitigating threats is essential to maintaining the security posture required for regulatory compliance.

Option A: "Auto scaling inference endpoints" is incorrect because auto-scaling does not directly relate to regulatory compliance.

Option D: "Cost optimization" is incorrect because it is focused on managing expenses, not compliance.

Option E: "Loosely coupled microservices" is incorrect because this architectural approach does not directly address compliance requirements.

AWS AI Practitioner References:

AWS Compliance Capabilities: AWS offers services and tools, such as data protection and threat detection, to help companies meet regulatory requirements for security and privacy.

Generative Pre-trained Transformers (GPT) are suitable for building an AI-based application that can generate SQL queries from natural language input provided by employees.

GPT for Natural Language Processing:

GPT models are designed for understanding and generating human-like text based on natural language input.

They can be fine-tuned to interpret specific tasks, such as converting natural language queries into SQL queries.

Why Option A is Correct:

Natural Language Understanding: GPT is highly effective for tasks that require understanding of human language and generating structured outputs like SQL.

User-Friendly: Requires minimal technology experience from employees, as they provide simple text input.

Why Other Options are Incorrect:

B. Residual neural network: Typically used in computer vision tasks, not for natural language-to-SQL conversion.

C. Support vector machine: Used for classification tasks, not for generating structured queries from text.

D. WaveNet: A deep generative model for audio data, unrelated to text-to-SQL tasks.

BLEU (Bilingual Evaluation Understudy) is a metric used to evaluate the accuracy of machine-generated translations by comparing them against reference translations. It is commonly used for translation tasks to measure how close the generated output is to professional human translations.

Option A (Correct): "Bilingual Evaluation Understudy (BLEU)": This is the correct answer because BLEU is specifically designed to evaluate the quality of translations, making it suitable for the company's use case.

Option B: "Root mean squared error (RMSE)" is incorrect because RMSE is used for regression tasks to measure prediction errors, not translation quality.

Option C: "Recall-Oriented Understudy for Gisting Evaluation (ROUGE)" is incorrect as it is used to evaluate text summarization, not translation.

Option D: "F1 score" is incorrect because it is typically used for classification tasks, not for evaluating translation accuracy.

AWS AI Practitioner References:

Model Evaluation Metrics on AWS: AWS supports various metrics like BLEU for specific use cases, such as evaluating machine translation models.

AI governance frameworks aim to build trust and deploy human-centered AI technologies by establishing guidelines and policies for data usage, transparency, responsible AI practices, and compliance with regulations. This ensures ethical and accountable AI development and deployment.

Exact Extract from AWS AI Documents:

From the AWS Documentation on Responsible AI:

"AI governance frameworks establish trust in AI technologies by developing policies and guidelines for data management, transparency, responsible AI practices, and compliance with regulatory requirements, ensuring human-centered and ethical AI deployment."

(Source: AWS Documentation, Responsible AI Governance)

Detailed Explanation:

Option A: Expanding initiatives across business units to create long-term business valueWhile expanding initiatives can drive value, it is not a core characteristic of AI governance frameworks focused on trust and human-centered AI.

Option B: Ensuring alignment with business standards, revenue goals, and stakeholder expectationsAlignment with business goals is important but not specific to AI governance frameworks for building trust and ethical AI deployment.

Option C: Overcoming challenges to drive business transformation and growthOvercoming challenges is a general business goal, not a defining characteristic of AI governance frameworks.

Option D: Developing policies and guidelines for data, transparency, responsible AI, and complianceThis is the correct answer. This option directly describes the core components of AI governance frameworks that ensure trust and ethical AI deployment.

Fine-tuning involves training a pre-trained AI model on a labeled dataset specific to a particular task or domain, adapting it to industry terminology and requirements. This process adjusts the model’s parameters to better fit the target use case, such as understanding specialized vocabulary or meeting domain-specific needs.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

"Fine-tuning allows you to adapt a pre-trained foundation model to your specific use case by training it on a labeled dataset. This technique is commonly used to customize models forindustry-specific terminology, improving their accuracy for specialized tasks."

(Source: AWS Bedrock User Guide, Model Customization)

Detailed Explanation:

Option A: Data augmentationData augmentation involves generating synthetic data to expand a training dataset, typically for tasks like image or text generation. It does not specifically adapt models to industry terminology or requirements.

Option B: Fine-tuningThis is the correct answer. Fine-tuning trains a pre-trained model on a labeled dataset tailored to the target domain, enabling it to learn industry-specific terminology and requirements, as described in the question.

Option C: Model quantizationModel quantization reduces the precision of a model’s weights to optimize it for deployment (e.g., on edge devices). It does not involve training on labeled datasets or adapting to industry terminology.

Option D: Continuous pre-trainingContinuous pre-training extends the initial training of a model on a large, general dataset. While it can improve general performance, it is not specifically tailored to industry requirements using labeled datasets, unlike fine-tuning.