Helping Hand Questions for AIF-C01

Providing labeled data with both a prompt field and a completion field is the correct strategy for fine-tuning a foundation model (FM) on Amazon Bedrock.

Fine-Tuning Strategy:

To fine-tune a model, labeled data that pairs input prompts with the correct outputs (completions) is necessary.

This allows the model to learn the desired behavior or response style based on the provided examples.

Why Option A is Correct:

Proper Training Format: The prompt-completion pairs provide the necessary format for training the model to produce accurate outputs.

Customization: Ensures that the model is fine-tuned to the specific requirements of the company’s data and desired outputs.

Why Other Options are Incorrect:

B. Prepare a .txt file in .csv format: This does not align with the specific need for labeled data with prompts and completions.

C. Purchase Provisioned Throughput: Relates to read/write capacity in databases, not to model fine-tuning.

D. Train on journals and textbooks: Lacks the specific format and labeling required for fine-tuning.

Data augmentation for imbalanced classes is the correct technique to address bias in input data affecting image generation.

Data Augmentation for Imbalanced Classes:

Involves generating new data samples by modifying existing ones, such as flipping, rotating, or cropping images, to balance the representation of different classes.

Helps mitigate bias by ensuring that the training data is more representative of diverse characteristics and scenarios.

Why Option A is Correct:

Balances Data Distribution: Addresses class imbalance by augmenting underrepresented classes, which reduces bias in the model.

Improves Model Fairness: Ensures that the model is exposed to a more diverse set of training examples, promoting fairness in image generation.

Why Other Options are Incorrect:

B. Model monitoring for class distribution: Helps identify bias but does not actively correct it.

C. Retrieval Augmented Generation (RAG): Involves combining retrieval and generation but is unrelated to mitigating bias in image generation.

D. Watermark detection for images: Detects watermarks in images, not a technique for addressing bias.

Amazon Bedrock provides an option to enable invocation logging to capture and store the input and output data of the models used. This is essential for monitoring and auditing purposes, particularly when handling customer data.

Option B (Correct): "Enable invocation logging in Amazon Bedrock": This is the correct answer as it directly enables the logging of all model invocations, ensuring transparency and traceability.

Option A: "Configure AWS CloudTrail" is incorrect because CloudTrail logs API calls but does not provide specific logging for model inputs and outputs.

Option C: "Configure AWS Audit Manager" is incorrect as Audit Manager is used for compliance reporting, not specific invocation logging for AI models.

Option D: "Configure model invocation logging in Amazon EventBridge" is incorrect as EventBridge is for event-driven architectures, not specifically designed for logging AI model inputs and outputs.

AWS AI Practitioner References:

Amazon Bedrock Logging Capabilities: AWS emphasizes using built-in logging features in Bedrock to maintain data integrity and transparency in model operations.

To securely use large language models (LLMs) on Amazon Bedrock, companies should design clear and specific prompts to avoid unintended outputs and ensure proper configuration of AWS Identity and Access Management (IAM) roles and policies with the principle of least privilege. This approach limits access to sensitive resources and minimizes the potential impact of security incidents.

Option A (Correct): "Design clear and specific prompts. Configure AWS Identity and Access Management (IAM) roles and policies by using least privilege access": This is the correct answer as it directly addresses both security practices in prompt design and access management.

Option B: "Enable AWS Audit Manager for automatic model evaluation jobs" is incorrect because Audit Manager is for compliance and auditing, not directly related to secure LLM usage.

Option C: "Enable Amazon Bedrock automatic model evaluation jobs" is incorrect because Bedrock does not provide automatic model evaluation jobs specifically for security purposes.

Option D: "Use Amazon CloudWatch Logs to make models explainable and to monitor for bias" is incorrect because CloudWatch Logs are used for monitoring and not directly for making models explainable or secure.

AWS AI Practitioner References:

Secure AI Practices on AWS: AWS recommends configuring IAM roles and using least privilege access to ensure secure usage of AI models.