AWS Certified AI Practitioner AIF-C01 Passing Score

BLEU (Bilingual Evaluation Understudy) is a metric used to evaluate the accuracy of machine-generated translations by comparing them against reference translations. It is commonly used for translation tasks to measure how close the generated output is to professional human translations.

Option A (Correct): " Bilingual Evaluation Understudy (BLEU) " : This is the correct answer because BLEU is specifically designed to evaluate the quality of translations, making it suitable for the company ' s use case.

Option B: " Root mean squared error (RMSE) " is incorrect because RMSE is used for regression tasks to measure prediction errors, not translation quality.

Option C: " Recall-Oriented Understudy for Gisting Evaluation (ROUGE) " is incorrect as it is used to evaluate text summarization, not translation.

Option D: " F1 score " is incorrect because it is typically used for classification tasks, not for evaluating translation accuracy.

AWS AI Practitioner References:

Model Evaluation Metrics on AWS: AWS supports various metrics like BLEU for specific use cases, such as evaluating machine translation models.

The F1 score is a metric used to evaluate the performance of a classification model by considering both precision and recall. Precision measures the accuracy of positive predictions (i.e., the proportion of true positive predictions among all positive predictions made by the model), while recall measures the model ' s ability to identify all relevant positive instances (i.e., the proportion of true positive predictions among all actual positive instances). The F1 score is the harmonic mean of precision and recall, providing a single metric that balances both concerns. This is particularly useful when dealing with imbalanced datasets or when the cost of false positives and false negatives is significant. Options B, C, and D pertain to other aspects of model performance but are not related to the F1 score.

Amazon SageMaker Model Cards provide a standardized way to document important details about an AI model, such as its purpose, performance, intended usage, and known limitations. This enables transparency and compliance while fostering better communication between stakeholders. It does not store models physically or optimize computational requirements. References: AWS SageMaker Model Cards Documentation.

Network isolation is a key security feature for SageMaker. It ensures that training and inference jobs run in a VPC and are not accessible from the internet. Per the official SageMaker documentation:

“When you enable network isolation, your model can’t make any outbound network calls. This is useful for security and regulatory compliance when working with sensitive data.”