Special Summer Sale 70% Discount Offer - Ends in 0d 00h 00m 00s - Coupon code: save70

Free and Premium ISTQB CT-AI Dumps Questions Answers

Page: 1 / 6
Total 80 questions

Certified Tester AI Testing Exam Questions and Answers

Question 1

You are testing an autonomous vehicle which uses AI to determine proper driving actions and responses. You have evaluated the parameters and combinations to be tested and have determinedthat there are too many to test in the time allowed. It has been suggested that you use pairwise testing to limit the parameters. Given the complexity of the software under test, what is likely the outcome from using pairwise testing?

Options:

A.

The number of parameters to test can be reduced to less than a dozen.

B.

All high priority defects will be identified using this method.

C.

While the number of tests needed can be reduced, there may still be a large enough set of tests that automation will be required to execute all of them.

D.

Pairwise cannot be applied to this problem because there is AI involved and the evolving values may result in unexpected results that cannot be verified.

Buy Now
Question 2

An engine manufacturing facility wants to apply machine learning to detect faulty bolts. Which of the following would result in bias in the model?

Options:

A.

Selecting training data by purposely excluding specific faulty conditions

B.

Selecting training data by purposely including all known faulty conditions

C.

Selecting testing data from a different dataset than the training dataset

D.

Selecting testing data from a boat manufacturer's bolt longevity data

Question 3

Which ONE of the following characteristics is the least likely to cause safety related issues for an Al system?

SELECT ONE OPTION

Options:

A.

Non-determinism

B.

Robustness

C.

High complexity

D.

Self-learning

Question 4

Before deployment of an AI based system, a developer is expected to demonstrate in a test environment how decisions are made. Which of the following characteristics does decision making fall under?

Options:

A.

Explainability

B.

Autonomy

C.

Self-learning

D.

Non-determinism

Question 5

Which of the following approaches would help overcome testing challenges associated with probabilistic and non-deterministic AI-based systems?

Options:

A.

Run the test several times to ensure that the AI always returns the same correct test result.

B.

Decompose the system test into multiple data ingestion tests to determine if the AI system is getting a sufficient volume of input data.

C.

Decompose the system test into multiple data ingestion tests to determine if the AI system is getting precise and accurate input data.

D.

Run the test several times to generate a statistically valid test result to ensure that an appropriate number of answers are accurate.

Question 6

A wildlife conservation group would like to use a neural network to classify images of different animals. The algorithm is going to be used on a social media platform to automatically pick out pictures of the chosen animal of the month. This month's animal is set to be a wolf. The test teamhas already observed that the algorithm could classify a picture of a dog as being a wolf because of the similar characteristics between dogs and wolves. To handle such instances, the team is planning to train the model with additional images of wolves and dogs so that the model is able to better differentiate between the two.

What test method should you use to verify that the model has improved after the additional training?

Options:

A.

Metamorphic testing because the application domain is not clearly understood at this point.

B.

Adversarial testing to verify that no incorrect images have been used in the training.

C.

Pairwise testing using combinatorics to look at a long list of photo parameters.

D.

Back-to-back testing using the version of the model before training and the new version of the model after being trained with additional images.

Question 7

Max. Score: 2

Al-enabled medical devices are used nowadays for automating certain parts of the medical diagnostic processes. Since these are life-critical process the relevant authorities are considenng bringing about suitable certifications for these Al enabled medical devices. This certification may involve several facets of Al testing (I - V).

I.Autonomy

II.Maintainability

III.Safety

IV.Transparency

V.Side Effects

Which ONE of the following options contains the three MOST required aspects to be satisfied for the above scenario of certification of Al enabled medical devices?

SELECT ONE OPTION

Options:

A.

Aspects II, III and IV

B.

Aspects I, II, and III

C.

Aspects III, IV, and V

D.

Aspects I, IV, and V

Question 8

Which of the following is a dataset issue that can be resolved using pre-processing?

Options:

A.

Insufficient data

B.

Invalid data

C.

Wanted outliers

D.

Numbers stored as strings

Question 9

In a conference on artificial intelligence (Al), a speaker made the statement, "The current implementation of Al using models which do NOT change by themselves is NOT true Al*. Based on your understanding of Al, is this above statement CORRECT or INCORRECT and why?

SELECT ONE OPTION

Options:

A.

This statement is incorrect. Current Al is true Al and there is no reason to believe that this fact will change over time.

B.

This statement is correct. In general, what is considered Al today may change over time.

C.

This statement is incorrect. What is considered Al today will continue to be Al even as technology evolves and changes.

D.

This statement is correct. In general, today the term Al is utilized incorrectly.

Question 10

A beer company is trying to understand how much recognition its logo has in the market. It plans to do that by monitoring images on various social media platforms using a pre-trained neural network for logo detection. This particular model has been trained by looking for words, as well as matching colors on social media images. The company logo has a big word across the middle with a bold blue and magenta border.

Which associated risk is most likely to occur when using this pre-trained model?

Options:

A.

There is no risk, as the model has already been trained

B.

Insufficient function; the model was not trained to check for colors or words

C.

Improper data preparation

D.

Inherited bias: the model could have inherited unknown defects

Question 11

Which ONE of the following tests is MOST likely to describe a useful test to help detect different kinds of biases in ML pipeline?

SELECT ONE OPTION

Options:

A.

Testing the distribution shift in the training data for inappropriate bias.

B.

Test the model during model evaluation for data bias.

C.

Testing the data pipeline for any sources for algorithmic bias.

D.

Check the input test data for potential sample bias.

Question 12

Which of the following is an example of a clustering problem that can be resolved by unsupervised learning?

Options:

A.

Associating shoppers with their shopping tendencies

B.

Grouping individual fish together based on their types of fins

C.

Classifying muffin purchases based on the perceived attractiveness of their packaging

D.

Estimating the expected purchase of cat food after a particularly successful ad campaign

Question 13

Which ONE of the following statements is a CORRECT adversarial example in the context of machine learning systems that are working on image classifiers.

SELECT ONE OPTION

Options:

A.

Black box attacks based on adversarial examples create an exact duplicate model of the original.

B.

These attack examples cause a model to predict the correct class with slightly less accuracy even though they look like the original image.

C.

These attacks can't be prevented by retraining the model with these examples augmented to the training data.

D.

These examples are model specific and are not likely to cause another model trained on same task to fail.

Question 14

Which ONE of the following options is an example that BEST describes a system with Al-based autonomous functions?

SELECT ONE OPTION

Options:

A.

A system that utilizes human beings for all important decisions.

B.

A fully automated manufacturing plant that uses no software.

C.

A system that utilizes a tool like Selenium.

D.

A system that is fully able to respond to its environment.

Question 15

Which of the following is correct regarding the layers of a deep neural network?

Options:

A.

There is only an input and output layer

B.

There is at least one internal hidden layer

C.

There must be a minimum of five total layers to be considered deep

D.

The output layer is not connected with the other layers to maintain integrity

Question 16

A company is using a spam filter to attempt to identify which emails should be marked as spam. Detection rules are created by the filter that causes a message to be classified as spam. An attacker wishes to have all messages internal to the company be classified as spam. So, the attacker sends messages with obvious red flags in the body of the email and modifies the from portion of the email to make it appear that the emails have been sent by company members. The testers plan to use exploratory data analysis (EDA) to detect the attack and use this information to prevent future adversarial attacks.

How could EDA be used to detect this attack?

Options:

A.

EDA can help detect the outlier emails from the real emails.

B.

EDA can detect and remove the false emails.

C.

EDA can restrict how many inputs can be provided by unique users.

D.

EDA cannot be used to detect the attack.

Question 17

A bank wants to use an algorithm to determine which applicants should be given a loan. The bank hires a data scientist to construct a logistic regression model to predict whether the applicant will repay the loan or not. The bank has enough data on past customers to randomly split the data into a training data set and a test/validation data set. A logistic regression model is constructed on the training data set using the following independent variables:

Gender

Marital status

Number of dependents

Education

Income

Loan amount

Loan term

Credit score

The model reveals that those with higher credit scores and larger total incomes are more likely to repay their loans. The data scientist has suggested that there might be bias present in the model based on previous models created for other banks.

Given this information, what is the best test approach to check for potential bias in the model?

Options:

A.

Experienced-based testing should be used to confirm that the training data set is operationally relevant. This can include applying exploratory data analysis (EDA) to check for bias within the training data set.

B.

Back-to-back testing should be used to compare the model created using the training data set to another model created using the test data set, if the two models significantly differ, it will indicate there is bias in the original model.

C.

Acceptance testing should be used to make sure the algorithm is suitable for the customer. The team can re-work the acceptance criteria such that the algorithm is sure to correctly predict the remaining applicants that have been set aside for the validation data set ensuring no bias is present.

D.

A/B testing should be used to verify that the test data set does not detect any bias that might have been introduced by the original training data. If the two models significantly differ, it will indicate there is bias in the original model.

Question 18

"AllerEgo" is a product that uses sell-learning to predict the behavior of a pilot under combat situation for a variety of terrains and enemy aircraft formations. Post training the model was exposed to the real-

world data and the model was found to be behaving poorly. A lot of data quality tests had been performed on the data to bring it into a shape fit for training and testing.

Which ONE of the following options is least likely to describes the possible reason for the fall in the performance, especially when considering the self-learning nature of the Al system?

SELECT ONE OPTION

    The difficulty of defining criteria for improvement before the model can be accepted.

    The fast pace of change did not allow sufficient time for testing.

    The unknown nature and insufficient specification of the operating environment might have caused the poor performance.

Options:

A.

There was an algorithmic bias in the Al system.

Question 19

In a certain coffee producing region of Colombia, there have been some severe weather storms, resulting in massive losses in production. This caused a massive drop in stock price of coffee.

Which ONE of the following types of testing SHOULD be performed for a machine learning model for stock-price prediction to detect influence of such phenomenon as above on price of coffee stock.

SELECT ONE OPTION

Options:

A.

Testing for accuracy

B.

Testing for bias

C.

Testing for concept drift

D.

Testing for security

Question 20

Consider an AI system in which the complex internal structure has been generated by another software system. Why would the tester choose to do black-box testing on this particular system?

Options:

A.

Test automation can be built quickly and easily from the test cases developed during black-box testing.

B.

The tester wishes to better understand the logic of the software used to create the internal structure.

C.

The black-box testing method will allow the tester to check the transparency of the algorithm used to create the internal structure.

D.

Black-box testing eliminates the need for the tester to understand the internal structure of the AI system.

Question 21

Which ONE of the following is the BEST option to optimize the regression test selection and prevent the regression suite from growing large?

SELECT ONE OPTION

Options:

A.

Identifying suitable tests by looking at the complexity of the test cases.

B.

Using of a random subset of tests.

C.

Automating test scripts using Al-based test automation tools.

D.

Using an Al-based tool to optimize the regression test suite by analyzing past test results

Question 22

Which ONE of the following options is the MOST APPROPRIATE stage of the ML workflow to set model and algorithm hyperparameters?

SELECT ONE OPTION

Options:

A.

Evaluating the model

B.

Deploying the model

C.

Tuning the model

D.

Data testing

Question 23

Which ONE of the following describes a situation of back-to-back testing the LEAST?

SELECT ONE OPTION

Options:

A.

Comparison of the results of a current neural network model ML model implemented in platform A (for example Pytorch) with a similar neural network model ML model implemented in platform B (for example Tensorflow), for the same data.

B.

Comparison of the results of a home-grown neural network model ML model with results in a neural network model implemented in a standard implementation (for example Pytorch) for same data

C.

Comparison of the results of a neural network ML model with a current decision tree ML model for the same data.

D.

Comparison of the results of the current neural network ML model on the current data set with a slightly modified data set.

Question 24

ln the near future, technology will have evolved, and Al will be able to learn multiple tasks by itself without needing to be retrained, allowing it to operate even in new environments. The cognitive abilities of Al are similar to a child of 1-2 years.’

In the above quote, which ONE of the following options is the correct name of this type of Al?

SELECT ONE OPTION

Options:

A.

Technological singularity

B.

Narrow Al

C.

Super Al

D.

General Al

Page: 1 / 6
Total 80 questions