You are executing the first test run of a test automation suite of 200 tests. All the relevant information related to the state of the SUT and to the automated test execution is stored in a small database. During the Automated test run you observe that the first 10 test pass, while an abnormal termination occurs when executing the 11th test. This test does not complete its execution and the overall execution of the suite is aborted. An immediate analysis of the abnormal termination is expected to be time consuming and you have been asked to produce a detailed report of the execution results for the first test run, as soon as possible.
What is the MOST important FIRST step to be taken immediately after the abnormal occurred when executing the 11th test?
Consider the following example of TAS metrics.
Time to execute automated tests
Speed and efficiency of TAS components
Which of the following statements is TRUE?
You are working on a web-based application called Book Vault that allows people to upload books and order books. This application must be available on all major browsers.
You have been testing the application manually and management have asked you to consider automating some of the tests.
You have investigated a number of commercial and free tools which can automate tests at a web browser level and one tool in particular meets your requirements and you have implemented a trial version.
You have basic programming skills and the main goal is to automate a few functional tests to see if the tool is compatible with the application and can recognise the objects and controls.
Which scripting technique would be MOST suitable in this scenario in order to meet the objectives?
A regression test suite consist of 500 test cases which are all executed manually. The business case for a pilot project is based on the adoption of test automation using a commercial tool that will reduce the execution time by a factor of 90% for 100% of the tests in the regression test suite. The pilot project lasted one month ( as planned) and you are currently its results. At the end of the pilot project, 40% of the regression tests have been automated and their execution time has been reduce by 60%.
Which of the following statements is TRUE in this scenario?
Which of the following is considered a disadvantage of test automation?
You have been asked to automate a set of functional tests at system Test level via the CLI of the SUT for the first release of a software system. The automated tests will be delivered to the learn in change of maintenance testing, who will use them for part of the regression testing. They have the following requirements.
1. The automated tests must be as fast and cheap to maintain as possible
2. The cost of adding new automated tests must be as low as possible
3. The automated tests must have a high level of independence from the tool itself
Which of the following scripting techniques would be MOST suitable?
You are implementing test automation for a project that has a business critical application A test execution tool is being used to run automated regression tests. The results from the test execution tool are very important and need to be 100% accurate.
You want to merge the test automation results with the test management system that also records the manual test results so that managers can make informed decisions about the progress quickly.
Which layer of the gTAA will be used to ensure the proper reporting occurs and the interfaces to the test management system are handled?
You are reviewing the testability of your SUT.
Which of the following BEST refers to the characteristic of OBSERVABILITY?
A SUT has an existing automated test suite.
Which of the following statements relating to the introduction of new features in the SUT is TRUE?
When if the BEST time for automation to consider legal and/or standard requirements for a SUT?
Designing the System Under Test (SUT) for testability is important for a good test automation approach and can also benefit manual test execution.
Which of the following is NOT a consideration when designing for testability?
You have been asked to implement test automation for a project that is not meeting its deadlines. After further analysis you discover that the manual testers are not able to keep up with the new feature testing because the regression testing is taking 75% of their time. As a result, the new features are being released with many defects and customers are complaining about the quality.
Given this information, what metric SHOULD you be tracking to show the value of test automation for this project?
You have been asked to determine a TAS for a new release of a SUT, test should be automated wherever. The new release will consist of 5 new interfaces and an amendment to 3 existing interfaces. The new and amended interface will be deliver incrementally in 3 sprints, each lasting 2 weeks.
What would be the BEST Test Automation Solution (TAS) design in this scenario?
As a TAE you are evaluating a functional test automation tool that will be for several projects within your organization. The projects require that tool to work effectively and efficiently with SUT’s in distributed environments. The test automated tool also needs to interface with other existing test tools (test management tool and defect tracking tool.) The existing test tools subject to planned updates and their interface to the test automated tool may not work property after these updates.
Which of the following are the two LEAST important concerns related to the evaluation of the test automation in this scenario?
Does the test automation tool need to install specific libraries that could impact the SUT?
Which of the following statements BEST describe aspects of the SUT to consider when designing a TAA?
Which of the following is NOT a technical design consideration for a TAA?
A project consists of distributed teams working in a 24-hour environment, where activities happen at all hours of the day. This project adopts a CI (Continuous Integration) process when developer check-in code and consists of automated activities that include generating a build and deploying it to a test environment. Automated integration tests are run multiple times a day. The project have asked for a report containing the automation test results for every build, which must be available 24/7 to the project team.
Which of the following would be the BEST way to automatically provides this report?
Which of the following CORRECTLY describes how automation SHOULD be applied to confirmation testing?
You are implementing test automation for a project and you want to be able to generate test cases automatically using a series of test design tools which use a variety of test design techniques such as decision tables, pairwise testing and boundary value analysis.
You also want to generate test data automatically which can then be used by the tests.
Initially these tests will be run manually to verify their correctness and ultimately you want to include them in the test execution tool so that they can run unattended.
Which layer of the gTAA will be used to support the specification of the test cases and preparation of the test data?
Which of the following statements does NOT describe good practice for maintaining the TAS?
You have inherited a TAS that is working well it uses keyword-driven scripting and was well architected. The automation architect who built the system has now moved on to another company. The TAS is working across several projects and has a multiple library of keywords, categorised by project. The individual project teams maintain these keyword scripts.
Based only on the given information, what is the MOST significant risk for the TAS?
Consider a TAS that exclusively uses the APIs of a SUT. To make this work, significant changes have been required to the SUT by adding a set of dedicated test interfaces to the APIs. All the automated tests will use these test interfaces when interacting with the SUT. Assume that you are currently verifying the correctness of the automated test environment and test tool setup.
Which of the following would you expect to be the MOST specific risk associated with this scenario?
When the SUT provides insight into the behaviour of the system, providing the users the with the status of the various actions performed so that they can check that expected behaviour equals actual behaviour, what is this called?
Assume that you are the TAE responsible for the correct functioning of a TAS, deployed in a test environment that consists of a few machines running the same version of the operating system. The TAS has been working and stable since its deployment, it has been used to run an automated test suite consisting of many similar automated test. The infrastructure team is planning to update the operating system on these machines by installing a new the service pack for security reasons. Since the vendor of the operating system assurance full backward compatibility, the infrastructure team assurance that there will be no impacts on the functioning of the TAS.
What is the BEST approach to confirm the correct functioning of the TAS in this scenario?