You are the Test Manager for a project to develop a client-server application that allows wine vendors to
order custom-assorted packages of wines of several winemakers to sell special packages in their wine
shops.
You decide to apply a blended risk-based and reactive testing strategy. Below the exit criteria for the
system testinG.
EXCR1- Each "critical" quality risk item must be covered by at least one test condition
EXCR2- Each "critical" requirement must be covered by at least one test condition
The following are the "critical" requirements of the application:
REQ-SEL-1. The application shall allow the user to order only one package at a time
REQ-SEL-2. The application shall allow the user to select between four different packages (2-bottles, 6bottles, 12-bottles, 15-bottles)
REQ-SEL-3. The application shall allow the user to order a package containing at least 1 bottle and no
more bottles than the package size. No error messages shall be displayed if the user selects a valid
number of bottles (at least 1 bottle and no more than the package size)
REQ-SEL-4. The application shall display an error message "Invalid number of bottles" if an invalid number
of bottles is selected by the user (zero bottles or a number higher than the package size)
REQ-PAY-1. The application shall allow the user to pay with the three accepted credit cards (Visa,
MasterCard, American Express)
REQ-PAY-2. The application shall display an error message "Invalid credit card" if invalid credit card data
are given by the user
QUSTION NO: 11
The following is the unique "critical" quality risk item that has been identified:
CR-RSK-1. The GUI of the application might accept non-integer values for the input field designed to get
the number of bottles from the user Test analysis for system testing has just begun and the following test
conditions have been identifieD.
TC-SEL-2. Test the selection of the package sizes TC-SEL-4. Test wrong numbers of bottles for an order TC-CR-RSK-1. Test the accepted values from the input field designed to get the number of bottles from the
user
Assume that you have used traceability to determine the logical test cases that cover all the requirements and the single risk item identified in that scenario. Which of the following is a positive logical test that is complete and correct, and covers the REQ-SEL-4
requirement? K3 2 credits
A. Select a 6-bottles package, then try to insert 5 bottles; verify that no error messages are displayed
B. Select a 6-bottles package, then try to insert 7 bottles; verify that no error messages are displayed
C. Select a 6-bottles package, then try to insert 7 bottles; verify that the "Invalid number of bottles" message is displayed
D. Select a 6-bottles package, then try to insert 7 bottles
Assume you are the Test Manager for a new software release of an e-commerce application.
The server farm consists of six servers providing different capabilities. Each capability is provided through a set of web services.
The requirements specification document contains several SLAs (Service Level Agreements) like the following:
SLA-001: 99.5 percent of all transactions shall have a response time less than five seconds under a load of up-to 5000 concurrent users
The main objective is to assure that all the SLAs specified in the requirements specification document will be met before system release. You decide to apply a risk-based testing strategy and an early risk analysis confirms that performance is high risk. You can count on a well-written requirements specification and on a model of the system behavior under various load levels produced by the system architect.
Which of the following test activities would you expect to be the less important ones to achieve the test objectives in this scenario?
K4 3 credits
A. Perform unit performance testing for each single web service
B. Monitor the SLAs after the system has been released into the production environment
C. Perform system performance testing, consisting of several performance testing sessions, to verify if all the SLAs have been met
D. Perform static performance testing by reviewing the architectural model of the system under various load levels
Consider an information system of a Pay-Tv company based on a SOA architecture.
The integrated system currently consists of three core systems:
-
a CRM (Customer Relationship Management) system
-
a BRM (Billing and Revenue Management) system
-
a CAS (Conditional Access System) system all of them communicating with SOA Middleware.
You have been asked to manage the testing activities for the integration of two additional off-the-shelf systems from two different vendors: a SMS (Short Message Service) server and an IVR (Interactive Voice Response) system. Assume that there is a high likelihood that the two off-the-shelf systems will be low-quality and that you have a clear proof that the testing performed by the two vendors on their systems has been unsystematic and unprofessional. This obviously leads to higher quality risk for the overall integrated system.
You are the Test Manager of this project. Your main goal is to plan for testing activities to mitigate this risk.
Which of the following answers best describes the test activities (assuming it is possible to perform all of them) you should plan for?
K4 3 credits
A. You should plan for an informal and minimal acceptance test of the two off-the-shelf systems and then a single end-to-end test of the overall integrated system
B. You should directly plan for a single end-to-end test focused on end-to-end tests of the overall integrated system without an acceptance test of the two off-the-shelf systems
C. You should plan for two levels: a system integration test and an end-to-end test of the overall integrated system
D. You should plan for adequate re-testing of both the systems followed by a system integration test and an end-to-end test of the overall integrated system
The following chart plots the cumulative number of defects opened against the cumulative number of defects closed during system testing of a software product.
Which of the following statements is true? K2 1 credit
A. The chart indicates that you have plenty of problems left to find
B. The chart can be used to reveal test progress problems
C. The chart seems to indicate that the defect management process is not working well
D. The chart seems to indicate that the defect management process is working well
Which one of the following metrics to be produced needs traceability between the test cases and each item in a proper test basis?
K2 1 credit
A. Requirements coverage
B. Trends in the lag time from defect reporting to resolution
C. Mean time between failures for the system
D. Cumulative number of reported defects versus cumulative number of resolved defects
Which of the following statements describing how identified product quality risks should be mitigated and managed, is true?
K2 1 credit A. The extent of re-testing and regression testing activities should be based on the risk level
B. The identification of new risks, the re-assessment of the level of existing risks and the evaluation of the effectiveness of risk mitigation activities should only occur at the very beginning of a project
C. Risk mitigation of product quality risks can be effective only after starting test execution
D. The priority of the development and execution of tests should not be based on the risk level but only on the likelihood
You are the Test Manager of a project that adopts a V-model with four formal levels of testinG. unit, integration, system and acceptance testing.
On this project reviews have been conducted for each development phase prior to testing, which is to say that reviews of requirements, functional specification, high-level design, low- level design and code have been performed prior to testing.
Assume that no requirements defects have been reported after the release of the product.
Which TWO of the following metrics do you need in order to evaluate the requirements reviews in terms of phase containment effectiveness? K3 2 credits
A. Number of defects found during the requirements review
B. Total number of defects attributable to requirements found during unit, integration, system and acceptance testing
C. Total number of defects found during functional specification review, high-level design review, low-level design review, code review, unit testing, integration testing, system testing and acceptance testing
D. Time to conduct the requirements review
E. Total number of defects attributable to requirements, found during functional specification review, high
level design review, low-level design review, code review, unit testing, integration testing, system testing and acceptance testing
Consider the following statements describing the importance of improving the test process:
I. Test process improvement is important because being focused only on the test process it can provide recommendations to improve the test process itself, but it can't indicate or suggest improvement to areas of the development process
II. Test process improvement is important because it is much more effective than software process improvement to improve the quality of a software system
III. Test process improvement is important because several process improvement models (STEP, TPI Next, TMMi) have been developed over the years
IV. Test process improvement is important because every organization, regardless of the context, should always achieve the maximum level of maturity of testing described in the test improvement models such as TMMi
Which of the following answers is correct?
K2 1 credit
A. I. and IV. are true; II. and III. are false
B. I., II., III. and IV are false
C. I., II. and III are true; IV. is false
D. I., II. and III. are false; IV. is true
Consider the following skills assessment spreadsheet for your test team (consisting of four team members):
This spreadsheet has three sections: technical expertise, testing skills and professionalism.
The skill levels for each skill area for both the "technical expertise" and "testing skills" sections have been rated on a four-point scale:
-E (Expert): indicates that a person has expert knowledge and experience in the skill area
-B (Beginner): indicates that a person has some knowledge and experience in the skill area but he/she is not autonomous
-W (Wants to learn): indicates that a person has no knowledge or experience in the skill area but he/she wants to learn that skill
-NI (Not Interested): indicates that a person has no knowledge or experience in the skill area and he/she is not interested to learn that skill
The skill levels for each skill area of the "professionalism" section have been rated on a three point scale (H=High, M=Medium, L=Low).
You are using this skills assessment spreadsheet in order to define a training development plan for your test team. Your objective is to fill the skill gaps by having at least a team member rated as an expert for each skill identified for the "technical expertise" and "testing skills" sections, and with the ability to train the other team members.
Considering the budget constraints you can send only one person to a training course.
Based only on the given information, which of the following answers would you expect to be the best option to achieve your objective?
K4 3 credits
A. Send Robert to a performance testing training course
B. Send Alex to a performance testing training course
C. Send John to a performance testing training course
D. Send Mark to a test automation training course
Assume you are managing the system testing execution phase of a project.
The system test execution period for that project is scheduled for eighteen weeks and the release date is
scheduled at the end of system testing.
During the sixth week of system test execution, at the staff meeting, the project manager informs you that
the project deadlines are changed and the release date that is only three weeks ahead.
This new release will not allow the completion of the system tests. Suppose also that you have followed a
risk-driven test approach for this project.
Which of the following statements represents the worst way to lead your test team in the next three weeks?
K2 1 credit
A. Neglect your management activities and work side-by-side with your test team executing tests
B. Considering the executed tests, you should reduce the test coverage back on the risk analysis and adjust downward the priority of the associated risk items
C. Convince all the people of your test team that each of them is an important and needed member, and that their contribution is fundamental to the success of the team
D. Favor and encourage a proactive attitude where people ask for new tasks as soon as they finish their current tasks