ISTQB Advanced Test Analyst Certificate in Software Testing

Transcription

ISTQB Advanced Test Analyst Certificate in Software Testing
ISTQB Advanced Test
Analyst Certificate in
Software Testing
Sample Paper A - 3 Hour Examination
This is not a complete exam paper
Record your surname/last/family name and initials on the Answer
Sheet, writing in block capitals at the top and marking the relevant
letter in each column.
Attempt all 65 multiple-choice questions.
There are no trick questions.
Pass Mark is 65/100.
Your answers should be indicated inside the box representing your
chosen answer to the right of the question number.
Do NOT turn over this page until instructed by the invigilator.
Copying of this paper is expressly forbidden without the direct
approval of UKTB.
Candidate Name:
………………………………..…………………
ATA Sample Exam Paper A
Page 1 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
UK Testing Board is the trading name of UKTB Ltd, Company Registration No. 6505485
1
How does test analysis and design contribute to test process improvement? Select
one option.
A
The process of test analysis and design will result in defects being discovered in
requirements and other supporting documentation.
Test analysis and design will enable identification of test conditions for use during
the test implementation and execution process.
The test analysis and design process enables risk reviews to be undertaken.
Test process improvement is performed in phases of which test analysis and design
is but one.
K2 (1mark)
B
C
D
SCENARIO 1
The following Scenario applies for Questions 2 and 3.
New game application
Gametech is constructing a new game from reused components, open source
components, and a small number of new build components. The reused components
have been used on 1 or more earlier products and a total of 14 defects related to these
components have been reported and corrected in the last 12 months. The open source
components have not yet been tested by Gametech. The new build components were
tested by the developers during the initial build phase using an Agile approach. The
project has now reached the integration phase, for which the following exit criteria have
been set:
1. All game Scenarios must be exercised by one or more test cases (A game Scenario
consists of a table of interactions driven by the game. For each interaction the game
responds according to the valid player actions or reports an invalid action);
2. All integration paths must be exercised by one or more test cases;
3. Total defects outstanding after integration testing must not exceed 0 severity 1 defects, 2
severity 2 defects, 3 severity 3 defects, and 10 defects overall.
Defects are classified as follows:
Severity 1 – Serious functional or non-functional defect requiring urgent attention and
necessitating a halt to testing;
Severity 2 – Functional or non-functional defect requiring urgent attention but not
necessitating a halt to testing;
Severity 3 – Defects for which a work around is available to continue testing, but which
must be corrected before release of the product;
Severity 4 – Defects for which a work around is available and which do not need to be
corrected before release of the product.
ATA Sample Exam Paper A
Page 2 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
2
Referring to Scenario 1 - After all integration test cases have been exercised the
following data has been collated:
1. All game Scenarios except the exit Scenario have been exercised.
2. All identified integration paths have been exercised (though there is no coverage
data to support this assertion).
3. A total of 2 functional defects and 1 non-functional defect were found but testing
was not interrupted. An additional 8 minor discrepancies were encountered but
all of these were resolved by minor changes to the user manual.
Does this set of measures satisfy exit criterion 3? Select one option.
A
B
C
D
Yes, because there are no severity 1 defects.
No, because the number of severity 2 defects is too high and the total number of
defects is too high.
Yes, because there are only 2 functional defects and all the minor discrepancies
have work-arounds.
No, because changes to the user manual have not corrected the defects.
K3 (2 marks)
3
Referring to Scenario 1 - State transition testing has been selected to test the
sequencing of game Scenarios. What coverage measure would be appropriate for
this test? Select one option.
A
B
Chow’s 0-switch coverage to ensure all individual interactions are covered.
Chow’s 1-switch coverage to ensure that individual pairs of interactions are
covered.
Chow’s n-switch coverage, where n is 1 less than the number of interactions in
each sequence.
Chow’s n-switch coverage where n is 1 more than the number of interactions in the
longest sequence.
K2 (1 mark)
C
D
--End of Scenario 1--
ATA Sample Exam Paper A
Page 3 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
4
Why is it important for a test environment to be verified prior to test execution
commencing? Select one option.
A
B
C
To prove that the test environment will not crash during test execution.
Test environments should always match those of the production environment.
The test environment should allow defects to be captured against the system under
test when test execution is underway.
Environments require specific hardware configurations to be able to operate as test
environments.
K2 (1 mark)
D
5
Which of the following statements correctly characterises management reviews and
audits? Select one option.
A
Management reviews are conducted to determine the effectiveness of a
management system; audits are conducted solely to decide whether budgets have
been correctly apportioned.
Management reviews are carried out by or for managers or key stakeholders; audits
are led by a moderator.
Management reviews deliver detailed lists of problem areas with root causes; audits
identify compliance with regulations and do not advise corrective actions.
Management reviews check deviance from plans but do not assess project risks;
audits interview staff and check documents.
K2 (1 mark)
B
C
D
6
Which two of the following characteristics are MOST important in communicating
defect information to a development team?
a.
b.
c.
d.
e.
A
B
C
D
Clarity in describing defect symptoms.
Precision in defining what the problem is.
Accuracy in assigning responsibility for a defect.
Detail in explaining how the defect arose.
Brevity in explaining how the defect should be corrected.
a and c.
b and e.
a and d.
c and d.
K2 (1 mark)
ATA Sample Exam Paper A
Page 4 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
SCENARIO 2
The following Scenario applies for Questions 7, 8 and 9.
New photography website
An on-line photography company is launching a new website which will allow their
customers to search for cameras using the following fields and their drop-down values:
Field Name
Camera type
Brand
Megapixels
Zoom range
Price range
Hard Disk capacity
Drop-down values (select one value only)
SLR with lens, SLR body only, Compact,
Camcorder SD, Camcorder HD
Clickon, Snapex, Supafilm, Shootax
Under 6, 6 to 9.9, 10 to 14.9, 15 +
0 to 4.9, 5 to 9.9, 10+
Under £100, £100 to under £200, £200 to under
£300, £300 to under £400, £400+
8GB, 16 GB, 32GB, above 32GB
The following limitations apply:
SLR body only - Zoom range does not apply
The lowest megapixel rating for an SLR camera is 12
Camcorders - megapixels does not apply
Snapex do not manufacture either type of Camcorder
Hard Disk capacity – only applies for Camcorders
The cheapest SLR camera (with or without a lens) is £250
The cheapest Camcorder camera (with or without HD) is £200
ATA Sample Exam Paper A
Page 5 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
7
Referring to Scenario 2 – Following launch of the web-site and analysis of user
feedback, further enhancements have been applied to the search criteria as follows:
•
•
•
•
The user may now specify any combination of Camera types.
The user may now specify any combination of Brands.
The user has the option to specify a maximum price when the ‘£400+’ value is
selected.
Valid Price ranges will only be displayed after the user has selected the type(s)
of Camera.
The following test design technique based tests have been proposed, but only three can
be used due to the constraints of the testing schedule. Which one SHOULD be dropped?
A
B
C
D
Use boundary value analysis to test maximum price entries.
Use classification tree class combination testing to ensure adequate coverage of
the new drop-down values introduced.
Use pairwise to ensure adequate coverage of the new drop-down values
introduced.
Use decision table testing to ensure that valid price values are displayed for
selected Camera types.
K4 (2 marks)
8
Referring to Scenario 2 - Using classification trees as a test case design technique,
how many test cases would be needed to achieve class coverage for SLR cameras
(with lens and body only)?
A
B
C
D
2.
3.
4.
5.
K3 (2 marks)
9
Referring to Scenario 2 - Using pairwise as a test case design technique, how many
test cases would be required to test the following fields and their values?
•
•
•
A
B
C
D
Camcorder (all types),
Brands (all associated types)
Hard Disk capacity (8GB and 16GB only)
3.
6.
8.
12.
K3 (2 marks)
--End of Scenario 2--
ATA Sample Exam Paper A
Page 6 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
10
What type of defects would be expected to be found during technical security
testing? Select one option.
A
All possible defects can be expected to be discovered during all types of test
execution.
The ability to access unauthorised data and/or areas of a system under test.
A user being able to enter an invalid username and password.
A user being unable to perform an expected action within the system under test.
K2 (1 mark)
B
C
D
11
There are commercial test tools readily available, so why would it be sometimes
necessary for a company to develop their own test tool? Select one option.
A
B
It is more expensive to design your own test tool.
The application under test contains elements of commercially available
components, and there would be sufficient benefit to developing a bespoke tool for
this purpose.
It is beneficial to have a bespoke test tool as they are often developed by
individuals for their own needs and are unsuitable for use by other testers or test
teams.
The hardware on which the system under test is deployed is not commercially
available.
K2 (1 mark)
C
D
12
In a risk-based test plan, which of the following sets of activities would address all
three PRIMARY stages in the risk-based testing approach? Select one option.
A
Expert interviews, classification of risks by probability of arising, construct a test
strategy to address all the risks.
FMEA workshop, classification of risks by impact, transfer the risks to a third party
by insurance.
Brainstorm session, quantitative classification of risks by impact, put in place
preventive measures to ensure the risks cannot arise.
Use of checklists, classification of risks by probability of arising and impact, decide
to accept all the risks.
K2 (1 mark)
B
C
D
ATA Sample Exam Paper A
Page 7 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
This page is intentionally blank.
ATA Sample Exam Paper A
Page 8 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
SCENARIO 3
The following Scenario applies for questions 13 to 16 inclusive.
Mobile phone software tool
A mobile phone company, H2O, has a special business tariff for bulk text messages using
a special ‘short code’ (5 digit address for text messages). After paying a one-off set up fee
of £500 for the short code, businesses can send up to 10,000 text messages free each
month. From the 10,001st message the cost is 1.5p per message up to 50,000 messages,
then 2p up to 100,000 messages. Above 100,000 messages the cost is 2.5p per message
up to 500,000 messages, then 3p per message up to 1 million messages per month.
Above 1 million messages there is a flat fee of 5p per message.
TextMark is a small marketing company that uses H2O’s business tariff as the basis of a
business to sell marketing campaigns to other small businesses from their own
(TextMark’s) servers. TextMark charges its customers for setting up their campaigns but
its messaging tariff is simpler than H2O’s, and ‘hides’ the H2O setup fee by charging 1p
per message for the first 10,000 messages, then 2p for the next 90,000, 3p for the next
900,000 and 6p thereafter.
TextMark has created a software tool to monitor outgoing text messages, calculate the
cost of sending the texts, apply the agreed mark-up, and generate bills for their customers.
This application needs to be tested, and the Test Manager has decided to construct and
maintain a suite of test cases so that future pricing changes can be easily accommodated.
ATA Sample Exam Paper A
Page 9 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
13
Referring to Scenario 3 - TextMark has now been approached by a large marketing
company that wants to license MarkMon for a series of their own marketing
campaigns. They will want the new features when they are available, but they need
the existing version to be ready for use at the earliest possible date. TextMark have
decided to complete testing of the existing version in parallel with the new
development and aim for the earliest launch date they can achieve for the original
version. Under these circumstances, which of the following would be the MOST
effective approach to testing the original version? Select one option.
A
B
C
Use a fault attack based on the experience gained by the original develop.
Use error guessing based on publicly available defect taxonomies.
Construct a test plan as originally intended but limit testing to that which can be
completed in the limited time available.
Recruit experienced testers on contract to carry out exploratory testing based on a
charter prepared by the original developer.
K4 (2 marks)
D
14
Referring to Scenario 3 - applying Equivalence Partitioning, what are the key input
partitions for TextMark’s application?
A
0 - 10000, 10001 – 100000, 100001 – 999999, 1000000.
B
10000 – 100000, 100000 – 1000000, 1000001+.
C
0 – 10000, 10001 – 99999, 100000 – 1000000, 1000001+.
D
0 – 10000, 10001 – 100000, 100001 – 1000000, 1000001+.
K3 (2 marks)
15
Referring to Scenario 3 - Which of the following show Boundary Analysis Values
covering each input partition for the H20 Business tariff? Select one option.
A
0, 10001, 50001, 100001, 1000000, 1000001.
B
0, 10000, 100000, 1000000.
C
0, 10000, 100000, 500000, 1000000, 1000001.
D
10000, 10001, 50000, 500000, 500001, 1000001.
K3 (2 marks)
ATA Sample Exam Paper A
Page 10 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
16
Referring to Scenario 3 – The following entries appear in the system design
specification, covering business tariff registrations through the H2O web-site:
1. Payment screen – Once valid account number, sort-code and amount entered
and OK selected (thus neither Exit application nor Go Back buttons selected),
call process payment module, otherwise return to previous page.
2. Display on Text Tariff page – ‘Annual cost for a business which sends 5000 text
messages per month is only £500!’.
3. The web-site design must cater for all combinations of selected web browsers,
pc specifications, server builds and operating systems.
4. Current H2O clients will be granted appropriate access to the Text Tariff page.
The following are review checklist items:
a)
b)
c)
d)
e)
Ambiguous
Not testable
Incomplete/Insufficient
Deviates from requirements
Contradictory
Which option below correctly matches each requirement statement with the appropriate
review checklist item?
A
B
C
D
1-e, 2-d, 3-b and 4-c.
1-c, 2-d, 3-b and 4-a.
1-b, 2-a, 3-d and 4-c.
1-c, 2-b, 3-e and 4-a.
K3 (2 marks)
--End of Scenario 3--
ATA Sample Exam Paper A
Page 11 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
17
The following state table shows both valid and invalid transitions:
Input A
S2
S3
S1
S2
S3
S4
Input B
S4
S2
-
Input C
S3
S1
Input D
S3
-
Input E
S4
-
What is the MINIMUM number of tests required to achieve 100% Chow’s zero switch
coverage?
A
B
C
D
1.
3.
4.
8.
K3 (2 marks)
18
Which three of the following system requirements would necessitate the use of
efficiency, reliability and technical security testing?
a.
b.
c.
d.
e.
f.
A
B
C
D
Must have no impact to the performance of other systems sharing the same
infrastructure
Must maintain full availability during hardware failures
Each system function should only be accessed by specified user roles
The system design must cope with future projected user volumes
User access must be maintained during malicious overload attempts
Must be accessible to the visually impaired and blind
a, b and d.
a, c and e.
c, d and f.
b, d and e.
K2 (1 mark)
ATA Sample Exam Paper A
Page 12 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
19
The application under test is currently used in production, and enables the business
to display and amend client account information (i.e. not available directly to the
general public). The system is undergoing UAT, where the recent delivery is to give
new reporting capabilities, adjust the industry premium rate for the start of the next
financial year (in 3 weeks time) and correct the well-documented “Double Monday”
problem.
The severity of problems reported in the defect management system is critical, high,
medium, low and cosmetic. Four business users have been involved in the test
activity, the results of which can be summarised as follows:
•
•
•
Reporting - new reports are produced in the correct circumstances, and can be
produced to a file or to the printer as determined by the operator but for any of
the 4 report types, there are no page breaks making the reports difficult to read;
Industry Premium Rate is applied at run-date rather than the transaction
effective date;
Behaviour around the “Double Monday” problem is unchanged.
Which one of the following (A, B, C or D) BEST represents the information to be passed
back to the development team on any new or existing defect reports?
A Reporting: update the existing defect report to severity critical, detailing the
tests undertaken, and giving examples of the reports produced
Industry Premium Rate: raise a new defect giving examples of when the rate
is correct and when it is incorrect. Severity high.
“Double Monday”: close the existing defect and raise a new one, to reflect
that the problem still occurs on release 1.0.3.12
B Reporting: update the existing defect report to severity low, detailing the tests
undertaken, and giving examples of the reports produced
Industry Premium Rate: raise a new defect detailing that the rate seems to be
applied at run date rather than at the transaction effective date. Severity critical
“Double Monday”: update the existing defect report to indicate that the
software has been retested on the new (1.0.3.12) release and shows the same
problem. Update the severity to critical as the defect has not been fixed when
reported as such.
C Reporting: update the existing defect report to severity cosmetic, detailing the
tests undertaken, and giving examples of the reports produced
Industry Premium Rate: raise a new defect with severity high
“Double Monday”: update the existing problem to status ‘retest failed’
D Reporting: update the existing defect report to severity medium, detailing the
tests undertaken, and giving examples of the reports produced
Industry Premium Rate: raise a new defect with severity critical
“Double Monday”: update the existing defect report to indicate that the
software has been retested on the new (1.0.3.12) release and shows the same
problem. Manually enquire as to whether the item was included in the build.
K4 (2 marks)
ATA Sample Exam Paper A
Page 13 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH
20
Leisure Jet is a holiday company offering cheap flights to holiday destinations.
Cheap travel insurance is also offered to passengers aged 18 or over and under 85.
Children under 18 may travel only if accompanied by an adult and, in such cases a
single family insurance policy is granted which applies a 10% discount to the
premium for each family member.
Passengers travelling to take part in any winter sports are charged a 10%
surcharge on insurance premiums; the surcharge increases to 15% for passengers
over 40 and to 20% for passengers under 25.
A software package to implement the insurance system is to be tested using
Decision Table testing. Which combination of the following test cases (A to F)
would give 100% test coverage? Select three test cases.
Test Case
A
Passenger
a
b
c
Age
25
87
16
B
a
18
b
c
14
17
a
b
37
63
c
a
b
c
24
40
23
17
E
a
b
c
44
18
17
F
a
b
c
44
24
46
C
D
Travel Plans (travelling to)
Luzern for a skiing holiday
Zurich to visit family
Bern, travelling alone, for a family
visit
Paris with a group of friends for a
shopping trip
Brussels with his mother
Luzern for a skiing holiday with
his father
Lanzarote
Berlin for a stag party with a
group of friends
Zurich for a hen party
Luzern for a skiing holiday
the same skiing holiday as A
Home to the UK, travelling alone
Gran Canaria for a holiday
Luzern for a skiing holiday
Paris for a weekend break with
her 17 year old brother
Luzern for a skiing holiday
Luzern for a skiing holiday
Paris for a hen party
K3 (3marks)
--End of Exam--
ATA Sample Exam Paper A
Page 14 of 14
Version 1.0 October 2011
© UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH