Use test case execution records and test suite execution
records to specify the execution environments for each test case and
test suite and to track the status of each test run. A wizard is provided
for generating test case execution records and test suite execution
records automatically.
Before you begin
Before you can generate test case execution records or test
suite execution records, you must have created at least one test case
or one test suite.
Procedure
To generate test case execution records or test suite
execution records automatically:
- Do one of the following:
- From an open test case, select Test Case Execution
Records.
- From an open test suite, select Test Suite Execution
Records.
- Click the Generate New Test Case Execution Records or Generate
New Test Suite Execution Records icon (
). This starts the wizard to generate test case execution
records or test suite execution records. After the wizard starts,
you can cancel by clicking the X in the upper right corner.
- Select a Test Plan and Test
Iteration from the lists.
Test iterations
are the various phases or iterations in your test plan. Test iterations
are only available when you select a particular test plan.
- Optional: Select an Owner for
the test case or test suite execution records.
Note: You
can choose to have an owner automatically assigned when the execution
record is executed by setting the
Automatically assign
executer as owner to Test Case and Test Suite execution record if
owner is not assigned execution preference. For information
on how to set the preference, see
Test execution preferences.
- Optional: Select a Channel for
the test case or test suite execution records. Choosing a channel
guides test environment selection by restricting options for test
environment reuse and suggesting attributes for test environment generation.
- If you have previously defined your test environments,
click Reuse Existing Test Environments, select
the test environments to reuse, and click Next.
- If you have not previously defined your test environments,
click Generate Test Environments.
- Select one or several environment attributes from each
column.
The number of test case execution records or
test suite execution records created depends on the number of attributes
selected, the level of coverage that you choose, and the Advanced
Properties (Inclusions, Exclusions, and Weightings) that you select.
Note: Advanced
Properties may not be visible until you select at least two attributes
from one of the columns of attributes.
- In the Generation Properties section, select the level
of coverage that you want.
Use this setting and the
Advanced Properties setting to fine-tune the test case execution records
or test suite execution records that will be generated.
- Choose Minimal to ensure that each selected
attribute is covered at least once, with no attempt to cover specific
combinations of attributes. For example, if you select one attribute
from three columns, three test case execution records or test suite
execution records are created, ensuring that each selected attribute
is covered at least once.
- Choose Medium - pair-wise interaction to
ensure that each combination of paired attributes is covered at least
once.
- Choose Large - three-way interaction to
ensure that each three-way combination of attributes is covered at
least once.
- Choose All - all permutations to ensure
that all combinations of attributes are covered at least once.
Note: The coverage options only become available when you start
selecting attributes. The greater the selected coverage, the more
attributes and columns that you must select.
- Click Advanced Properties to
display a window with three tabs: Inclusions, Exclusions, and Weightings.
- Click Next.
The
wizard creates a preview of the Generated Test Environments from which
the test case execution records or test suite execution records will
be generated.
- Select the test environments that you plan to commit to
and click Next.
The wizard creates
a preview of the generated test case execution records or test suite
execution records.
Tip: You can create unique names for
each test case execution record or test suite execution record by
selecting the To make the new test environment names unique,
add a prefix to the generated name option.
- Select the test case execution records or test suite execution
records that you want to keep.
- Optionally, decide how you want to group the generated
test case execution records or test suite execution records by selecting
one of the choices in the Group By list.
- Click Finish.
The
wizard generates the test case execution records or test suite execution
records according to the criteria you have selected.
- Click Save to add the test case
execution records or test suite execution records to the test case
or test suite.
Results
After the test case execution records or test suite execution
records are generated, you can select one and run it.
Test Case Execution Records - Examples
The
following table shows four different sets of settings for generating
test case execution records. In row 2, the Coverage is
changed from Minimal to Medium. In row 3, three more modifications
are made, and in row 4, only one more modification is made. Each change
results in an increase in the number of test case execution records
that are created.
Table 1. Examples of test case execution
records.| Example |
Browsers selected |
CPUs selected |
OS selected |
Coverage |
Inclusions & Exclusions |
Weighting |
Result (TERs created) |
| 1 |
Firefox, IE |
Intel i386, PowerPC® |
Windows XP,
SUSE |
Minimal |
None |
Priority to Firefox, Intel, & Windows XP |
2 |
| 2 |
|
|
|
Medium |
|
|
4 |
| 3 |
Firefox, IE, Safari |
|
Windows XP,
SUSE, Mac OS X |
|
|
Safari and Mac OS X priority 3. |
9 |
| 4 |
|
|
|
Large |
|
|
18 |