Manage Test Sets

Print this topicEmail this topic

Test sets allow you to group and schedule regression tests in an iteration or release. For example, a test set could include smoke, configuration, system, and so on. Once grouped, you can run test cases together.

Managing test sets includes the following:

Create a test set

A test set is a container for test cases which can be run in an iteration or release.

Create a test set from any of these pages:

  • Iteration Task Status
  • Iteration Test Status
  • Iteration Defect Status

  1. On the Create Test Set editor, complete the fields as necessary.
  2. Click Save & Close.

    The test set displays at the bottom of the summary page.

Add test cases to a test set

Adding test cases to test sets is only available on the Iteration Test Case Status page.

  1. From the Iteration Test Case Status page, click the Add Test Cases icon on the test set row.
  2. On Choose Regression Tests, select the test cases you want to add to the test set.
  3. If test cases are organized in test folders, use the Test Folder filter to view only those test cases then add them to your test set.

  4. Click Save & Close.

Expand the test set to view all the associated test cases.

Note: On the chooser page, if you select items and then click to the next page , your selections on the first page are not saved. Filter your search criteria and increase your display to limit your results to one page.

Edit a test set

You can edit from any of these pages:

  • Iteration Task Status
  • Iteration Test Status
  • Iteration Defect Status

With the editor

  1. From Release or Iteration Status summary page, click the edit icon Inline Edit of the test set you want to edit.
  2. On the Edit Test Set editor, complete your edits as necessary.
  3. Click Save & Close.

Inline

  1. From Release or Iteration Status summary page, double-click the test set row you want to edit.
  2. With the row in edit mode, complete your edits.
  3. Click Inline Save to save or click Cancel to cancel.

Re-order test cases in a test set

When editing a test case from the Iteration Status or Release Status page, the editor will show the global test case rank, not the test case's rank within the test set. The test cases will show in rank order on the test run page for the test set. The rank value is only displayed in the editor if you are using a manually ranked workspace.

Drag-and-drop ranking

Rank test cases within a test set by using drag-and-drop. To change the order of a test case, select the test case and drag it to the correct placement.

Test set drag and drop

Manual ranking

If your workspace is set to use manual ranking, you can change the order or priority of a test case by double-clicking on the case and entering a rank value.

Test set manual rank

Copy a test set

Save time and effort by copying an existing test set then editing the copy to make necessary adjustments. You can copy a test set from the Iteration or Release Status page. Copy is available from any of these pages:

  • Task Status
  • Test Status
  • Defect Status

  1. From the Release or Iteration Status summary page, click the Copy icon of the test set you want to copy.
  2. On the Edit Test Set editor, complete your edits.
  3. Click Save & Close.

Run a test set

When you create and populate test sets, you can easily execute test cases contained within a test set from a single location. Running a test set is only available on the Iteration Test Case Status page.

  1. From the Iteration Test Case Status page, click the Run icon of the test set you want to execute test cases.

    The Test Run page displays all test cases and their related test steps contained within the test set. Use this page to run each test case within the test set.

  2. From the Test Run page, you can create and edit test case results and defects.

    The test set status roll-up bar displays at the top of the page. The status bar reflects the state (pass, fail, inconclusive, other) of the test cases in the test run. Hover over the test set status display to view the percentage and number of test cases in each state.

Delete a test set

You can delete an entire test set. Delete is available from any of these pages:

  • Iteration Task Status
  • Iteration Test Status
  • Iteration Defect Status

  1. On the summary page, click the Delete icon of the test set you want to delete.
  2. Click OK on the confirmation message.

Deleting a test set does not delete the test cases or test case results. Only the association between the test set and test cases is removed.

Remove a test case from a test set

You can remove test cases from a test set. Removing a test case from a test set is only available on the Iteration Test Case Status page.

  1. On the Iteration Test Case Status page, expand the test set to display the associated test cases.
  2. Click the remove test case icon of the test case you want to remove.
  3. Click OK on the confirmation message.

Test set fields

The following fields are available to help you describe or add detail to a test set. Set these field values when creating or editing a test set.

Required fields are highlighted in red on the full screen editor.

Field Description
General
ID A system-generated ID that is assigned to your test set; it is unique and will never change. The ID consists of a prefix and a numerical value. The prefix can be customized by your system administrator for each work item type in your workspace.
Name Enter a textual name of the test set.
Owner Specify the owner of the test set.
Schedule
Schedule State Specify the progress that has been made toward the completion of the test set. There are six states in the drop-down list. The first and last states can be customized by your subscription administrator to help you better manage your process. The default states that the test set can move through are:
  • Defined: The development team can write tasks and provide estimates. This is the defaulted state value for a new test set and cannot be customized.
  • In Progress: The test set has been committed to an iteration and work has begun. This state can not be customized.
  • Completed: All related tasks have been completed. When the state for all of the tasks are set to Completed, the test set is automatically rolled up to reflect the Completed state regardless of its initial setting. This state can not be customized.
  • Accepted: The acceptance criteria has been met. This state can not be customized.
Blocked Check the box if work on the test set cannot continue until all issues preventing further progress are removed. If a task has been marked blocked, this field will automatically be checked in the editor. You can also manually block the test set by editing it and activating the check box. The blocked state displays in the Iteration Status or Release Status page in red to indicate blocked, but will still carry the associated state letter so the initial state of the test set is not lost.
Release/Iteration Select a release or iteration from the drop-down which lists all available releases or iterations contained in the project.
Plan Estimate Record how much effort is estimated to complete the test set. This field is a real number and can accept three digits followed by a decimal and two more digits. The units are defined by your administrator.

Feedback

Please send us your feedback regarding our help site. For feedback regarding the Rally product, click here to open a support case or click here to submit a new feature request
English
By submitting this form, you accept the Mollom privacy policy.
© 2014 Rally Software Development Corp | Legal