Manage Test Sets

Test sets allow you to group and schedule regression tests in an iteration or release. For example, a test set could include smoke, configuration, system, and so on. Once grouped, you can run test cases together.

Managing test sets includes the following:

Create a test set

A test set is a container for test cases which can be run in an iteration or release.

  1. On the Create Test Set editor, complete the fields as necessary.
  2. Click Save & Close.

    The test set displays at the bottom of the summary page.

Add test cases to a test set

Add test cases to test sets inline on the Iteration Status page.

  1. From the Iteration Status page, click the row action icon bin gear menu on the test set and select Add Child Inline from the drop-down menu.
    add child inline
  2. The Child Type automatically defaults to Test Case. Enter the Name, Type and Method fields.
    add child inline step 2
  3. Click Create+New to add the test case and create another test case, Create to add the test case to the test set, Add Details to enter additional test case details, or +Add Existing to add a test case that has already been created.
  4. You can expand the test set to view all associated test cases by clicking the arrow next to the test set.

Edit a test set

With the editor

  1. From the Release summary page, click the edit icon Inline Edit of the test set you want to edit. From the Iteration Status page, click the FormattedID of the test set you want to edit, or click the row action icon bin gear menu next to the test set and select Edit from the drop-down menu.
  2. On the Edit Test Set editor, complete your edits as necessary.
  3. Click Save & Close.

Inline

  1. From the Release summary page, double-click the test set row you want to edit. From the Iteration Status page, you can edit inline with a single click.
  2. With the row in edit mode, complete your edits.
  3. Inline edits are saved automatically when you click away from a field or tab to the next field.

Re-order test cases in a test set

When editing a test case from the Iteration Status or Release Status page, the editor will show the global test case rank, not the test case's rank within the test set. The test cases will show in rank order on the test run page for the test set. The rank value is only displayed in the editor if you are using a manually ranked workspace.

Drag-and-drop ranking

Rank test cases within a test set by using drag-and-drop. To change the order of a test case, select the test case and drag it to the correct placement.

dragdrop

Manual ranking

If your workspace is set to use manual ranking, you can change the order or priority of a test case by double-clicking on the case and entering a rank value.

manual rank

Copy a test set

Save time and effort by copying an existing test set then editing the copy to make necessary adjustments. You can copy a test set from the Iteration or Release Status page.


  1. From the Release Status summary page, click the Copy icon of the test set you want to copy. From the Iteration Status page, click the row action icon bin gear menu next to the test set you want to copy, then select Copy.
  2. On the Edit Test Set editor, complete your edits.
  3. Click Save & Close.

Run a test set

When you create and populate test sets, you can easily execute test cases contained within a test set from a single location. Running a test set is only available on the Iteration Status page.

  1. From the Iteration Status page, click the row action icon bin gear menu next to the test set and select Run Test Set.
  2. The Test Run page displays all test cases and their related test steps contained within the test set. Use this page to run each test case within the test set.

  3. From the Test Run page, you can create and edit test case results and defects.

    The test set status roll-up bar displays at the top of the page. The status bar reflects the state (pass, fail, inconclusive, other) of the test cases in the test run. Hover over the test set status display to view the percentage and number of test cases in each state.

Delete a test set

You can delete an entire test set.


  1. On the Iteration Status page, click the row action icon bin gear menu next to the test set you want to delete and select Delete from the drop-down menu.
  2. Click OK on the confirmation message.

Deleting a test set does not delete the test cases or test case results. Only the association between the test set and test cases is removed.

Remove a test case from a test set

You can remove test cases from a test set. Removing a test case from a test set is only available on the Iteration Status page.

  1. On the Iteration Status page, expand the test set to display the associated test cases.
  2. Click the row action icon bin gear menu next to the test case you want to delete and select Remove from the drop-down menu.
  3. Click OK on the confirmation message.

Test set fields

The following fields are available to help you describe or add detail to a test set. Set these field values when creating or editing a test set.

Required fields are highlighted in red on the full screen editor.

Field Description
General
ID A system-generated ID that is assigned to your test set; it is unique and will never change. The ID consists of a prefix and a numerical value. The prefix can be customized by your system administrator for each work item type in your workspace.
Name Enter a textual name of the test set.
Owner Specify the owner of the test set.
Schedule
Schedule State Specify the progress that has been made toward the completion of the test set. There are six states in the drop-down list. The first and last states can be customized by your subscription administrator to help you better manage your process. The default states that the test set can move through are:
  • Defined: The development team can write tasks and provide estimates. This is the defaulted state value for a new test set and cannot be customized.
  • In Progress: The test set has been committed to an iteration and work has begun. This state can not be customized.
  • Completed: All related tasks have been completed. When the state for all of the tasks are set to Completed, the test set is automatically rolled up to reflect the Completed state regardless of its initial setting. This state can not be customized.
  • Accepted: The acceptance criteria has been met. This state can not be customized.
Ready This checkbox can be used to indicate that a test set is ready to be worked. This field is primarily used by teams using the Kanban Board or other board based method of pulling work.
Blocked Check the box if work on the test set cannot continue until all issues preventing further progress are removed. If a task has been marked blocked, this field will automatically be checked in the editor. You can also manually block the test set by editing it and activating the checkbox. The blocked state displays in the Iteration Status or Release Status page in red to indicate blocked, but will still carry the associated state letter so the initial state of the test set is not lost.
Blocked Reason Indicates the reason why a test set is blocked.
Release/Iteration Select a release or iteration from the drop-down which lists all available releases or iterations contained in the project.
Plan Estimate Record how much effort is estimated to complete the test set. This field is a real number and can accept three digits followed by a decimal and two more digits. The units are defined by your administrator.

Feedback

Need more help? The Rally Community is your one-stop shop for self-service and support. To submit feedback or cases to Rally Support, find answers, and collaborate with others, please join us at rallycommunity.rallydev.com.
© 2015 Rally Software Development Corp | Legal