Rally Quality Manager Overview
Agile development has dramatically changed the way testers work, asking you to be part of a close-knit Agile team and test as requirements and code are changing constantly. Rally offers software test engineers the tracking tools you need to provide test results in-step with the software development lifecycle but also support the work you do in a variety of automated software testing tools.
Rally’s basic testing features allow you to:
- Create test cases directly from user stories and defects
- Evolve acceptance tests simultaneously with—or ahead of—the coding efforts
- View status dashboards that automatically group test case results by user stories to assess quality and readiness
- Provide access to failing test cases for improved communication, easier defect re-creation, and lower management burdens
- Manage regression tests that need to be run multiple times throughout the life of your system
- Create custom test plan lists based on criteria you specify
- Easily filter and sort tests outside of iterations and releases on the Test Case summary page
Quality management concepts
A test case is created from a work item (user story or defect) to verify that the work is acceptable. Test cases also capture test results.
Test folders are a basic mechanism for organizing test cases that have similar functionality. Test cases can only be assigned to one test folder.
Test Sets are a collection of test cases (optionally stored in test folders.) Test sets allow you to group and schedule regression tests in iterations or releases. Test sets are only created and used on the Iteration and Release Status pages. Copy test sets from one iteration or release to another.
|Life of a Test Case
1. Create a new test case (acceptance test) in association with a user story or defect. A test case can stand alone but it is not recommended.
2. The tester concludes that the work is acceptable. If the tester decides this test case should be included in regression testing, continue to the next steps.
3. Optional: Add the test case to a test folder that contains similar test cases. Test folders help organize tests, such as UI Tests for Firefox.
4. The test case is now just one of many regression tests that are scheduled together in a test set. Test sets are associated with an iteration or release.
Related Rally pages
Test Plan page
This page provides testers with a single location to organize and manage test cases into folders. When planning your test effort use test plans to assemble test cases into a hierarchy of folders. Rank test cases in a test folder, run the tests in groups, log test results and defects, then see the summarized results.
Note that when a new test folder is created on the Test Plan page, the test folder is associated with the current scope. In the example above, a new test folder is associated with the Shopping Team. If you want to share test folders with other testers on other teams, associate your test folders at a higher node in the tree.
Iteration Test Case Status page
A test set is a container for test cases which can be run in an iteration or release. Create a test set from the Actions menu on any of these pages:
- Iteration or Release Task Status
- Iteration or Release Test Status
- Iteration or Release Defect Status
Consider the following:
- The Rally Quality Manager module is required for test sets, the Test Plan page, and the Test Case summary page.
- You can view reports and dashboards that display the status of your test coverage, including the number of test cases passing, failing, or pending.
- Use the Rally App SDK Toolkit to create custom Apps or reports that integrate Rally with data from third-party testing systems.