Join 34,000+ subscribers and receive articles from our blog about software quality, testing, QA and security.
 

[Feature Request] Add option to push updated and new test cases to active plans or runs


#1

Greetings!

I am sure others have experienced frustration with how updates to test suites are not reflected in active test runs that split test cases manually, even when a selection is for an entire section or sub-section.

The general idea for how to build around this limitation seems to require taking where you would normally split a suite into a section (or even just splitting based on where assignment workload) and instead splitting it into its own suite where the “select all” option can be used and updates with each change.

That presents two issues: the main issue I’m raising and the inverse where you might want to freeze suites in active runs so that new test cases aren’t suddenly inserted into a testers To Do list in the middle of a run. The primary use case that comes to mind for me would be when I’m adding/updating cases in advance of new features actually being implemented.

The solution that I imagined is to automatically detect if changes are being made to a suite* that is also within an active run or plan, and present a popup modal with few options to the user:

  • Push changes to all active runs
  • Self-explanatory. This would only apply the push to runs that trigger the suite/section/sub-section level selections
  • Push changes to the selected active runs
  • This option could potentially also be used to push the new/updated cases into a run that previously did not include any of the “original” sections. Useful in a situation like doing a specific re-run of “retest” status results but there are also new additional changes that should’ve been tested at the same time but were missed
  • Save changes without pushing to active runs
  • This would be identical to making updates to a suite that is not involved in any active runs in any way (current behavior, assuming no active runs)
  • “Cancel”
  • To go back and make more edits before attempting to save/push again
  • “Discard changes”
  • Reverts suite back to before any updates or changes were made. This may be too destructive to include, but I’m trying to not miss anything

This would only apply the logic to suite/section/sub-section level detection, so if you had an active run that was only testing a manual selection of individual cases without ever selecting a full section, etc. those would not trigger the options.

Does this feature request make sense? I think it handles most cases for

*either when attempting to navigate away, or introducing “save changes” and “discard” buttons at the top and bottom once the first changes are made, or both.


#2

Hi Daniel,

Thanks for your post! The feature request makes sense and we’re happy to review this for a future update. Currently, as long as you have the ‘Include all test cases’ option selected for the test run/plan, any test case added to the suite would automatically also be included in the active test runs/plans. You can workaround this by using the ‘Select specific test cases’ option and then clicking the ‘Select All’ option in the ‘Select Cases’ dialog. This would add all the test cases at the time of the test run creation, and any new test cases that are added to the suite after that point would need to be added manually to the test run. Some of the other options you recommended still wouldn’t be possible with this method, however it can help alleviate some of the issues when adding many test cases to a suite. Any changes to the test cases that are included would still be applied to any live test runs as well. We’re happy to review your overall feature request as well.

Hope this helps!

Regards,
Marco


#3

Hello Marco,

I have been searching the forums for this exact feature and wanted to see if I can vote for this feature.

The way we do our test planning in TestRail is:
I first create a Test Plan and then add multiple Test Runs to the plan.
For each test run, I select multiple configurations and different test cases for each run.
I never have a case where I would want to Select ALL test cases.

The issue we often run into is for new features. We add new test cases as we test and it wastes a lot of time for us to first create a run with say a few test cases and then go back and forth adding all our new tests to the test runs as they are written. Would love a way to add new test cases directly into a test run or have a feature as mentioned in this original post.

I am totally open to doing things in a different way if it makes it possible for us to add tests to a plan faster.

Thank you for your time!
Denise