Hi, I’m playing around with a test installation of TestRail and I have a question about test results.
I set up a simple test case with 4 steps. It’s part of a test suite, and in turn part of a test run.
I assigned it to a user with role ‘tester’ (permissions left at default setting the test installation came with).
As the tester, I went to my todo list, clicked on the run, then the test case, then ADD TEST RESULT.
So far so good.
I can click on the ‘F’ icon by the Test Results, which automatically sets the dropdown for each individual test step to FAILED. Still good.
At the top of the ADD TEST RESULT overlay, I have a dropdown where I can set the status (passed/blocked/retest/failed). By default this seems to be set to PASSED.
- If I choose the F icon to set all test results at once to FAILED, that dropdown at the top of the box doesn’t change. It still says PASSED.
- If I manually set one test step to F, then the status at the top of the box changes to FAILED, as expected.
So say I set all steps to F, then overlook that the overall status is still PASSED, even though each step failed. I click ADD TEST RESULT.
Now I have a test result that says
- The test status has been set to ‘passed’.
- 0 passed, 4 failed and 0 untested steps.
That makes no sense, so I try to edit it. I can click on edit, and change the status of the individual test steps, but I can’t edit the overall status.
Is this a bug? Is this meant to be this way – and if so is there a way around it?