Join 34,000+ subscribers and receive articles from our blog about software quality, testing, QA and security.
 

When using variations of "pass" for statuses, the overall pass completion in a test run does not update


#1

We work primarily on mobile testing and test both iOS and Android platforms. We customized our result statuses to have ‘iOS Passed’ and ‘Android Passed’ but if we use those to pass tests then the % pass rate of the test run does not increase.

For example:

Though 183 test cases were passed using “iOS passed” it reads as only a 1% pass rate.

Is there anyway to set customized statuses (such as “iOS passed” or “Android passed”) to add to the overall % completion of a run?


#2

Hi Andrew,

Thanks for your posting! Currently, the built-in Passed status is the only status that adds to the overall pass rate. For testing against configurations or different environments, we would recommend a slightly different approach and TestRail has a built-in feature for this with test plans and configurations:

http://www.gurock.com/testrail/videos/test-plans-configurations/

Instead of managing configurations on the test or result level, we recommend creating separate runs and TestRail’s configuration feature automatically creates runs for your configurations:

This makes it very easy to compare test results across different configurations/platforms, e.g. with the Comparison report from the Reports tab:

Cheers,
Tobias