Join 34,000+ subscribers and receive articles from our blog about software quality, testing, QA and security.

How to compare results of various Test Runs of same test suite?



Our team has a cycle of weekly production deployment which makes the regression verification a very important part of continuous deployment.

My Requirement : All our executed test suites are saved under 'Test Run and Results. When the same test suite is executed after few days, we need to ensure there is no new failure. One approach is to open two web browsers and open the current test run and compare with the one which was executed earlier in order to find out the test case results and manually verify the difference. This becomes a tedious task when there are multiple test suites to be verified.

Is there a better way to compare the test results of previous few runs? This will be helpful for the QAEs and SDETs to quickly sign off the current run ensuring no new failure is introduced with the latest code change.