Join 34,000+ subscribers and receive articles from our blog about software quality, testing, QA and security.

Measuring test flakiness


A test is flaky if its status has changed from green to read frequently across last X builds.

Is there a way to understand with TestRail which tests are the most flaky?

For Jenkins there’s Test Results Analyzer plugin. Even if it does not provide single numbers (flakiness metric), it eases scanning test status across recent builds.