We’re trying set up Testrail to Jira integration and we’re having some difficulty with determining the workflow of test cases to stories in Jira.
In our Scrum model, we have a PSI (potentially shippable increment) with 4 sprints: PSI2 Sprint1, PSI2 Sprint2, etc.
We have stories in our backlog in Jira that are put into the sprint and we link the test cases to the stories using the reference field in Testrail and we’ve already created our Testrail project and our test run.
- Jira Story: HIP-101
- Test Cases: HIP-TCS-100.101, HIP-TCS-100.102, HIP-TCS.100.103
Now, with the integration, we execute HIP-TCS-100.101 and 102 in Sprint1.
We create PSI2 Sprint 2 and regression test 100.101 and 100.102 and execute 100.103. We get:
- 100.101 - fail (which passed in Sprint 1)
- 100.102 - pass (which passed in Sprint 1)
- 100.103 - pass
PSI2 finishes and we move to PSI3. Essentially, a brand new project and all the HIP-TCS-100.10x test cases are now regression tests for PSI3.
We create a test run in Testrail, copy in our HIP test cases, create a story for regression testing and reference the Jira story.
The problem: the Jira story now has the results from PSI2. I would have thought we would have had blank results and ready to start over. Additionally, the reference for the original test case to Jira story has changed to the new Jira story so results for the old story could now be wrong.
What are we missing? Do we have to create new test cases each time? The ID of the new test run and the copied test cases is different than the original runs and the test results are ‘Untested’ however, for the linked Jira story, they are showing the original test case ID and the results.
We must be missing something basic here?
Thanks in advance for the help.