Join 34,000+ subscribers and receive articles from our
blog about software quality, testing, QA and security.

Test Plan being treated as a Test Run


#1

I am evaluating TestRail as a potential replacement for our current test management tool and have been using a trial copy. Trying to understand test plan functionality. I created a Test Run with two tests in it and then created a test plan and added this test run to it. TestRail seems to just count this Test Plan as another test run and shows that I have four test executions. What am I missing here?


#2

Do you mean you added the test suite to the test plan? It looks like you’ve created a test run and then the test plan has created a separate test run based on the test suite you’ve added, so four test cases in total. :slight_smile:


#3

I have not created any test suites. Just two test cases, created a test run with those two and then defined a test plan with the test run


#4

Hi there,

Thank you for the post. When creating a test run, it is really meant to be stand alone. When using test plans, you would create the test plan first and then create test runs under that test plan. I would recommend taking a look at our documentation that goes over plans and runs. You can find this here:

http://docs.gurock.com/testrail-userguide/userguide-gettingstarted#test_runs_and_tests


#5

Hi

Thanks for your quick reply. I did read all the documentation, and it is not specified that you need to create a test plan first and then new test runs under that. In fact, when you first define a test plan, the screen (attached) directs you to “Please add test runs to this plan from the sidebar” and this added the existing test plan automatically. I was not given the option to create a new test run under the plan. There is also no indication on this page to add tests suites (maybe because I had not defined any test suites yet?)

[cid:image002.jpg@01D29E31.EB3B16B0]


#6

I was re-watching the video on test plans just now, and confirmed that the screen in the video is different than what I got below. In the video, when you click on Add Test Plan, the options in the sidebar are: Add Test Suite and Rerun Test Plan. That makes sense. Adding an existing test run to a test plan does not make sense given your explanation and should not be an option on the Add Test Plan screen.

Thanks,
Ben


#7

Yes, you’re right. It should probably give an option like create test run, rather than add test run.


#8

Hi there,

Thank you for your post and information. When creating a test plan, we give you the option to ‘add’ a test run to the plan which makes sense but we can see where this may cause some confusion. We would be happy to take a look at this however.