Hey there, I have worked for a couple companies that have gone through the implementation of automation into TestRail. In each company, there has always been different practices of doing things. I would like to ask the community & gurock what their best practice would be for the following examples:
When you automate a manual test case, what do you do with the manual case and what do you do with the automation case?
ex: Do you keep the manual test and just flag it as automated, if so do you point to the case id in automation to have a link and add any other fields to the testrail case? How do you keep it up to date if the test changes?
ex2: Do you delete the manual test and import the automated test in its place?
ex3: Do you keep both tests but flag the manual one as automated?
What do you use the reference field for?
ex: do you use it to link the jira epic/story for the test case? how do you then link to the requirements?
ex2: do you use it to link to the requirements, if so, what tool do you use?
Most automated tests are webdriver, api, etc… but do you include unit tests in testrail?
If I have a manual test that’s been automated but not under each platform, what do you do?
ex: Don’t flag it as automated but make a note in the test stating its automated for xyz platforms (or a separate test case field with automated platforms)
ex2: Flag it as automated and spin up a new test case for the non-automated platforms
ex3: Not a concern, if it works on one platform, it should be sufficient
If you add automated tests to testrail that do not have a corresponding test case, where do you put them?
ex: use a section id of the feature to place them where they should logically go
ex2: use a section id of the feature but then have an ‘automated’ folder where they go
ex3: have a flag automation folder
How do you work around being reliant on testrail ids?
ex: if you migrate from a cloud solution to onprem… all of your ids break. If each test case is linked to an id, this would be thousands of code changes needed… or if a manual tester moves sections around to reorganize the group tree… it may break automation
I know that’s a lot but I think it’s a worthwhile discussion.