After some time of evaluation we decided for Testrail as our Testmanagment Tool. So I am quite new to testrail. I am now in the progress of setting up the first tests. As our product has a client/server architecture, we need to test the client on different platforms against the server on different platforms. That’s where I thought that configurations may come in handy, but I am not quite satisfied with the results. At the moment the configurations look like this:
- Windows Server 2008
- Windows Server 2012
- Windows XP
- Windows 7
- Windows 8
- Windows 10
- CentOS 7
That gives me the e.g. the following test runs:
x86, 64bit, Server, Windows Server 2008
x86, 32bit, Client, Windows 10
x86, 32bit, Client windows 8
You get the idea.The test cases are mostly generic, as we usually don’t test on different platforms in everyday testing (Java Software). So, when running the test cases in one of the test runs I have no information that let’s say the test cases in x86,32bit,Client,Windows need to be run against x86,64bit,Server,Windows Server 2008.
I don’t want to duplicate test cases for every combination. I also don’t want to include every possible combination in the configurations which may not the intended use of configurations.
So I need some advice, how to best organize testing combinations of our client/server software.
Thanks a lot,