Running the whole suite
Tue, 10/16/2007 - 09:25 — sanjaydatta
Hi Frds,
This is Sanjay here, have a query hope u guys will help me out.
It like whenever I run a whole suite containing some no. of testcases some of them fail where as when run individually they all pass. Somehow I tried everything but in vain.
Hope for a quick reply.
Thanks in advance
Sanjay Datta
Maybe wrong testcase design?
Hi Sanjay,
this sounds like a known problem of testcase design.
Check the following aspects:
- Are there any dependencies between the tests? For example tests using the same resources (files, singleton objects)
- Are there any resources that are very dynamical, for example tests using database tables that change constantly?
- Are there any resource that aren't closed or opend correctly (forgotten db-commit or file.close())?
- Are the teardowns implemented correctly so that each resource is opened and closed correctly also in the case of success as the case of fail?
- Are there any randomly created values you are using during runtime?
- Are there any forgotten testartefacts like remaining inserts in a database that have to be deleted after each test?
thanx....
Thanks for your analysis for my query but it seems we have already taken care of these situation. We actually are working on automation on JUnit. We have found out some problems for which some of our testcases fail but indiviually are fine.
-Is there any limitation on number of testcases in a testsuite
-Sometimes a testcases gets passed but dosent get commited which futher adds to more testcases to be failed.
Thanks in advance
Sanjay
thanx....
Thanks for your analysis for my query but it seems we have already taken care of these situation. We actually are working on automation on JUnit. We have found out some problems for which some of our testcases fail but indiviually are fine.
-Is there any limitation on number of testcases in a testsuite
-Sometimes a testcases gets passed but dosent get commited which futher adds to more testcases to be failed.
Thanks in advance
Sanjay