We have a large test codebase with more than 1500 tests for a Python/Django application. Most of the tests use factory-boy for generating data for the project models.
Currently, we are using nose test runner, but open to switching to py.test.
The problem is, from time to time, when running parts of tests, combination of tests we encounter unexpected test failures that are not reproduced when running all the tests or these tests individually.
It looks like the tests are actually coupled.
The Question: Is it possible to automatically detect all the coupled tests in the project?
My current thinking is to run all the tests in different random combinations and report the failures, can nose or py.test help with that?
Aucun commentaire:
Enregistrer un commentaire