Error in documentation? (test runner return code)
|Reported by:||anonymous||Owned by:||teraom|
|Cc:||Triage Stage:||Ready for checkin|
|Has patch:||yes||Needs documentation:||no|
|Needs tests:||no||Patch needs improvement:||no|
From the release docs for Django 1.2 it would look like the exit status code returned by the test runner scripts no longer represents the number of failed tests.
The exit status code of the test runners (tests/runtests.py and python manage.py test) no longer represents the number of failed tests, because a failure of 256 or more tests resulted in a wrong exit status code. The exit status code for the test runner is now 0 for success (no failing tests) and 1 for any number of test failures. If needed, the number of test failures can be found at the end of the test runner's output.
However, even in the currently existing testing documentation it is stated that the return code is the number of failed tests.
Note that the return code for the test-runner script is the total number of failed and erroneous tests. If all the tests pass, the return code is 0. This feature is useful if you're using the test-runner script in a shell script and need to test for success or failure at that level.
Provided "exit status code" and "return code" mean the same thing, this would look like an error to me.