Add options to runtests.py to discover test pairings that fail
|Reported by:||Russell Keith-Magee||Owned by:||nobody|
|Cc:||Triage Stage:||Design decision needed|
|Has patch:||no||Needs documentation:||no|
|Needs tests:||no||Patch needs improvement:||no|
Although unittests and doctests are supposed to be self contained, sometimes they have leaky side effects. For example, if a test case activates a language setting, but doesn't deactivate it, subsequent tests will be run in the wrong locale, which can cause tests to fail that pass when run in isolation.
Test failures like this are painful to try and track down, so ./runtests.py should have some tools to help narrow down the cause.