On Mon, Dec 7, 2009 at 23:30, Martin Buchholz <marti...@google.com> wrote:
> You cannot exclude the Mother Of All Tests. > This is non-negotiable. More seriously... It's very difficult to manage creeping failures in regression tests. In theory, the process is supposed to prevent regression test failures from ever creeping in - that's the whole point. When they do (inevitably) creep in, they are supposed to be aggressively targeted. A gatekeeper demonstrates the failure to a developer, and the developer is given X time units to fix the test breakage, or face reversion of the breakage-inducing change. I would like to see more effort devoted to fixing the tests (or the code!) rather than adding infrastructure that might have the effect of hiding the test failures. BTW, I run regtests on java.util collections regularly, but only on Linux. Martin
