We currently have over 30,000 tests in our system.  It's getting harder to 
manage them.  In particular, it's getting harder to find out which TODO tests 
are unexpectedly passing.  It would be handy have to some option to force TODO 
tests to die or bailout if they pass (note that this behavior MUST be optional).

Now one might think that it would be easy to track down missing TODOs, but with 
15,000 tests aggregated via Test::Aggregate, I find the following unhelpful:


 TODO passed:   2390, 2413

If those were in individual tests, it would be a piece of cake to track them 
down, aggregated tests get lumped together.  Lacking proper subtest support 
(which might not mitigate the problem) or structured diagnostics (which could 
allow me to attach a lot more information to TODO tests) at the end of the day, 
I need an easier way of tracking this.

Suggestions?

Cheers,
Ovid
--
Buy the book         - http://www.oreilly.com/catalog/perlhks/
Tech blog            - http://use.perl.org/~Ovid/journal/
Twitter              - http://twitter.com/OvidPerl
Official Perl 6 Wiki - http://www.perlfoundation.org/perl6

Reply via email to