--- Michael G Schwern <[EMAIL PROTECTED]> wrote:
> > TAPx-Parser $ /usr/bin/perl -Ilib bin/runtests -qm tbad/
> > tbad/060-aggregator......ok 
> > tbad/badtests............FAILED tests 1, 2, 4, 5, 7, 8, 10, 11, 13,
> 14,
> > 16, 17, 19, 20, 22, 23, 25, 26, 28, 29, 31, 32, 34, 35, 37, 38, 40,
> 41,
> > 43, 44, 46, 47, 49, 50, 52, 53, 55, 56, 58, 59, 61, 62, 64, 65, 67,
> 68,
> > 70, 71, 73, 74, 76, 77, 79, 80, 82, 83, 85, 86, 88, 89, 91, 92, 94,
> 95,
> > 97, 98, 100
> >         Failed 67/100 tests, 33.00% okay
> > tbad/ddd.................ok 
> > tbad/longtestfilename....FAILED tests 3, 10
> >         Failed 2/10 tests, 80.00% okay (less 1 skipped test: 7
> okay,
> > 70.00%)
> > <snip>
> 
> Ok, I'm blind.  I don't see the problem.

Sorry, I wasn't clear because I went ahead and trimmed the test summary
output which duplicates the above list of failed tests.

While I've managed to fix the problem, see that long list of failed
tests?  That information is printed after every test program terminates
and then it's printed again in the summary.  My -q and -Q options are
ways of suppressing the printing of extra information.

-q just suppresses the printing of test failures as they occur.  This
is useful if you just want to keep out clutter.  Also, the list of
"FAILED tests" after each test program is just duplicated in the
summary and that's one objection I have already encountered when I've
inquired about redoing the test output.

My current test output is now like this:

  t/last_minute...ok
  t/head_end......ok
  t/head_fail.....Failed 1/4 tests
  t/inc_taint.....Failed 1/1 tests
  t/no_nums.......Failed 1/5 tests
  <summary snipped again because right now it's very ugly>

-Q suppresses *any* test output except the summary, so even the above
doesn't show up.  However, I was having a problem because of how
Test::Builder defaulted to sending diagnostic information to STDERR. 
I've corrected this now by automically enabling the experimental
--merge feature which merges STDERR and STDOUT.  Note that --merge is
is off by default but -q, -Q, and --failures (only show test failures
when in verbose mode) require --merge to be enabled.

Incidentally, the -Q and -q features have the nice benefit of
tremendously speeding up some test suites.  When you need the detail,
just leave 'em off.

Counter-arguments welcome.

Cheers,
Ovid

--

Buy the book -- http://www.oreilly.com/catalog/perlhks/
Perl and CGI -- http://users.easystreet.com/ovid/cgi_course/

Reply via email to