Re: [PATCH t/TEST t/harness vms/test.com] Set PERL_CORE environment var

2001-10-18 Thread Michael G Schwern

On Wed, Oct 17, 2001 at 03:05:08PM +0300, Jarkko Hietaniemi wrote:
> Thanks, applied.  If this $ENV{PERL_CORE} scheme works we can ask the
> other dual life citizens to do the same.  Will make the pumpkin's life
> much, much, much easier.

The only bit that worries me is now in order to run a core test by
hand you have to do:

PERL_CORE=1 ./perl -Ilib lib/Some/Module.t

-- 

Michael G. Schwern   <[EMAIL PROTECTED]>http://www.pobox.com/~schwern/
Perl6 Quality Assurance <[EMAIL PROTECTED]>   Kwalitee Is Job One
Here's hoping you don't harbor a death wish!



Re: Preliminary test coverage analysis

2001-10-18 Thread Michael G Schwern

On Thu, Oct 18, 2001 at 12:07:26AM -0600, chromatic wrote:
> > - Of those covered, a smidge less than half have < 75% statement coverage. - "
> >"  "   , 20% have < 50% statement coverage.
>
> Is it possible to get an update on this?  Writing a new test from
> scratch is generally harder than adding to an existing test.  (It's
> probably the blank page thing that plagues authors.)

Unfortunately, no.  Devel::Coverage is fundamentally broken and
Devel::Cover is gagging on the core test suite.

I'll see what I can do about getting Devel::Cover working.


-- 

Michael G. Schwern   <[EMAIL PROTECTED]>http://www.pobox.com/~schwern/
Perl6 Quality Assurance <[EMAIL PROTECTED]>   Kwalitee Is Job One
"What's black and white and makes you duck as it goes by?"
"A nun with a spear through her head."



Re: Essential Modules Smoke Testing?

2001-10-18 Thread Michael G Schwern

On Wed, Oct 17, 2001 at 11:21:58PM -0600, chromatic wrote:
> Test::Smoke handles bleadperl nicely.  Is there a tool to download a
> set of modules (say, EssentialModules from the Wiki), to run their
> tests, to collate, and to report the results?

Said beast lives as CPAN::Test
http://magnonel.guild.net/~schwern/src/CPAN-Test-0.12.tar.gz

The critical modules are all done.
CPAN::Test
CPAN::Test::Author
CPAN::Test::Mistake
CPAN::Test::Module

CPAN::Test::Reporter is a patched up version of Skud's module used to
send reports back to cpan-testers.  The format is currently wrong.


Two important bits are missing:
1) It currently doesn't save anything.

Each test, module and set of mistakes should be dumped into some sort
of simple database so the information is hung onto across multiple
runs.  If nothing else, it will prevent the need to constantly retest
modules.

2) The scripts to do the actual testing are incomplete

bin/cpan_smoke_module.plx is the only one that "works", however it's
currently got stuff in it specific to my machine.  It also does some
cavalier rm -rf's.


> Have I just volunteered to write such a beast?

No, but you may have volunteered to finish it.  Or at least kick me to
finish it.


-- 

Michael G. Schwern   <[EMAIL PROTECTED]>http://www.pobox.com/~schwern/
Perl6 Quality Assurance <[EMAIL PROTECTED]>   Kwalitee Is Job One
viscosity dawns
creamy, juicy, filling paste
open wide fucker
-- imploded



Re: Proposed Patch (add tests for Net::Time)

2001-10-18 Thread Michael G Schwern

On Thu, Oct 18, 2001 at 01:01:23AM -0600, chromatic wrote:
> Relying on reliable networking is pretty unportable, and it's really hard to
> get useful test information that way.  I coded up some mock objects for
> IO::Socket and IO::Select that made this test much easier.

Yes, this is the right way to go!  It does rely on knowing that Net::*
use IO::Socket and fiends^Wfriends, but that's ok.

If it works out, we can generalize Net::Mock and dump it into t/lib/
where other test can get at it.


> Someone has to get this done, though, and if doing things the Max
> Power way (wrong, but faster and with more yelling) shakes out
> better ideas, I'll rush in where fools fear to tread.

Only if you sing the Max Power song while you do it.



> +use Test::More 'no_plan';

I was about to rewire t/TEST and vms/test.com to understand no_plan
tests and decided it would be too much invasive surgery to get it
right.  I still have the patch lying around and could put it in if you
need it.


-- 

Michael G. Schwern   <[EMAIL PROTECTED]>http://www.pobox.com/~schwern/
Perl6 Quality Assurance <[EMAIL PROTECTED]>   Kwalitee Is Job One
You can't control the universe with a jar of red pepper.
http://www.goats.com/archive/981004.html



Re: Proposed Patch (add tests for Net::Time)

2001-10-18 Thread chromatic

On Thursday 18 October 2001 19:43, Michael G Schwern wrote:

> Yes, this is the right way to go!  It does rely on knowing that Net::*
> use IO::Socket and fiends^Wfriends, but that's ok.

Anyone who's maintaining the test really ought to glance over Net::Time at 
least once.

> If it works out, we can generalize Net::Mock and dump it into t/lib/
> where other test can get at it.

I'll shake Net::* and see what else falls out of the tree.

> Only if you sing the Max Power song while you do it.

The monorail song seems more appropriate for QA:

"Is there a chance the track could bend?
 Not on your life my Hindu friend,
 What about us brain dead slobs?
 You'll be given cushy jobs,
  ...
 The ring came off my pudding can,
 Take my pen knife my good man!"

> > +use Test::More 'no_plan';
> I was about to rewire t/TEST and vms/test.com to understand no_plan
> tests and decided it would be too much invasive surgery to get it
> right.  I still have the patch lying around and could put it in if you
> need it.

No, that was laziness on my part.  It should have been changed to the number 
of tests actually written before creating the patch.  Think of it as a typo 
with long lag time.

-- c