Paul Johnson wrote:
On Fri, Sep 23, 2005 at 12:06:43PM +0200, Thomas Klausner wrote:
Hi!
On Fri, Sep 23, 2005 at 12:54:42PM +1000, Adam Kennedy wrote:
Collecting any sort of coverage data is a complete bitch. Let me just
say right now that doing it across _all_ of CPAN is flat out impossible.
It's impossible.
And remember folks, only perl can parse Perl.
Well, at CODE anyway. And coverage is about code, not documents.
I completly agree.
However, the problem is only slightly harder than testing all of CPAN.
>
>
Now, if somebody sets up a system to collect coverage data thats generated
at various decentralised machines and provides a nice interface to the
results, CPANTS might be able to use coverage statistics as a metric.
I really doubt it. If you want to prove this can be done, go find us a
percentage coverage in CPAN Testers. That's your limit for generating
coverage.
And it introduces the additional problem of scoring for non-universal
coverage. At the moment we have universal coverage of all metrics for
all modules (a way of saying "yes" or "no"). PPI will let us take that
further as it has (for all intents and purposes) universal coverage as well.
However, what do you do when you only have 90% coverage? How do you
handle the math?
Adam K
