Brian and cpantesters,
Personally, in the beginning I had problems with "na" vs "fail".
Therefore my first draft on grades in germanic english. Please
proofread and correct:
----------------------------------------------------------------
x.) Grades
There are four different grades you can report.
pass
The built will go fine and all supplied tests passed.
If you get some non fatal warnings you should cc the
output of the command to the author as well.
fail
Some or all tests failed. If you get a fatal error during
the built process ("perl Makefile.PL", "make") you should
grade the distribution as "fail", too. The only exception
is when "na" applies. In the case of a fail its necessary
to supply the output of the failed command in your report
as well.
You should cc your report to the author.
na
You should only give a na if the distribution is not supposed
to run on your specific platform (OS). Therefore e.g Macintosh
or Windows specific modules will get a na on Linux.
You won't give a na if a Module requires MySQL but you haven't
installed it.
unknown
You judge a distribution as unknown if the distribution did not
include any tests. It may also approbriate to give a unknown if
the tests output does not show any "ok" or other information which
let you decide wether the test passed or not.
You should cc to the author noting something like "No tests defined."
or "No test defined. It would be nice if you could supply at least
some load test as supplied by h2xs".
------------------------------------------------------------------
Missing stuff:
FAIL -- The "Prerequisite not set in Makefile.PL" Problem
Should I give a fail or not if I get a missing module warning/error
during "make test", but not during "perl Makefile.PL" ?
IMHO, if we cannot decide on this issue this problem still should be
mentioned.
Brian, thanks for starting this FAQ project.
Andreas Marcel
