On this thread, Eric asked how to run a "scientific" style test. Here's an idea based on CPAN Testers tools -- though not necessarily CPAN Testers output.
a) Configure CPAN::Reporter to use the Test::Reporter::Transport::File transport -- this will save reports into a directory b) Run CPAN::Reporter::Smoker -- this will smoke test all of CPAN in reverse order of upload c) Install alpha M::B d) Change directory for output e) Run CPAN::Reporter::Smoker again f) Compare output in the two directories. This would be better if I finally updated CPAN::Reporter::Smoker to take an arbitrary list of distributions instead of just working backwards through CPAN and if you had a list of distributions with Build.PL. -- David