Re: [p5pod] [ANNOUNCE] Pod::StdParser, Pod::Tests proof of concept
Marek Rouchal DAT CAD HW Tel 25849 sent the following bits through the ether: > We probably could argue for centuries about this Yes, indeed ;-). I'm going to compare this to XML::Parser, where the main (default) style is proper event-based parsing. Alternative styles (such as XML::DOM) exist which build upon the simpler parser, for those who need the power. IMO the POD parsers could and should go this way. HTH, Leon -- Leon Brocard.http://www.astray.com/ yapc::Europe - September 22-24 London - http://yapc.org/Europe/ ... Error 404: ENOPOD
Re: Rambling on Benchmarking [was Re: Risk of unacceptably slow perl6 performance]
Michael G Schwern sent the following bits through the ether: > The things we bench need not be simple low level bits. AFAIK benchmarking in general hasn't really been done in Perl, apart from the recent slew of 'sort' benchmarks. I think that proper benchmarks give us a great deal of information about scalability, and more importantly cache and buffer interactions which go against our intuition. Pretty graphs rule! ;-) Leon -- Leon Brocard.http://www.astray.com/ yapc::Europe - September 22-24 London - http://yapc.org/Europe/ ... Error 404: ENOPRETTYGRAPHS
Re: Interactive tests?
Kirrily 'Skud' Robert sent the following bits through the ether: > Using Test::More, how can I intersperse stuff for user interaction? For > instance: I had to test the OpenFrame module on lots and lots of platforms which involved installing a great number of Perl modules. I didn't appreciate modules being interactive when they didn't absolutely have to be. I don't necessarily want to connect to databases just install the actual module. Thankyou for listening ;-) Leon -- Leon Brocard.http://www.astray.com/ Nanoware...http://www.nanoware.org/ I want to be an assembler when I grow up?
Re: Web Site Testing
Ilya Martynov sent the following bits through the ether: > 4) WWW::Automate and WWW::Chat And recently petdance has updated WWW::Automate to WWW::Mechanize. Personally I use a home-brewed solution which is very compact test-wise, but I'm open to moving to something where other people can understand the tests... ;-) Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ All wiyht. Rho sritched mg kegtops awound?
Re: WWW::Mechanize 0.37 released
Andy Lester sent the following bits through the ether: > Or are you saying that people will want to use it strictly behind a > restrictive firewall where google.com isn't accessible? For example, we use it at work for testing our web applications. The slightly overly-secure server we use for developing can not see the Internet, but it can test on localhost or other internal servers. (There's a local CPAN mirror and other such things to make it bearable). Leon ps thanks for the module! ;-) -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Clap on! (clap, clap) Clap off! ([EMAIL PROTECTED]&$NO CARRIER
Testers & PASS
Hello, I've been looking at the testers database (well, downloading the list via nntp.perl.org really) for Module::CPANTS recently. In the current version of Module::CPANTS I report the count of PASSes and FAILs for each distribution. This works well. I've been looking at gathering the number of tests that a distribution has. However, it looks like FAILs have this information, eg: Failed 1/10 test scripts, 90.00% okay. 3/43 subtests failed, 93.02% okay. ... but PASSes don't. So for the next version of Module::CPANTS I'll be able to report the number of tests only for those distributions which have a plan and have failed at least one test. Firstly, is there a reason for this inconsistency? Secondly, who do I need to convince to add the "make test" results for PASSes too? ;-) Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... I am not a photon
Re: Testers & PASS
Leon Brocard sent the following bits through the ether: > Secondly, who do I need to convince to add the "make test" results for > PASSes too? ;-) So, does anyone actually have an opinion on this? Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... "Beulah, peel me a grape."
Re: Testers & PASS
Abe Timmerman sent the following bits through the ether: > Did I misunderstand? My point is that the CPAN Testers reports for fails have the output of make test, eg: http://nntp.x.perl.org/group/perl.cpan.testers/96865 ... but passes don't: http://nntp.x.perl.org/group/perl.cpan.testers/96886 This is inconsistent and we're throwing information away. I say put it in all the time. Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... ASCII and ye shall receive
Re: Testers & PASS
alian sent the following bits through the ether: > But there is a serious problem with CPAN test database. There is like > 100 000 reports in the CPAN db. This is not a big problem. 100_000 reports is a very small database and I still don't know why the testers.cpan.org site is so slow. I got annoyed about it and wrote my own as it wasn't open source. It is much much faster. http://search.cpan.org/author/LBROCARD/CPAN-WWW-Testers/ http://testers.astray.com/ Comments welcome, Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Change is inevitable, except from a vending machine
Re: Testers & PASS
alian sent the following bits through the ether:
> About order of v-string:
> It would be good in details results that 1.18 would be first before 1.2.
You're looking at http://testers.astray.com/show/MIME-Lite-HTML.html.
I'm actually sorting using version.pm at the moment, as it seemed to
be the most comprehensive. Sort::Versions didn't really do the right
thing for module versions. See what version.pm says:
kanga% perl -e 'use version; print version->new("1.9")'
1.900
kanga% perl -e 'use version; print version->new("1.10")'
1.100
perlmodstyle says:
The most common CPAN version numbering scheme looks like this:
1.00, 1.10, 1.11, 1.20, 1.30, 1.31, 1.32
00modlist.long.html says:
To be fully compatible with the Exporter and MakeMaker modules you
should store your module's version number in a non-my package variable
called $VERSION. This should be a valid floating point number with at
least two digits after the decimal (ie hundredths, e.g, $VERSION =
"0.01"). See Exporter.pm for details.
Thus, I think that my website is correct in sorting the version
numbers. 1.2 should be later than 1.18. I think your versioning system
is wrong ;-)
http://dellah.org/testers/MIME-Lite-HTML gets the version sorting
wrong but "right". How do you sort, Iain?
http://testers.cpan.org/search?request=dist&dist=MIME-Lite-HTML
keeps on timing out, so I don't know what it does. Graham?
Now maybe I should ignore the version numbers and instead sort using
the dates that the module was uploaded to CPAN, but that's external
information, bah.
Leon
--
Leon Brocard.http://www.astray.com/
scribot.http://www.scribot.com/
... Blueness is a way of life
Re: Testers & PASS
Graham Barr sent the following bits through the ether: > > Now maybe I should ignore the version numbers and instead sort using > > the dates that the module was uploaded to CPAN, but that's external > > information, bah. > > That is what search does because guessing at peoples versioning was to > unpredictable. However using upload dates is also problematic for some > distributions (eg mod_perl and perl) It does? The order of the MIME-Lite-HTML page and the backpan dates don't agree: http://testers.cpan.org/search?request=dist&dist=MIME-Lite-HTML kanga% ls -tr BACKPAN/authors/id/A/AL/ALIAN/MIME-Lite-HTML-*.tar.gz BACKPAN/authors/id/A/AL/ALIAN/MIME-Lite-HTML-0.1.tar.gz BACKPAN/authors/id/A/AL/ALIAN/MIME-Lite-HTML-0.3.tar.gz BACKPAN/authors/id/A/AL/ALIAN/MIME-Lite-HTML-0.4.tar.gz [...] BACKPAN/authors/id/A/AL/ALIAN/MIME-Lite-HTML-1.16.tar.gz BACKPAN/authors/id/A/AL/ALIAN/MIME-Lite-HTML-1.17.tar.gz BACKPAN/authors/id/A/AL/ALIAN/MIME-Lite-HTML-1.18.tar.gz Thanks for answering all these questions, Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Change is inevitable, except from a vending machine
Re: Testers & PASS
Tels sent the following bits through the ether: > Hm, it generates fast, but wrong results :-) Ooops, the summaries are wrong. Fixed. Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... For Sale: Slightly used message. Enquire within
Re: Testers & PASS
Graham Barr sent the following bits through the ether: > > http://testers.cpan.org/search?request=dist&dist=MIME-Lite-HTML > > keeps on timing out, so I don't know what it does. Graham? > > I just added a new index to the database. It should be much quicker now. Wow, that's like a 100x speedup. Can you speed up http://testers.cpan.org/search?request=by-dist&letter=M too? ;-) Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... "1001 Things To Do With Whipped Cream", LGLB (1995)
Re: Scrutinizing CPAN distributions (was Testing for valid path names...)
Andrew Savige sent the following bits through the ether: > I'm an enthusiastic admirer of Schwern's CPANTS kwalitee vision and > aware of Module::CPANTS but unsure about the current state of play. > Tips on other stuff I should look at are welcome. [From a Module::CPANTS perspective...] Module::CPANTS is a small subset of Schwern's original kwalitee vision, in so far as it is a bunch of metrics that I can easily extract without eval-ing the whole of CPAN. The actual module is a big hash of hashes, but I think shipping an SQLite database might be a better idea in future. I highly recommend trying out Thomas' web form, which has some good example queries at the bottom: http://domm.zsi.at/cpants/search > 1) Archive nit-picker. Archive::Any's is_impolite/is_naughty is a >start. Also test for: "good cross-platform" file names (my >original question); "good" Changes, README, t/ directory etc.. I like the is_impolite / is_naughty ideas, and will roll them into the next version. If you have a simple metric for a good cross-platform filename, that'd be good. I'm not sure about how you mean a "good" Changes. For a start, people call them different things (Changes, CHANGES, ChangeLog etc.), and format them differently. What is a good README? To be honest, now that we have web interfaces to docs on search.cpan.org I don't think that READMEs are terribly important. The current version of CPAN reports the number of tests for a distribution (but only if it's had a FAIL, sigh). > 2) POD tester. Use Test::Pod/Pod::Coverage, say, on all POD in a >distribution. I don't want to eval the whole of CPAN. Maybe we could get the CPAN Testers to do this? > 3) Static Perl code analyser. I suppose PerlTidy, Module::Info, >B::Lint may be helpful. Any others? To achieve what? > 4) Test suite analyser. How good is the test suite? Use perhaps >Devel::Cover to determine how much of the code is covered by >the distribution's test suite. Sure, convince CPAN Testers to do this ;-) > 5) Signature checker. Sure. > 6) Prerequisite checker. What would you check, exactly? > 7) Version checker. What would you check, exactly? > Anything else? Does such a module/script already exist? Module::CPANTS::Generator contains a number of metric finding functions. It's great that somebody else thinks that metrics is a good idea. I thought it was just Schwern, Thomas and I! ;-) Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Hi-ho, hi-ho, it's hand grenades I throw...
Re: Testers & PASS
alian sent the following bits through the ether: > I just see that testers.cpan.org now use your interface. Cl. Faaast. Indeed! > But some problems ... > We use in CPANPLUS old interface, old url to fetch reports about a dist. > So there is no longuer report from CPANPLUS testers since yesterday. Which interface is this? We can probably fake it with a mod_rewrite rule if you tell me the details. > Ok, I patch this for use the great yaml I found one the new site, but > there is missing info into the yaml file: > When reports are failed, we just know: "this fail". > I need another field like 'detailed_results' who is an url to detailed > report (today http://nntp.x.perl.org/group/perl.cpan.testers/xxx). If you replace the xxx with the ID then you have the correct URL. The next release of CPAN testers will have a report_url key containing this. HTH, Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Don't sweat it - it's only ones and zeros
Re: Testers & PASS
alian sent the following bits through the ether: > The patch is already done. But if there is others apps that use that: > http://testers.cpan.org/search?request=dist&dist=$name > who is now: > http://testers.cpan.org/show/$name Done that: http://testers.cpan.org/search?request=dist&dist=Acme-Colour Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... C program run. C program crash. C programmer quit
Re: Phalanx / CPANTS / Kwalitee
Thomas Klausner sent the following bits through the ether: > OTOH, it might be an interesting idea to allow CPANTS to compile code (and > thus use stuff like Devel::Cover) if not testing the whole of CPAN, but > "linting" one distribution. Yes. We've been thinking about this. It either needs stealing buildd from Debian, having a box we don't mind destroying every so often, or having a VMware virtual machine we can undo easily. What we need is more free time ;-) Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Ethernet: A device for catching the Ether Bunny
Smoking CPAN
Hello. I've had more time recently, so I smoke tested the Phalanx 100. Files are attached. Also see http://search.cpan.org/dist/Haul/ So, what it does is: foreach module to do start out with a fresh perl 5.8.3 with nothing else installed try and install the module & its deps ... report OK or TIMEOUT (infinite loops or things) hcaerof It's very simple, and some wheels may have been reinvented in the process, but I have a computer I'm prepared to dedicate to smoking cpan. This can check dependencies are correct, and whether modules work with all versions of Perl. Oh, and Module::Depends rocks. Comments? Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Useless invention no. 404: Caffeine-free Diet Coke install.pl Description: Perl program Installing Compress::Zlib... ... done Installing DBD::mysql... ... done Installing DBI... ... done Installing HTML::Parser... ... done Installing LWP... ... done Installing Mail::Mailer... ... done Installing MIME::Base64... ... already installed Installing URI... ... done Installing Date::Calc... ... done Installing Digest::HMAC... ... done Installing Digest::SHA1... ... done Installing GD... ... done Installing HTML::Tagset... ... done Installing IO::Wrap... ... done Installing Mail::SpamAssassin... ... done Installing MIME::Lite... ... done Installing MIME::Parser... ... done Installing Net::DNS... ... done Installing Net::Telnet... ... done Installing Net::SSLeay... ... done Installing Parse::RecDescent... ... done Installing Spreadsheet::WriteExcel... ... done Installing XML::Parser... ... done Installing XML::Simple... ... done Installing Apache::Session... ... done Installing AppConfig... ... done Installing Archive::Tar... ... done Installing Archive::Zip... ... done Installing Bio::Seq... ... done Installing Bit::Vector... ... done Installing CGI::Application... ... done Installing CGI::Kwiki... ... done Installing CGI::Session... ... done Installing Class::DBI... ... done Installing Class::Date... ... done Installing Config::IniFiles... ... done Installing Convert::ASN1... ... done Installing Crypt::Blowfish... ... done Installing Crypt::CBC... ... done Installing Crypt::DES... ... done Installing Crypt::SSLeay... ... done Installing Data::ShowTable... ... done Installing Date::Manip... ... done Installing DBD::CSV... ... done Installing DBIx::SearchBuilder... ... done Installing Error... ... done Installing Expect... ... done Installing GD::Graph... ... done Installing GD::Text... ... done Installing HTML::Template... ... done Installing HTML::Tree... ... done Installing Image::Info... ... done Installing Image::Size... ... done Installing Inline... ... done Installing IO::Tty... ... done Installing XML::LibXML... ... done Installing Mail::Sendmail... ... done Installing MD5... ... done Installing Module::Build... ... done Installing MP3::Info... ... done Installing Net::Daemon... ... done Installing Net::SNMP... ... done Installing Params::Validate... ... done Installing PDF::API2... ... done Installing PDL... ... timed out (after 10 mins)!
Re: Distributed testing idea
Michael G Schwern sent the following bits through the ether: > So what I need is some way to set up a network of test servers such that > I can say "test this module for me" and my testing client would ship it > to as many test servers as it can find and get the results back all in > just a few minutes. The scheme that you propose sounds awfully like a messaging system. Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... But I don't *like* ponies!
testers.cpan.org ideas
Hello. Having got a Perl release out of the way, I'm now back to working on http://testers.cpan.org/ Does anyone have any features they'd like to see on the website? I'm looking at extracting more information (Perl version, platform) and having pages (and thus RSS) per author. Cheers, Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... I love it when a plan comes together!
Re: testers.cpan.org ideas
Adrian Howard sent the following bits through the ether: > RSS feeds would be *very* nice :-) Easy request to fulfill - it already does has an RSS feed per distribution. The bottom of http://testers.cpan.org/show/Test-Exception.html points out: http://testers.cpan.org/show/Test-Exception.rss So now I want an RSS feed per author, so I don't have to subscribe to 30 RSS feeds ;-) Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... $$$ not found -- (A)bort (R)efinance (B)ankrupt
Re: Redoing the Phalanx 100
Andy Lester sent the following bits through the ether: > I'll be redoing the Phalanx 100 this week. I'm hoping to get FTP logs > from pair.com and from cpan.org. If anyone else has FTP logs they can > submit to me, I'd love to have 'em. Please make the list available in a computer-readable format. A module on CPAN, perhaps. Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... That must be wonderful! I don't understand it at all
Re: Redoing the Phalanx 100
Steve Peters sent the following bits through the ether: > I've got Bundle::Phalanx100 out there right now. Once the list is > updated, I can get the module updated. And a link to this module, then ;-) -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Drive C: Error, (A)bort (R)etry (I)gnore (K)ick (S)cream
Re: Fwd: CPAN Upload: D/DO/DOMM/Module-CPANTS-Generator-0.22.tar.gz
Thomas Klausner sent the following bits through the ether: > On issue I'd like to ask is: We (Gabor Szabo and I) are thinking of renaming > the distribution from "Module::CPANTS" to "CPANTS". Do you think that this > is a good idea? I see no advantage and quite a bit of pain in renaming. However, it is your module ;-) Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... But my little voice TOLD me to do it!
Module::Packaged vs Phalanx 100
This is what you get when you set Module::Packaged against the Phalanx 100. So right now FreeBSD packages the most of Phalanx, and it's kinda interesting to see the version numbers. http://astray.com/tmp/phalanx.html Script: http://unixbeard.net/acme-svn/Module-Packaged/phalanx.pl (pass in the source of http://qa.perl.org/phalanx/100/) There might be bugs, patches welcome, Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... A living example of Artificial Intelligence
Re: Module::Packaged vs Phalanx 100
Johan Vromans sent the following bits through the ether: > Definitely. I'm quite sure Getopt::Long is in _every_ distribution... Of course, this only notices individually-packaged CPAN dists (ignores the core). Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Acoustic - What you play pool with
Re: Module::Packaged vs Phalanx 100
Leon Brocard sent the following bits through the ether: > http://astray.com/tmp/phalanx.html This now mentions core modules and notices Mandrake contrib (Module-Packaged 0.79 just hit CPAN), so Mandrake jumps from 28 -> 87. Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... I'm sure it's in the manual somewhere...
Test::Expect
Oh, I forgot to mention to perl-qa that I wrote Test::Expect: http://search.cpan.org/dist/Test-Expect/ It does "Automated driving and testing of terminal-based programs". Simple example here: http://search.cpan.org/src/LBROCARD/Devel-ebug-0.38/t/ebug.t It's a simple wrapper, but I like it. Leon -- Leon Brocard.http://www.astray.com/ scribot.http://www.scribot.com/ ... Look out! Behind you!
Re: testers.cpan.org out of sync with search.cpan.org?
On 1/27/06, Tyler MacDonald <[EMAIL PROTECTED]> wrote: > Usually this clears up in about a day, but in some cases it's been 3 or 4 > days now and search.cpan.org is telling me that tests have run, but > testers.cpan.org doesn't seem to know anything about them. Sorry, I'll prod testers.cpan.org again. Give it a while to sync up. Leon
Re: testers.cpan.org out of sync with search.cpan.org?
On 1/30/06, Tyler MacDonald <[EMAIL PROTECTED]> wrote: > Awesome, thanks! Is the code that drives testers.cpan.org open > source? I'd really like to learn more about it. Of course! (include subtle dig at non-opensource CPAN websites here) http://search.cpan.org/dist/CPAN-WWW-Testers-Generator/ http://search.cpan.org/dist/CPAN-WWW-Testers/ Leon
Re: Using Perl in QA departments
On 6/17/06, Gabor Szabo <[EMAIL PROTECTED]> wrote: http://www.szabgab.com/perl_in_test_automation.html This is really neat. You might want to add a link to Test::Expect too, which makes it almost to easy to test terminal-based programs. Thanks again! Leon
Re: Expect on Windows
On 6/28/06, Gabor Szabo <[EMAIL PROTECTED]> wrote: As Test::Expect was just mentioned here, I would like to know why Expect and thus Test::Expect does NOT work on Windows? Well, Test::Expect is a wrapper. Test::Expect works on Windows if and only if Expect works on Windows. It has this comment, which may or may not be useful: http://search.cpan.org/~rgiersig/Expect-1.17/Expect.pod#Can_I_use_this_module_with_ActivePerl_on_Windows%3F ... but I bet it's because the author has no access to Windows. I'm sure he'll accept patches! ;-) Leon
Re: CPANDB - was: Module::Dependency 1.84
On 7/14/06, Tels <[EMAIL PROTECTED]> wrote: afte seeing the recent discussion about CPANDB and CPAN::Index, I don't think I want to work on that project anymore for two reasons: Hey Tels, Please ignore the other people in the thread. Instead spend a little bit of time to do something simple that works. My preferred development methodology is to underpromise and overdeliver. Mailing lists generally do not help in this regard. To the other people in this thread: please ignore this mail ;-) Leon
Re: TAP ain't "Test All Perl"
On 8/14/06, Ovid <[EMAIL PROTECTED]> wrote: If anyone likes this idea, I've been accepted to attend Google's Automated Testing Conference in London I shall also be there and shall also speak to people about TAP. I think about 3 other London.pm-ers will also be there. Thing is, I only use TAP with Perl. I'll try and play with it in other places before the conference ;-) Otherwise, sounds like a good idea. Getting the major players involved would be the key point. Maybe they are doing things we should be doing too... Leon
Re: Counting files, lines, packages, subs in Perl
On 9/4/06, Matisse Enzer <[EMAIL PROTECTED]> wrote: I've started working on a module to analyze perl code and give reports like this: Neato. Kind of similar to my Perl::Metric::Basic: http://search.cpan.org/dist/Perl-Metric-Basic/ Regards, Leon
Re: Perl::Metrics::Simple 0.30
On 12/10/06, Matisse Enzer <[EMAIL PROTECTED]> wrote: Now in a CPAN near you: Perl::Metrics::Simple 0.30 Ah, the old Simple versus Basic argument: http://search.cpan.org/dist/Perl-Metric-Basic/ Leon, who has already renamed it once to please Adam.
