Re: Smoking private dists? was Re: Diagnostics was Re: Smoking private dists?
Paul Johnson wrote: > But did we ever get an answer to the original question? I have a > similar requirement and the answers currently seem to be > > 1. Buildbot (which seems to be overkill in my situation) > 2. Smolder and some scripts > > Is that a fair summary? I'd add a #3 which is Buildbot + Smolder. I'm going to start working on that this weekend. I've got some enhancements and bug fixes to smolder that should make that much easier and I just need to get off my duff and do it. -- Michael Peters Plus Three, LP
Smoking private dists? was Re: Diagnostics was Re: Smoking private dists?
On Wed, Feb 13, 2008 at 07:51:24AM -0800, Matisse Enzer wrote: > And of course, in the Java world, it is "Expected/Got" (JUnit wants the > expected value as the first argument to assertions.) Which is, of course, the right way round, however you spell "Got". (Hint: it's "Received".) Haven't we had this discussion before? > ;-) Quite. But did we ever get an answer to the original question? I have a similar requirement and the answers currently seem to be 1. Buildbot (which seems to be overkill in my situation) 2. Smolder and some scripts Is that a fair summary? -- Paul Johnson - [EMAIL PROTECTED] http://www.pjcj.net
Re: Smoking private dists?
On 5 Feb 2008, at 14:44, Philippe Bruhat (BooK) wrote: That's what I did at $work. I store all the results in a database, and hope to come up with creative reports (especially historical ones) in the future. TAP::Parser was very helpful in collecting the test results. Cool! Nice to hear of someone using it :) -- Andy Armstrong, Hexten
Re: Smoking private dists?
On Tue, Feb 05, 2008 at 09:58:39AM +0100, Thomas Klausner wrote: > > Therefore, my current approach would be to hack together a few scripts > that fetch stuff from git, run the tests, collect the results, and > report them. That's what I did at $work. I store all the results in a database, and hope to come up with creative reports (especially historical ones) in the future. TAP::Parser was very helpful in collecting the test results. My smoke script is basically fetching the list of all test files, then looping over each of them with TAP::Parser, and producing various objects (stored in a db) for smoke / script / test. The biggest trouble I had was for diagnostics. I ended up considering that diagnostics output after a test result belong to the test result (as a comment to it), and that diagnostics appearing before the first test result are "global" to the whole test script. Which means that "# Looks like you failed 3 tests of 22." is always attached to the last test. -- Philippe Bruhat (BooK) You are never too old to have your seat tanned by your Grandmother. (Moral from Groo The Wanderer #41 (Epic))
Re: Smoking private dists?
On Feb 5, 2008, at 2:31 AM, "Gabor Szabo" <[EMAIL PROTECTED]> wrote: On Feb 5, 2008 11:55 AM, Andy Armstrong <[EMAIL PROTECTED]> wrote: You could look at buildbot. It can do all of the above. It's in Python if that matters :) Or Tinderbox which was the original that buildbot copied. And now buildbot will be replacing tinderbox.
Re: Smoking private dists?
On Feb 5, 2008 11:55 AM, Andy Armstrong <[EMAIL PROTECTED]> wrote: > You could look at buildbot. It can do all of the above. It's in Python > if that matters :) > Or Tinderbox which was the original that buildbot copied. (Why did they have to keep the GUI I don't know :) Gabor
Re: Smoking private dists?
On 5 Feb 2008, at 08:58, Thomas Klausner wrote: Are there any tools/frameworks available that would (in a perfect, lazy world) to the following: * fetch various projects from git (HEAD, and some defined tags) * run their test suite * run Devel::Cover (eg via Build testcover) * run some special tests (eg Pod::Coverage), which probably means to run some tests in the testsuite with some special ENV settings * report all results on a nice and colorfull website You could look at buildbot. It can do all of the above. It's in Python if that matters :) -- Andy Armstrong, Hexten
Re: Smoking private dists?
Thomas Klausner wrote: > And I presume that the various CPAN smoking tools don't fit my needs, > because they are designed to either smoke the whole of CPAN, or to send > back test results after installing a given CPAN dist. Remember that you can always bind your own local view of the CPAN with CPAN::Mini and CPAN::Mini::Inject » http://search.cpan.org/dist/CPAN-Mini-Inject/ -- Sébastien Aperghis-Tramoni Close the world, txEn eht nepO.
Smoking private dists?
Hi!
I've recently started a new job (and a small company (which btw explains
a certain CPANTS lagging on my part...)), and we want to smoke test our
code.
Are there any tools/frameworks available that would (in a perfect, lazy
world) to the following:
* fetch various projects from git (HEAD, and some defined tags)
* run their test suite
* run Devel::Cover (eg via Build testcover)
* run some special tests (eg Pod::Coverage), which probably means to run
some tests in the testsuite with some special ENV settings
* report all results on a nice and colorfull website
If there isn't, are there any frameworks to customize, or CPAN modules
to glue together?
Smolder looks interesting, but it seems to be more concerned with
presenting test results and so much with the acutal smoking (or am I
missing something)?
Then there's SmokeRunner::Multi, but I couldn't understand how it's
supposed to work from the docs (and before I burn a few hours playing
with it, I'd rather ask here...)
And I presume that the various CPAN smoking tools don't fit my needs,
because they are designed to either smoke the whole of CPAN, or to send
back test results after installing a given CPAN dist.
Therefore, my current approach would be to hack together a few scripts
that fetch stuff from git, run the tests, collect the results, and
report them.
Unless somebody shows me the one wellknown package that
does what I need and that everybody besides me knows about :-)
Thanks!
--
#!/usr/bin/perl http://domm.plix.at
for(ref bless{},just'another'perl'hacker){s-:+-$"-g&&print$_.$/}
