Re: Passing parameters to test scripts

2007-04-04 Thread Eric Hacker
ore useful for me. Somewhat related. I've been meaning to go back and figure out where 'prove' came from. I don't recall seeing any reference to it when I first went through the Test::Tutorial and other Test:: docs. It is very useful, but I found it by accident. Thanks -- Eric H

Re: Tests fail under load

2007-03-28 Thread Eric Hacker
eb tests take ages to run, and on a bad day they time out. Any suggestions for how to work around this? Add a check of the response time of the sandbox server before starting the functional tests and skip if it is not good enough. Regards -- Eric Hacker, CISSP aptronym (AP-troh-NIM) noun A na

Re: TAP.ng Collecting stdout/stderr and diagnostics with Test runs

2007-03-09 Thread Eric Hacker
On 3/9/07, Andy Armstrong <[EMAIL PROTECTED]> wrote: On 9 Mar 2007, at 16:15, Eric Hacker wrote: > I know. It probably isn't hard for a human to figure it out. A TAP > consumer can only really make a best guess though. It wouldn't be hard to information to the TAP to asso

Re: TAP.ng Collecting stdout/stderr and diagnostics with Test runs

2007-03-09 Thread Eric Hacker
On 3/9/07, Andy Armstrong <[EMAIL PROTECTED]> wrote: On 9 Mar 2007, at 13:37, Eric Hacker wrote: > Current TAP diagnostics appear after the the test results in the > standard TAP producers. D'you mean messages produced with diag() ? They appear in same order relative to the te

TAP.ng Collecting stdout/stderr and diagnostics with Test runs

2007-03-09 Thread Eric Hacker
uot; to "Well, I can't see how that is useful, but it's not too much trouble to allow it." That's what got me using Perl in the first place. -- Eric Hacker, CISSP aptronym (AP-troh-NIM) noun A name that is especially suited to the profession of its owner I _can_ leave

Re: You cannot predict what TAP will be used for (was Re: Should TAP capture exit codes)

2007-03-08 Thread Eric Hacker
On 3/8/07, Adam Kennedy <[EMAIL PROTECTED]> wrote: Andy Armstrong wrote: >> Otherwise when dealing with TAP streams that don't have a concept of >> an exit code or a seperate error channel, the most common example >> being web testing, we're left high and dry. > > In which case you'd just omit th

Re: You cannot predict what TAP will be used for (was Re: Should TAP capture exit codes)

2007-03-08 Thread Eric Hacker
On 3/8/07, Andy Armstrong <[EMAIL PROTECTED]> wrote: I propose that we prefix lines from STDERR with '! ' in the same way that '# ' is used for diagnostics. wstat and exit can just be wstat 256 exit 1 How about this? wstat: 256 exit: 1 YAML, YAML, do! ;)

Re: Should TAP capture exit codes

2007-03-07 Thread Eric Hacker
On 3/7/07, Andy Armstrong <[EMAIL PROTECTED]> wrote: It sounds as if you're doing monitoring rather than testing though. Although they're related the requirements are quite different. Poor explaining on my part then. Monitoring has similar needs, but us usually much more shallow. Consider a we

Re: Should TAP capture exit codes

2007-03-07 Thread Eric Hacker
On 3/7/07, Michael G Schwern <[EMAIL PROTECTED]> wrote: Any time you start writing a system that involves representing states as numbers and doing bitmasks and math to add extra meaning, step back and remind yourself that its 2007 and this is not C and you're not writing a network protocol. You

Re: Should TAP capture exit codes

2007-03-07 Thread Eric Hacker
How gross would it be just to have a logical channel in TAP that could represent output to STDERR? That plus the exit status of the test script is pretty much all you have at the moment. Would that be so bad? Perhaps, for non-Unix testing, perhaps not. Here is what I have. There are bots that a

Re: Should TAP capture exit codes

2007-03-07 Thread Eric Hacker
On 3/7/07, Andy Armstrong <[EMAIL PROTECTED]> wrote: On 7 Mar 2007, at 13:48, Eric Hacker wrote: > I think it was Ovid who recently called it the Test Anything Protocol. > If really what is desired, then some additional complexity is > required. Sure - I'm completely in fav

Re: Should TAP capture exit codes

2007-03-07 Thread Eric Hacker
On 3/7/07, Andy Armstrong <[EMAIL PROTECTED]> wrote: On 7 Mar 2007, at 13:01, Eric Hacker wrote: > Exit code or Status code? Well let's generalise it and discuss the specifics: "any useful information that's available when the test script terminates" Ok > The

Re: Should TAP capture exit codes

2007-03-07 Thread Eric Hacker
s, but like the SIP protocol, they can be reworked to something compatible and generally recognizable. Everyone knows that a 404 is bad. Regards, -- Eric Hacker, CISSP aptronym (AP-troh-NIM) noun A name that is especially suited to the profession of its owner I _can_ leave well enough alone, but m

Re: Managing Test Plans with Vim

2007-03-05 Thread Eric Hacker
, especially the configuration information or warnings. Perl is great at parsing, but why make it difficult. Especially for the person I'll worship who'll write the Eclipse TAP plugin. Hey, we all have our vices, I like Eclipse. :) So I'd do something like. rc_file: /home/ovid/.ru

Re: Managing Test Plans with Vim

2007-03-05 Thread Eric Hacker
f a plan to be flagged when it is important retains Perl's inherent flexibility while supporting correctness when necessary. -- Eric Hacker, CISSP aptronym (AP-troh-NIM) noun A name that is especially suited to the profession of its owner I _can_ leave well enough alone, but my criteria for well enough is pretty darn high.

Re: Return values from a test as a right value.

2007-02-26 Thread Eric Hacker
On 2/26/07, Michael G Schwern <[EMAIL PROTECTED]> wrote: Also you don't want it to always be true. You want it to reflect whether the test passed or failed. I presume you still want the extra value even if the test failed. Well, at first I didn't think that I'd want it, but after seeing your

Return values from a test as a right value.

2007-02-24 Thread Eric Hacker
ask, what do you think? Thanks for all the hard work in making Perl, TAP, etc. the excellent foundation from which to build a tool to fulfill my testing need. Regards, -- Eric Hacker, CISSP aptronym (AP-troh-NIM) noun A name that is especially suited to the profession of its owner I _can_ le