Re: QA Hack directions?

2011-04-11 Thread nadim khemir
Leaon, since you'll be at the QAH, maybe we can work a bit on Test::Exception. I won't be physically present though. Nadim. > On Sun, Apr 10, 2011 at 5:26 PM, Ricardo Signes > > wrote: > > The QA hackathon wiki suggests that directions to the hotels can be found > > at http://2011.qa-hackathon

Re: sharing perl data structures across tests

2010-04-02 Thread nadim khemir
> I see no one's answered this yet. I was hoping for more clarification lest my (mis)understanding hampers things. You have a large data structure to share across tests and I assume either some code builds it and others than need it or it's expensive to build? If it's the former, it implies an

Re: Examining Inheritance Hiearchies

2009-02-15 Thread nadim khemir
On Sunday 15 February 2009 17.49.43 Ovid wrote: > If you're struggling to understand a complex app, a graph of the > inheritance hierarchy can be very useful. Here's an example for > TAP::Parser: > > http://i82.photobucket.com/albums/j275/publius_ovidius/Geek%20Stuff/graph-5 >.png > ... > Nice,

Re: TAP::Data or TAPx::Data?

2009-02-11 Thread nadim khemir
On Wednesday 11 February 2009 11.58.02 Steffen Schwigon wrote: > Hi! > > [TAP Namespace Nonproliferation Treaty] > > Should I name a module that represents the result of a TAP parse as > data structure > > TAP::Data > > or > > TAPx::Data > > before I upload to CPAN? > > T

Sum of all tests for a module/application

2008-10-26 Thread nadim khemir
Hi, I was discussing one of my modules with a friend and he asked how many tests I had. I answered 500 hundred but it then hit me that to have the module working I had to rely on other modules written by other people. The actual number of tests being the sum of all the tests for the module dep

Re: wxWidgets and TAP processing (YAPC::EU?)

2008-08-09 Thread nadim khemir
On Friday 08 August 2008 11.05.53 Gabor Szabo wrote: > I am not sure if this is related to the recent ascii-art discussion There was an ascii art discussion? where? Cheers

Re: Interrest for a QA-Tool hackathon after YAPC::EU

2008-07-21 Thread nadim khemir
Hi, sorry I didn't reply earlier but I deserved some sunny vacations; On Friday 18 July 2008 10.29.10 Gabor Szabo wrote: > I am about to book my flight to Copenhagen but I have to decide when > to come back > so I was wondering what's going on with the Hackathon? > > Is it going to take place? Yes

Re: best practices for temporary files during testing

2008-06-10 Thread nadim khemir
On Saturday 07 June 2008 19.36.21 Gabor Szabo wrote: > I just got a failure report from David Golden as this line > did not work with "Permission denied" > > copy($0, "$0.tmp") > > He was running it on Windows (Strawberry Perl). > > I am sure I create temporary files in various test, so it might b

Re: Video of Oslo QA Hackathon closing remarks

2008-05-27 Thread nadim khemir
On Thursday 22 May 2008 12.56.02 brian d foy wrote: > I've managed to edit the video from the closing remarks at the Oslo QA > Hackathon. > > http://vimeo.com/1043143 > > It's nothing fancy, but it's the first video I've made and next time it > will be better :) Nice. Now we all have to do that at

Re: TODO Tests

2008-05-12 Thread nadim khemir
On Monday 12 May 2008 20.41.58 Bram wrote: > > Leave your todo test as it was to start with. > > Create a new test file "development_values_that_shoulnot_change.t" in > > your developer test directory (that's not just for pod right). > Which is not practical at all. > That means maintaining an ext

Re: TODO Tests

2008-05-12 Thread nadim khemir
On Monday 12 May 2008 16.23.46 Bram wrote: > Then what happens if it starts returning 4? > Then the test script will report a FAIL, and users will/might start > ignoring failures. > Which is a bad thing (IMHO). > > The todo test indicates that something doesn't behave as it should. > If it suddenly

Re: Munging output when running warning tests

2008-05-08 Thread nadim khemir
Thank you for explaining the thoughts behind $trap. Cheers, Nadim.

Re: Interrest for a QA-Tool hackathon after YAPC::EU

2008-05-06 Thread nadim khemir
On Tuesday 06 May 2008 13.21.17 Andy Armstrong wrote: > I'm in :) Of course this is first come - first served > Once we know numbers and have a better idea of who's attending I'll > volunteer for some duty or other. What are you good at? > As long as I don't have to clean the > latrines... Not

Interrest for a QA-Tool hackathon after YAPC::EU

2008-05-06 Thread nadim khemir
In Oslo I proposed to organize a hackathon the week after YAPC::EU. Subject: -QA - tool: IDE, editors, _debugger_, CPAN::Mini::xxx (I believe most toolchain ppl are on the QA list) - your_idea_here I'd like to make it possible to have this one "on a shoestrin

Re: Munging output when running warning tests

2008-05-02 Thread nadim khemir
On Friday 02 May 2008 01.24.00 Eirik Berg Hanssen wrote: > use Test::More tests => 1; > use Test::Trap; > trap { warn "1\n2\n3" }; > $trap->warn_like(0, qr/1\n2\n3/); Ah! I like this. How did I miss this module?? is it possible to have trap{} return an object/sub/whatever that is created by the

Re: Munging output when running warning tests

2008-05-01 Thread nadim khemir
On Thursday 01 May 2008 20.06.52 Eirik Berg Hanssen wrote: > What precisely must "something()" be? I tried the following: > So. Where do I look? Here is the (simplified) code that would generate the warning I thought was a problem (read below) my ($search_regex, $replacement_regex) = (qr/

Re: Munging output when running warning tests

2008-05-01 Thread nadim khemir
On Tuesday 29 April 2008 19.52.08 Aristotle Pagaltzis wrote: > If the warning is normal, how about disabling it? If a warning > does not signify a problem, there is absolutely no point in > having perl emit one anyway. It's a perl warning (in an eval) not something I output. Cheers, Nadim.

Re: Munging output when running warning tests

2008-04-28 Thread nadim khemir
On Tuesday 29 April 2008 03.24.48 Michael G Schwern wrote: > > BTW: Test::Warn suck a bit because it doesn't check the warning you emit > > but the _first_ line of the warning you emit (hmm, time for a patch > > maybe). > > All the warnings_* functions take an array ref of warnings. You can't test

Munging output when running warning tests

2008-04-27 Thread nadim khemir
Hi, I have had a problems with output when running tests, this happends, IE, when perl output a warning. warning_like { something() ; } qr'Use of uninitialized value in substitution iterator' ; I get the warning on the terminal which is boring when one works with a mod

Re: Devel::Cover vs MakeMaker

2008-04-18 Thread nadim khemir
On Friday 18 April 2008 20.06.32 Michael G Schwern wrote: > I'd like to know if anyone has a way to make Devel::Cover work properly > with the MakeMaker tests. Currently I get bizarre results from cover -test > (see below) where it thinks there's no lines in the modules. This is > probably the re

Re: Testing print failures

2008-01-05 Thread nadim khemir
On Saturday 05 January 2008 20.21.59 Eric Wilhelm wrote: > Even if it weren't a system handle, in what situation does print() > return false? > > 1. Closed handle > 2. Unopened handle > 3. Disk full > > Unless I've missed one, you don't need to check the return value of > print. > > I will

Re: Testing print failures

2008-01-05 Thread nadim khemir
On Saturday 05 January 2008 15.08.55 Michael G Schwern wrote: > nadim khemir wrote: > > print 'hi' or carp q{can't print!} ; > > I'm not even going to wade into the layers of neurosis demonstrated in this > post, but if you want to throw an error use croak

Testing print failures

2008-01-05 Thread nadim khemir
With the advent of intensive coverage tests and zealous Perl::Critic policies, testing even simple things is getting messy. even a moundain: print 'hello' ; triggers the wrath of InputOutput::RequireCheckedSyscalls with the message "Return value of flagged function ignored". This is

Re: buildbot - an experiment

2008-01-04 Thread nadim khemir
On Thursday 03 January 2008 19.42.26 nadim khemir wrote: > I did send a mail to cabie author asking if he had made a comparison > between cabie and other systems. I also invited him to join us on this > mailing list. I'll forward his answer if he does answer me. I received an an

Re: buildbot - an experiment

2008-01-03 Thread nadim khemir
On Thursday 03 January 2008 11.50.03 Andy Armstrong wrote: > > Cabie seems to be as good, if not better (psst, it's written in Perl). > Does that make it better? :) RTFM! In the feature list the authors writes "* It's really cool!". Since cool is better than good, I assume it is ;) The "written

Re: buildbot - an experiment

2008-01-02 Thread nadim khemir
On Saturday 29 December 2007 10.11.41 Matisse Enzer wrote: > I've spent some of this holiday season learning how to set up BuildBot > ... I've also found this one to be written in Perl: http://www.johnkeiser.com/mozilla/tbox3.html other links http://en.wikipedia.org/wiki/Continuous_Integration

Re: buildbot - an experiment

2008-01-02 Thread nadim khemir
On Saturday 29 December 2007 10.11.41 Matisse Enzer wrote: > I've spent some of this holiday season learning how to set up BuildBot > ... Cabie seems to be as good, if not better (psst, it's written in Perl). http://cabie.tigris.org/ Cheers, Nadim.

Re: [ANNOUNCE] TAP::Harness::Archive 0.03

2007-12-16 Thread nadim khemir
On Sunday 16 December 2007 23.29.55 Michael G Schwern wrote: > nadim khemir wrote: > > On Saturday 15 December 2007 20.53.30 Michael Peters wrote: > >> The uploaded file > >> > >> TAP-Harness-Archive-0.03.tar.gz > >> ... > > > > Nice.

Re: [ANNOUNCE] TAP::Harness::Archive 0.03

2007-12-16 Thread nadim khemir
On Saturday 15 December 2007 20.53.30 Michael Peters wrote: > The uploaded file > > TAP-Harness-Archive-0.03.tar.gz > ... Nice. Now, what do we do with it? Cheers, Nadim.

Re: Milton Keynes PM coding collaboration

2007-12-13 Thread nadim khemir
Edwardson, Tony wrote: > Anyone written any CPAN modules for which the testing coverage needs to > be improved ? Euuu, All of them. Nadim.

Re: shouldn't "UNEXPECTEDLY SUCCEEDED" mean failure?

2007-12-08 Thread nadim khemir
FYI: http://socialtext.useperl.at/woc/index.cgi?todo_test_bounties

Re: shouldn't "UNEXPECTEDLY SUCCEEDED" mean failure?

2007-12-03 Thread nadim khemir
On Sunday 02 December 2007 18:48, Chris Dolan wrote: > ... > > In this fashion, we use TODO tests to track when bugs in our > dependent packages get fixed, and then when we can remove workarounds > therefore. > > Chris This discussion is interresting and it's always educating to understand why o

Re: shouldn't "UNEXPECTEDLY SUCCEEDED" mean failure?

2007-12-02 Thread nadim khemir
On Sunday 02 December 2007 18:51, Eric Wilhelm wrote: > # from Ovid > > # on Sunday 02 December 2007 07:47: > >--- nadim khemir <[EMAIL PROTECTED]> wrote: > >> The subject says it all. IE: > > ... > > >> t/20_policies.t 152 578 5

Re: shouldn't "UNEXPECTEDLY SUCCEEDED" mean failure?

2007-12-02 Thread nadim khemir
On Sunday 02 December 2007 16:47, Ovid wrote: > --- nadim khemir <[EMAIL PROTECTED]> wrote: > > The subject says it all. IE: > > > > All tests successful (2 subtests UNEXPECTEDLY SUCCEEDED), 7 tests > > skipped. > > Passed TODO

shouldn't "UNEXPECTEDLY SUCCEEDED" mean failure?

2007-12-02 Thread nadim khemir
The subject says it all. IE: All tests successful (2 subtests UNEXPECTEDLY SUCCEEDED), 7 tests skipped. Passed TODO Stat Wstat TODOs Pass List of Passed --- t/20_policies.t 152 578 583 (nice report

Re: test suite as CPAN module

2007-11-26 Thread nadim khemir
On Sunday 25 November 2007 20:47, Chris Dolan wrote: > I've been working on Test::Virtual::Filesystem for a couple of > weeks. > ... > filesystems (like Fuse filesystems -- I use it for Fuse::PDF) > ... > Thoughts? Fuse::PDF caught my eyes a few days ago (how could it not with that name ;) alth

Test quality

2007-11-18 Thread nadim khemir
Hi, This mail is not discussing what quality and what test quality is. It is about what quality our 'test files' have. I run Test::Fixme, Kwalitee, perl::Critic, etc ... on my modules but none of them is ran on my tests. tests have a tendency to become a mess, be undocumented, etc... What are

My list of small quirks

2007-11-18 Thread nadim khemir
Hi, I spend a rather large amount of time writing and running tests. There are a few things that could be better. I either don't know how or it may not possible. I thought we could share some of questions and ideas that can make working with tests more pleasent. This should go into a Q&A I gue

Re: Overriding CORE::GLOBAL::print

2007-10-29 Thread nadim khemir
On Monday 29 October 2007 02:06, Chris Dolan wrote: > On Oct 28, 2007, at 6:12 PM, Scott McWhirter wrote: > > You could use an IO::Handle based object wrapped around STDOUT/STDERR. > > It doesn't really matter whether it's a glob filehandle or an > IO::Handle or a tied handle. The important part i

Re: .t files as specs

2007-08-02 Thread nadim khemir
On Tuesday 19 June 2007 17:52, Mike Malony wrote: > So I'm working my project, and I've got one other more junior coder with > me. > > Has anyone tried writing test files as part of their spec's? > > An overview document would also be needed, and some time walking through > the expected testing. B

Re: Revising the Perl Testing quick reference card

2007-08-02 Thread nadim khemir
On Wednesday 01 August 2007 22:10, Andrew Ford wrote: > I have corresponded with Ian Langworth and he has agreed that I should > revise the Perl Testing quick reference. I shall be converting it to > LaTeX and expanding it to be a two-sided card, which implies doubling > the amount of information

Re: Pod::Critic?

2007-06-08 Thread Nadim Khemir
On Friday 08 June 2007 00:04, Matisse Enzer wrote: > I wonder how you all feel these days about the "put the pod at > the __END__" approach? I've been trying it for over a year now > and am not really sure its the best way to go (vs. having the pod > for each method right next to it.) I put the P

Re: Pod::Critic?

2007-06-08 Thread Nadim Khemir
On Thursday 07 June 2007 12:54, David Cantrell wrote: > Nadim Khemir wrote: > > 'method docs have examples': I believe the examples should be tested. > > I have to disagree. And that would be your priviledge. If you have code in you POD and that code is not tested t

Re: Pod::Critic?

2007-06-06 Thread Nadim Khemir
On Wednesday 06 June 2007 17:08, Ian Malpass wrote: > I've been documenting lately, so I'm a bit POD-focussed at the moment :) > I was pondering creating Pod::Critic, as a documentation analogue of > Perl::Critic. > > Clearly it's not so easy to give hard-and-fast rules about > documentation, but I

Re: Testing URIs in POD

2007-06-06 Thread Nadim Khemir
How do you plan to test things like: my $url_base = "http://search.cpan.org/"; ; for my $rest (qw(modlist/Graphics modlist/Database_Interfaces)) { do_anything_with($ur_base . $rest); } Nadim. On Sunday 03 June 2007 15:10, Ian Malpass wrote: > ReneeB wrote: > > Let this t

Re: Testing URIs in POD

2007-06-02 Thread Nadim Khemir
Can we get examples? first the POD then what you would like to extract. Best would be to write your examples as tests. Nadim. On Saturday 02 June 2007 12:11, ReneeB wrote: > Ian Malpass wrote: > > I've started crafting Test::Pod::URI to extract URIs from POD and > > check them to make sure they

POD-Tested

2007-05-23 Thread Nadim Khemir
Hi, I just uploaded POD-Tested to CPAN (It may take a few hours before it is accessible). it's a fun little module to write cookbooks. It lets you test the content of you cookbook and generate some sections dynamically. There are a few schoolbook examples in the distribution but Config-Hierarch

Re: testing dependent modules

2007-05-09 Thread Nadim Khemir
PAR has a module to find module dependencies. That might help. Nadim.

Re: a safer way to use no_plan?

2007-03-04 Thread Nadim Khemir
On Sunday 04 March 2007 09:40, Shlomi Fish wrote: > My solution to this is: >... > What I do is add comments in a small domain-specific language ... >... > # TEST > is ($mystring, "Hello", "String is Hello"); > > # TEST*3 > for my $i (0 .. 2) > { > ok () > } > Wouldn't Test::Block be bet

Re: Test script with hierarchy

2007-02-17 Thread Nadim Khemir
On Saturday 03 February 2007 09:04, chromatic wrote: > > Can I use TAP for this? Can TAP be used to represent such hierarchy? > Filesystem directories already represent a hierarchy. Using the tagging scheme is bound to fail if you modify you test hierarchy (well, you can always modify your tags

Re: Module Announcement: Perl-Critic-1.01

2007-02-04 Thread Nadim Khemir
On Saturday 03 February 2007 07:48, Adam Kennedy wrote: > And from all of us, I think a big Thank You and congratulations are in > order. Indeed, Jeffrey's work is of the highest value to the perl community. It would be interresting to know how many ppl and new modules use Perl::Critic. In any c

Re: Bad test functions in Test::Exception

2007-02-02 Thread Nadim Khemir
On Friday 02 February 2007 10:09, Adrian Howard wrote: > [snip] > I'm unconvinced that this should be the default behaviour because I'm > fairly certain that a number of these new test failures - possibly > the majority - won't actually be indications of code that doesn't work. > > For example. Mod

Re: Bad test functions in Test::Exception

2007-02-01 Thread Nadim Khemir
On Thursday 01 February 2007 22:37, Joshua ben Jore wrote: > I'd be a happy guy if a paranoid T::E caused consternation and people > to post "OMG! My stuff fails now!" to perlmonks or whatever. I use T::E extensively and I, too, would like to see a complete paranoid module. Someone wrote, "don'

Re: Bad test functions in Test::Exception

2007-01-30 Thread Nadim Khemir
On Tuesday 30 January 2007 19:09, A. Pagaltzis wrote: > * Nadim Khemir <[EMAIL PROTECTED]> [2007-01-30 18:20]: > > # Check that a test runs without an exception > > lives_and { is $foo->method, 42 } 'method is 42'; > > Isn't this equivalent to i

Re: Bad test functions in Test::Exception

2007-01-30 Thread Nadim Khemir
On Tuesday 30 January 2007 18:53, Pete Krawczyk wrote: > snip > No, you're not - but shunning all possible uses of dies_ok becasue you > didn't write a test as complete as you could have isn't the fault of > Test::Exception. > How about code that dies with an object? dies_ok lets you inspect the

Re: Bad test functions in Test::Exception

2007-01-30 Thread Nadim Khemir
On Tuesday 30 January 2007 19:19, A. Pagaltzis wrote: > * Pete Krawczyk <[EMAIL PROTECTED]> [2007-01-30 19:00]: > > How about code that dies with an object? dies_ok lets you > > inspect the object in $@, whereas throws_ok only lets you see > > if it's part of a class. What if you want to see if $@

Bad test functions in Test::Exception

2007-01-30 Thread Nadim Khemir
I like Test::Exception, it's a very fundamental test module with Text::NoWarning, Test::Deep and other goodies. Still, I believe some of the functions made available should not be there at all. The good guys : # Check that the stringified exception matches given regex throws_ok { $foo->me

Carp::Diagnostics

2007-01-30 Thread Nadim Khemir
A, slightly, better way to handle diagnostics? http://search.cpan.org/~nkh/Carp-Diagnostics-0.02/ Cheers, Nadim.

Re: symphony and TAP

2007-01-17 Thread Nadim Khemir
On Wednesday 17 January 2007 14:57, Christopher H. Laco wrote: > Christopher H. Laco wrote: > > While strolling through PlanetMVC, I noticed a free chapter about unit > > testing using it's own testing library call Lime. Low and behold, my > > eyes see TAP and some props to Test::More. Kewl. :-) >

Re: Test::Builder feature request

2007-01-12 Thread Nadim Khemir
Hi, On Friday 12 January 2007 01:49, [EMAIL PROTECTED] wrote: > You don’t have to use objects to get the same end effects as mocking > objects. Right! Now, as my "devil's advocate" signature tried to show, this thread is for the fun of the discussion. I'm sure all of use, and Ovid more than th

Re: Test::Builder feature request

2007-01-11 Thread Nadim Khemir
On Thursday 11 January 2007 18:04, Ovid wrote: >> Just one, Shouldn't the mailer "object" be mocked and the mail >> sending checked? >absolutely, but how do you know to mock it or really send the email >unless you know that you're being run by tests? Aren't you mixin contexts here? The code to be

Re: Test::Builder feature request

2007-01-11 Thread Nadim Khemir
On Thursday 11 January 2007 15:30, Ovid wrote: > Quite often people will write code which tests to see if > $ENV{HARNESS_ACTIVE} is true. For example, this allows them to not > email support from their code while testing. This variable is set in > Test::Harness. However, this causes a problem wh

DIAGNOSTICS section

2006-12-19 Thread Nadim Khemir
Hi all, PBP p. 134 and 286 advocates the use of a "=head1 DIAGNOSTICS" section. Although this is a bit on the heavy side, I would tend to agree. I'm not sure it would help a lot of users but it makes one feel good (which is why we write module. Right?). my latest modules confess at 30 differen

Re: testing module loading output and testing under the debugger

2006-12-19 Thread Nadim Khemir
Hi Josh, > Not true. If you real perldebguts you'll see that the debugger can be > scripted or you could write your own debugger. right and right but Devel::Ebug is simply much cleaner and I'd rather not mock a debugger when I can use a real one. Hi Adrian, >> The first problem I have is captu

testing module loading output and testing under the debugger

2006-12-17 Thread Nadim Khemir
Hi, I'm writing a module to help debug application. I have used it in PBS for a while and I wanted to rewrite it "right" with tests and all. = 1 = The first problem I have is capturing the module output when it is loaded. I tried: my $capture ; BEGIN { $capture = IO::Capture::Stdout->