[issue10848] Move test.regrtest from getopt to argparse
Brett Cannon added the comment: Since http://bugs.python.org/issue10967 is the meta issue for updating regrtest this can be closed. -- resolution: - fixed status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Chris Jerdonek added the comment: Since regrtest is now using argparse (as of 6e2e5adc0400), is there a reason to keep this issue open? Or should the issue be retitled (current title: Move test.regrtest from getopt to argparse)? There seem to be some thoughts in the comments that are broader than the current title, but I don't know the right focus. It seems to be more of a brainstorm on how to improve regrtest. -- versions: +Python 3.4 -Python 3.3 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Chris Jerdonek added the comment: I just discovered that issue 15302, which has a patch awaiting review from a month ago as well as some discussion, is a duplicate of this issue. Would it be possible to leave that issue open (retitling either or both issues if necessary to avoid overlap)? The discussion here seems broader in certain ways (e.g. discussing the behavior of certain options, pre-requisites for end-to-end testing of regrtest, adding a --more-help option, etc). The patch in issue 15302 is narrower in that it handles testing via dependency injection so that main() can remain largely unaffected. I could propose such a retitling. What about putting the addition option details in the epilog? By the way, David, I did use epilog in my patch there (without having seen this thread). :) -- nosy: +cjerdonek ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Changes by Tshepang Lekhonkhobe tshep...@gmail.com: -- nosy: +tshepang ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Changes by Sandro Tosi sandro.t...@gmail.com: Removed file: http://bugs.python.org/file20541/issue10848-testdir-py3k.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: I've created two new issues (David, I think I've lost why I'd need 3 :) ) * issue11030 - finally allows to specify a relative dir with --coverdir * issue11031 - to expose --testdir in order to specify a different location of the directory containing tests (disabling stdtest nottest if testdir is set). Thanks Nick for your explanation of what's the purpose of STDTEST NOTTESTS, I've added a brief comment in the code to write that in stone :) do you think issue11031 should be in dependencies? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
R. David Murray rdmur...@bitdance.com added the comment: I would say so, otherwise how are you going to run the tests you write :) As for the other issue...I hadn't counted one for --testdir, but making that a new issue was a good idea. So the other two I had in mind was for STDTESTS and NOTTESTS. I still think the NOTTESTS pre-population should be eliminated by renaming the two problematic files, unless someone can explain why they need to be named test_xxx. For STDTESTS...you can fix that as part of 11031 (don't return them if they don't exist in the test dir). -- dependencies: +regrtest - --testdir, new command-line option to specify alternative test directory ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: As suggested by David, I made it possible to specify an alternative test directory by introducing '--testdir DIR' cli option: attached the patch, comments are welcome :) What about STDTESTS/NOTTESTS in case --testdir is specified? Currently they are executed/excluded even in case we're not running the python test suite: should we remove them in that case? -- keywords: +patch Added file: http://bugs.python.org/file20541/issue10848-testdir-py3k.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: shouldn't we use the same method also for --coverdir (that currently faild the least surprise test when specifying a relative path) replacing coverdir = os.path.join(os.getcwd(), a) with coverdir = os.path.join(support.SAVEDCWD, a) ? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
R. David Murray rdmur...@bitdance.com added the comment: I would open three new bugs to address the issues you raise. It ought to be possible to rename things so that we can eliminate the pre-population of NOTTESTS (if not I'd like to know why not!). STDTESTS appear to move certain tests to the front, possibly for stability reasons? Perhaps that can be eliminated as well; certainly it seems worth investigating. If we can't eliminate it then a check could be added such that the tests would not be returned if they don't actually show up in the directory passed to findtests. The coverdir thing looks like a bug. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Nick Coghlan ncogh...@gmail.com added the comment: As I recall, STDTESTS is there to check we have a basically functioning interpreter (i.e. the compiler works, etc). The idea is that if any of those fail, everything else is likely to go belly up as well. If regrtest is being used to run some other set of tests, then that won't apply. I thought we actually did use the testdir arg to handle the PID specific directory naming on the buildbots, but I may be misrembering where that appears in the execution sequence. -- nosy: +ncoghlan ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: On Tue, Jan 25, 2011 at 02:20, R. David Murray rep...@bugs.python.org wrote: That might be handy. I thought you were trying to roughly reproduce the current help (which dumps it all out at once), which is why I suggested epilog. actually that was my objective :) but facing the impossibility to implement it, I asked for advice; I'll go with --help with only usage classic options descriptions and --more-help for --help + long options descriptions -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
R. David Murray rdmur...@bitdance.com added the comment: Hmm. Am I misunderstanding something about epilog, then? I thought it was placed at the end of the other help text? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: On Tue, Jan 25, 2011 at 19:29, R. David Murray rep...@bugs.python.org wrote: R. David Murray rdmur...@bitdance.com added the comment: Hmm. Am I misunderstanding something about epilog, then? I thought it was placed at the end of the other help text? Sorry I get confused by the assonance with epydoc (ok they are quite fare away but still :) now I see argparse.ArgumentParser has an 'epidoc' karg that does exactly what I meant: thanks! -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Raymond Hettinger rhettin...@users.sourceforge.net added the comment: ISTM that moving from argument parser to another is more likely to introduce bugs than to solve them. There may be other advantages, but reducing bugginess isn't one of them. Lots of scripts have used getopts successfully. -- nosy: +rhettinger ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Brett Cannon br...@python.org added the comment: If Sandro is willing to write test for regrtest as part of the move then that would be a complete net win from the current situation. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Raymond Hettinger rhettin...@users.sourceforge.net added the comment: +1 -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: Sure, that would be really interesting to do, and I do commit to write a test suite to the tool that runs the python test suite :) What I'm asking is: how would you do that? I'm quite new as contributor so the ideas of experienced core devs are very valuable at this stage of the task. David proposed to write a parallel test-directory for regrtest, would you think it's feasible to do that? and what to put in that dir to trigger weird behaviour in regrtest? Any other input? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Éric Araujo mer...@netwok.org added the comment: Some parts of regrtest have been obsoleted by changes in unittest. Best not to write tests for something that will go. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
R. David Murray rdmur...@bitdance.com added the comment: I would say writing tests for regrtest is going to be a somewhat tricky task. I think you will have to do some code tweaking to even be able to run certain tests. I believe that regrtest currently has some built in assumptions about the test directory (ie: that it is Lib/test), even though the regrtest main program provides a testdir argument. So the first task is probably going to be getting that argument to actually work, and then exposing a way to set it at the regrtest command level (or, alternatively, moving all command functionality out of __main__ and into main). Once you have that, your test suite can programatically generate a test test-directory and populate it with whatever files you need for each test, using the utilities in test.script_helper. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: I finally had the time to look more closely to the issue, and I'd like to hear some comments on the info visualization. Currently we have --help option to print: usage + additional details about execution + more rigorous testing options verbosity selecting tests special runs additional options details Now, AFAIK argparse it's not so flexible, so we have to draw a line and choose a trade-off. F.e., the additional options details: they can't be added in a help='..' kargs but they should be nonetheless be displayed when passing --help to regrtest.py. * options, verbosity, selecting tests, special runs can all be grouped up into argument groups. * usage can be managed twisting a bit the usage='...' karg of argparse.ArgumentParser * but what about additional options details ? should we add that to the usage='...' text? or should we somehow override the print_help() and show usage options options groups (this is standard until here) additional options details (appending the text after options)? or something different I still don't imagine? :) Cheers, Sandro -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
R. David Murray rdmur...@bitdance.com added the comment: What about putting the addition option details in the epilog? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: R. David Murray rdmur...@bitdance.com added the comment: What about putting the addition option details in the epilog? maybe it loose the fact that all the doc/explanation for regrtest options were available from the command-line? what about a --more-help option that print_help() + all those information about cmdline switches? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
R. David Murray rdmur...@bitdance.com added the comment: That might be handy. I thought you were trying to roughly reproduce the current help (which dumps it all out at once), which is why I suggested epilog. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Changes by Éric Araujo mer...@netwok.org: -- keywords: -easy ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: R. David Murray rdmur...@bitdance.com added the comment: Note that based on my experience with the conversion of compileall to argparse,it is important to have good tests. Of course, regrtest itself has no tests... Indeed that's quite funny :) anyhow, any suggestions on how to properly test it while porting it to argparse? f.e, I can think to get all the examples in the devguide and make sure they work, but since I'm new to python development I might miss something really important, hence the commends from more experienced devs would be really important for me :) Cheers, Sandro -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
R. David Murray rdmur...@bitdance.com added the comment: Testing regrtest is distinctly non-trivial, since options have interactions (some of the somewhat unobvious). Ideally we'd refactor the code so that we could point it at a test test-directory so we could write some automated tests for it :) But if you are going that far you might as well rewrite it. This is, I suspect, why nobody has yet done this conversion. My best suggestion if you really want to go ahead is to go through each option individually, with and without command line arguments, and test how it currently behaves and make good notes. Anything that doesn't make sense, ask on (#)python-dev. And then...build a matrix and test each option in combination with each other option, again keeping notes. Which is something that has probably never been done, and will doubtless reveal some interesting bugs. You might be able to automate some tests using doctest and subprocess. I'm not sure about that easy tag. This could easily be more than a one day project. I suspect you will find your fingers itching to refactor more than just the argument parsing code. You should probably resist that urge insofar as possible :) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
R. David Murray rdmur...@bitdance.com added the comment: Note that it is also possible that after doing a review of the functionality, there might be consensus to drop one or more options, which would be a good thing overall, IMO. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
New submission from Brett Cannon br...@python.org: r87812 shows that using getopt is not a good thing; having the short and long versions of an argument separated from each other can lead to bugs. It would be good to move test.regrtest over to argparse to help prevent that from happening again. -- components: Tests keywords: easy messages: 125597 nosy: brett.cannon priority: low severity: normal status: open title: Move test.regrtest from getopt to argparse type: feature request ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Sandro Tosi sandro.t...@gmail.com added the comment: I had that in mind since quite some time, so I'm taking ownership of this issue. -- assignee: - sandro.tosi nosy: +sandro.tosi versions: +Python 3.3 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
R. David Murray rdmur...@bitdance.com added the comment: Note that based on my experience with the conversion of compileall to argparse,it is important to have good tests. Of course, regrtest itself has no tests... -- nosy: +r.david.murray ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10848] Move test.regrtest from getopt to argparse
Changes by Éric Araujo mer...@netwok.org: -- nosy: +eric.araujo ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10848 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
