[issue3353] make built-in tokenizer available via Python C API

2017-03-13 Thread Dustin J. Mitchell
Dustin J. Mitchell added the comment: If the patch still applies cleanly, I have no issues with you or anyone opening a PR. I picked this up several years ago at the PyCon sprints, and don't remember a thing about it, nor have I touched any other bit of the CPython source since then. So any

[issue24530] `import..as` fails where `import` does not

2015-06-29 Thread Dustin J. Mitchell
New submission from Dustin J. Mitchell: Reproduction: # main.py import foo.bar # foo/__init__.py # (empty) # foo/bar/__init__.py import foo.bar.bing as bing # foo/bar/bing.py # (empty) Result: dustin@euclid ~/tmp $ python3.3 main.py Traceback (most recent call last): File main.py, line

[issue3353] make built-in tokenizer available via Python C API

2015-06-29 Thread Dustin J. Mitchell
Dustin J. Mitchell added the comment: This seems to have stalled out after the PyCon sprints. Any chance the final patch can be reviewed? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue3353

[issue3353] make built-in tokenizer available via Python C API

2015-04-14 Thread Dustin J. Mitchell
Dustin J. Mitchell added the comment: From my read of this bug, there are two distinct tasks mentioned: 1. make PyTokenizer_* part of the Python-level API 2. re-implement 'tokenize' in terms of that Python-level API #1 is largely complete in Andrew's latest patch, but that will likely need

[issue3353] make built-in tokenizer available via Python C API

2015-04-14 Thread Dustin J. Mitchell
Dustin J. Mitchell added the comment: New: - rename token symbols in token.h with a PYTOK_ prefix - include an example of using the PyTokenizer functions - address minor review comments -- Added file: http://bugs.python.org/file38999/issue3353-2.patch

[issue3353] make built-in tokenizer available via Python C API

2015-04-14 Thread Dustin J. Mitchell
Dustin J. Mitchell added the comment: Here's an updated patch for #1: Existing Patch: - move tokenizer.h from Parser/ to Include/ - Add PyAPI_Func to export tokenizer functions New: - Removed unused, undefined PyTokenizer_RestoreEncoding - Include PyTokenizer_State with limited ABI

[issue19543] Add -3 warnings for codec convenience method changes

2015-04-13 Thread Dustin J. Mitchell
Dustin J. Mitchell added the comment: This fixes the four cases Nick referred to, although not in the functions expected: - str.encode no longer exists - unicode.decode no longer exists - encoders used by str.encode must return bytes (does not apply to codecs.encode) - decoders used

[issue1187] pipe fd handling issues in subprocess.py on POSIX

2008-08-02 Thread Dustin J. Mitchell
Dustin J. Mitchell [EMAIL PROTECTED] added the comment: Thoughts on this patch? ___ Python tracker [EMAIL PROTECTED] http://bugs.python.org/issue1187 ___ ___ Python-bugs-list

[issue1187] pipe fd handling issues in subprocess.py on POSIX

2008-05-15 Thread Dustin J. Mitchell
Dustin J. Mitchell [EMAIL PROTECTED] added the comment: Hmm.. I see why you didn't write a unit test for this! Attached is a patch with a unit test that tickles this behavior, along with Andrew's fix. Added file: http://bugs.python.org/file10338/1187-dustin.patch

[issue1625509] 'imp' documentation does not mention that lock is re-entrant

2008-05-10 Thread Dustin J. Mitchell
Dustin J. Mitchell [EMAIL PROTECTED] added the comment: Patch attached. -- keywords: +patch Added file: http://bugs.python.org/file10258/1625509.patch _ Tracker [EMAIL PROTECTED] http://bugs.python.org/issue1625509

[issue1174606] Reading /dev/zero causes SystemError

2008-05-10 Thread Dustin J. Mitchell
Dustin J. Mitchell [EMAIL PROTECTED] added the comment: While it is a sensible fix for the signed/unsigned problem, David's patch still fails regrtest on my system (amd64), after OOM-killing random other processes :( Andrew's suggestion makes a lot of sense here. Does it make sense

[issue1792] o(n*n) marshal.dumps performance for largish objects with patch

2008-05-10 Thread Dustin J. Mitchell
Dustin J. Mitchell [EMAIL PROTECTED] added the comment: This test passes -- is this ready to commit? I see a reduction from 1.9s to 1.5s for the test script in msg59715. -- nosy: +djmitche __ Tracker [EMAIL PROTECTED] http://bugs.python.org/issue1792

[issue1174606] Reading /dev/zero causes SystemError

2008-05-10 Thread Dustin J. Mitchell
Dustin J. Mitchell [EMAIL PROTECTED] added the comment: Improved fix; this passes test_file on my system. -- keywords: +patch Added file: http://bugs.python.org/file10266/1174606.patch _ Tracker [EMAIL PROTECTED] http://bugs.python.org/issue1174606

[issue1187] pipe fd handling issues in subprocess.py on POSIX

2008-05-10 Thread Dustin J. Mitchell
Dustin J. Mitchell [EMAIL PROTECTED] added the comment: I see that, on running your fix_fileno.py, nothing is output to /tmp/stdout.test. I don't necessarily see the link to your fix. Could you describe the problem and/or add comments to your patch to explain why these checks are made

[issue1174606] Reading /dev/zero causes SystemError

2008-05-10 Thread Dustin J. Mitchell
Dustin J. Mitchell [EMAIL PROTECTED] added the comment: Ack, sorry. My 'vi' settings should now be correct. Added file: http://bugs.python.org/file10274/1174606-3.patch _ Tracker [EMAIL PROTECTED] http://bugs.python.org/issue1174606