[issue2180] tokenize: mishandles line joining

2019-05-18 Thread Gregory P. Smith
Gregory P. Smith added the comment: Thanks for figuring this one out Anthony! :) -- resolution: -> fixed stage: patch review -> commit review status: open -> closed ___ Python tracker

[issue2180] tokenize: mishandles line joining

2019-05-18 Thread miss-islington
miss-islington added the comment: New changeset abea73bf4a320ff658c9a98fef3d948a142e61a9 by Miss Islington (bot) (Anthony Sottile) in branch 'master': bpo-2180: Treat line continuation at EOF as a `SyntaxError` (GH-13401)

[issue2180] tokenize: mishandles line joining

2019-05-18 Thread Gregory P. Smith
Change by Gregory P. Smith : -- assignee: -> gregory.p.smith nosy: +gregory.p.smith ___ Python tracker ___ ___ Python-bugs-list

[issue2180] tokenize: mishandles line joining

2019-05-17 Thread Anthony Sottile
Change by Anthony Sottile : -- keywords: +patch pull_requests: +13312 stage: needs patch -> patch review ___ Python tracker ___ ___

[issue2180] tokenize: mishandles line joining

2019-04-07 Thread Anthony Sottile
Anthony Sottile added the comment: Here's an example in the wild which still reproduces with python3.8a3: https://github.com/SecureAuthCorp/impacket/blob/194b22ed2fc85c4f241375fb7ebe4e0d89626c8c/impacket/examples/remcomsvc.py#L1669 This was reported as a bug on flake8:

[issue2180] tokenize: mishandles line joining

2014-02-03 Thread Mark Lawrence
Changes by Mark Lawrence breamore...@yahoo.co.uk: -- nosy: -BreamoreBoy ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue2180 ___ ___

[issue2180] tokenize: mishandles line joining

2011-09-07 Thread Meador Inge
Meador Inge mead...@gmail.com added the comment: That syntax error is coming from the CPython parser and *not* the tokenizer. Both CPython and the 'tokenizer' modules produce the same tokenization: [meadori@motherbrain cpython]$ cat repro.py if 1: \ pass [meadori@motherbrain cpython]$

[issue2180] tokenize: mishandles line joining

2010-09-26 Thread Meador Inge
Changes by Meador Inge mead...@gmail.com: -- nosy: +meador.inge ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue2180 ___ ___ Python-bugs-list

[issue2180] tokenize: mishandles line joining

2010-09-20 Thread Mark Lawrence
Mark Lawrence breamore...@yahoo.co.uk added the comment: Nobody appears to be interested so I'll close this in a couple of weeks unless someone objects, unless a patch is provided. -- nosy: +BreamoreBoy status: open - pending ___ Python tracker

[issue2180] tokenize: mishandles line joining

2010-09-20 Thread Raymond Hettinger
Raymond Hettinger rhettin...@users.sourceforge.net added the comment: Mark, please stop closing these based on age. The needs to be a determination whether this is a valid bug. If so, then a patch is needed. If not, it can be closed. -- assignee: jhylton - nosy: +rhettinger status:

[issue2180] tokenize: mishandles line joining

2010-08-21 Thread Mark Lawrence
Changes by Mark Lawrence breamore...@yahoo.co.uk: -- versions: +Python 2.7, Python 3.1, Python 3.2 -Python 2.6 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue2180 ___

[issue2180] tokenize: mishandles line joining

2009-02-15 Thread Daniel Diniz
Changes by Daniel Diniz aja...@gmail.com: -- stage: - test needed versions: +Python 2.6 -Python 2.5 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue2180 ___

[issue2180] tokenize: mishandles line joining

2008-03-19 Thread Sean Reifschneider
Changes by Sean Reifschneider [EMAIL PROTECTED]: -- assignee: - jhylton nosy: +jhylton __ Tracker [EMAIL PROTECTED] http://bugs.python.org/issue2180 __ ___ Python-bugs-list

[issue2180] tokenize: mishandles line joining

2008-02-24 Thread Jared Grubb
Changes by Jared Grubb: -- components: Extension Modules nosy: jaredgrubb severity: minor status: open title: tokenize: mishandles line joining type: behavior versions: Python 2.5 __ Tracker [EMAIL PROTECTED] http://bugs.python.org/issue2180

[issue2180] tokenize: mishandles line joining

2008-02-24 Thread Jared Grubb
New submission from Jared Grubb: tokenize does not handle line joining properly, as the following string fails the CPython tokenizer but passes the tokenize module. Example 1: s = if 1:\n \\\n #hey\n print 1 exec s Traceback (most recent call last): File stdin, line 1, in module File

[issue2180] tokenize: mishandles line joining

2008-02-24 Thread Jared Grubb
Jared Grubb added the comment: CPython allows \ at EOF, but tokenize does not. s = 'print 1\\\n' exec s 1 tokenize.tokenize(StringIO(s).readline) 1,0-1,5:NAME'print' 1,6-1,7:NUMBER '1' Traceback (most recent call last): File stdin, line 1, in module File