[issue9974] tokenizer.untokenize not invariant with line continuations

nick caruso ngv...@gmail.com added the comment: -- import StringIO import tokenize tokens = [] def fnord(*a): tokens.append(a) tokenize.tokenize(StringIO.StringIO(a = 1).readline, fnord) tokenize.untokenize(tokens) -- Generates

[issue9974] tokenizer.untokenize not invariant with line continuations

nick caruso ngv...@gmail.com added the comment: Additionally, substituting a=1\n for a=1 results in no assertion and successful untokenizing to a = 1\n -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9974