> > the docs are wrong when they say:
> >
> > ......................................
> > using a backslash). A backslash is illegal elsewhere on a line outside a
> > string literal.
> > ......................................
> >
> You're not passing a backslash. Try print(s).
> It would be different with a raw string
>
> s=r"""42 not\
> in [42]"""
>
Good catch Christian. Here the complete corrected code:
# --------------
from tokenize import tokenize
from io import BytesIO
s = r"""42 not\
in [42]"""
g = tokenize(BytesIO(s.encode('utf-8')).readline)
print(*(g), sep='\n')
# --------------
outputting now:
......................................
TokenInfo(type=57 (ENCODING), string='utf-8', start=(0, 0), end=(0, 0), line='')
TokenInfo(type=2 (NUMBER), string='42', start=(1, 0), end=(1, 2), line='42 not
in [42]')
TokenInfo(type=1 (NAME), string='not', start=(1, 3), end=(1, 6), line='42 not
in [42]')
TokenInfo(type=1 (NAME), string='in', start=(1, 7), end=(1, 9), line='42 not in
[42]')
TokenInfo(type=53 (OP), string='[', start=(1, 10), end=(1, 11), line='42 not in
[42]')
TokenInfo(type=2 (NUMBER), string='42', start=(1, 11), end=(1, 13), line='42
not in [42]')
TokenInfo(type=53 (OP), string=']', start=(1, 13), end=(1, 14), line='42 not in
[42]')
TokenInfo(type=4 (NEWLINE), string='', start=(1, 14), end=(1, 15), line='')
TokenInfo(type=0 (ENDMARKER), string='', start=(2, 0), end=(2, 0), line='')
......................................
but this doesn't seem to change the conclusion.
--
https://mail.python.org/mailman/listinfo/python-list
