Carl Friedrich Bolz <[email protected]> added the comment: I am not really sure that using rply's tokenizer would improve things (I should really raise that with Alex, too). rply's tokenizer uses rlib.rsre to tokenize stuff, which is overkill, given that the regular expressions needed for Python's tokens are really regular, not Perl-style regular expressions.
---------- nosy: +cfbolz ________________________________________ PyPy bug tracker <[email protected]> <https://bugs.pypy.org/issue340> ________________________________________ _______________________________________________ pypy-issue mailing list [email protected] http://mail.python.org/mailman/listinfo/pypy-issue
