Pablo Galindo Salgado <pablog...@gmail.com> added the comment:

I am -1 exposing the C-API of the tokenizer. For the new parser several 
modifications of the C tokenizer had to be done and some of them modify 
existing behaviour slightly. I don't want to corner ourselves in a place where 
we cannot make improvements because is a backwards incompatible change because 
the API is exposed.

----------
nosy: +pablogsal

_______________________________________
Python tracker <rep...@bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

Reply via email to