Pablo Galindo Salgado <pablog...@gmail.com> added the comment:

> What's also possible is to handle keywords at tokenizer level

Sadly, the tokenizer is unaware of keywords (maybe except async and await 
because their history as soft keywords) as that distinction usually is up to 
the parser as the parser is the one who knows about the grammar. Introducing 
keywords in the tokenizer would couple them too much IMHO apart from other 
possible problems.

----------

_______________________________________
Python tracker <rep...@bugs.python.org>
<https://bugs.python.org/issue40246>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

Reply via email to