[issue7594] shlex refactoring

Changes by Éric Araujo : -- nosy: +eric.araujo versions: +Python 3.3 -Python 2.6, Python 2.7, Python 3.1, Python 3.2 ___ Python tracker ___ ___

[issue7594] shlex refactoring

Mark Hammond added the comment: I tried to use this in place of shlex for parsing IMAP responses for the 'imapclient' package. A couple of things struck me. * The class no longer has a next() method but probably should be added for b/w compat. * The class no longer has a 'token' attribute,

[issue7594] shlex refactoring

Ezio Melotti added the comment: Thanks for the patch. Three minor things: 1) the source contains non-ASCII chars and an encoding declaration at the beginning of the file. PEP8 says that "using \x, \u or \U escapes is the preferred way to include non-ASCII data in string literals", so I would us

[issue7594] shlex refactoring

New submission from Brian Harring : Currently, shlex.shlex's internal read_token is a bit of a nasty mess to follow and pretty poorly performant. The refactoring I'll be attaching essentially inverts the state machine approach read_token uses- instead, converting it over to a more procedural set