Benjamin Peterson <benja...@python.org> added the comment: On Thu, Jan 29, 2009 at 5:13 PM, STINNER Victor <rep...@bugs.python.org> wrote: > Ok, I created a new function PyTokenizer_FromUnicode(). I > choosed "FromUnicode" because the string is encoded in unicode (as > UTF-8, even if it's not the wchar_t* type).
How about PyTokenizer_FromUTF8() then? > >> The (char *) cast in PyTokenizer_FromString is unneeded. > > The cast on the decode_str() result? It was already present in the > original code. I removed it in my new patch. No, I was referring to this line: tok->encoding = (char *)PyMem_MALLOC _______________________________________ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue4626> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
