On 5/16/07, Ron Adam <[EMAIL PROTECTED]> wrote:
> Guido van Rossum wrote:
> > That would be great! This will automatically turn \u1234 into 6
> > characters, right?
>
> I'm not exactly clear when the '\uxxxx' characters get converted.  There
> isn't any conversion done in tokanize.c that I can see.  It's primarily
> only concerned with finding the beginning and ending of the string at that
> point.  It looks like everything between the beginning and end is just
> passed along "as is" and it's translated further later in the chain.

OK, I think that happens in a totally different place. But it also
needs to be fixed. :-)

> (I had said earlier tokanize.py,  meant tokanize.c)

Well, actually, tokenize.py also needs adjustments to support this...

> > Perhaps you could make the patch against the py3k-struni branch
> > instead of against the regular p3yk (sic) branch?
>
> I can do that.  :-)

Great!

-- 
--Guido van Rossum (home page: http://www.python.org/~guido/)
_______________________________________________
Python-3000 mailing list
[email protected]
http://mail.python.org/mailman/listinfo/python-3000
Unsubscribe: 
http://mail.python.org/mailman/options/python-3000/archive%40mail-archive.com

Reply via email to