Re: [Numpy-discussion] PyArray_Scalar() and Unicode

2010-06-13 Thread Pauli Virtanen
Sat, 12 Jun 2010 17:33:13 -0700, Dan Roberts wrote: [clip: refactoring PyArray_Scalar] There are a few problems with this. The biggest problem for me is that it appears PyUCS2Buffer_FromUCS4() doesn't produce UCS2 at all, but rather UTF-16 since it produces surrogate pairs for code points

[Numpy-discussion] PyArray_Scalar() and Unicode

2010-06-12 Thread Dan Roberts
I apologize ahead of time for anything I might be totally missing, but in order to make PyArray_Scalar() work on non-CPython interpreters, it's necessary for me to significantly refactor that function. I've made (untested but correct looking) changes to the function to handle all of the data