Re: [Numpy-discussion] Adoption of a Code of Conduct

2018-08-03 Thread Antoine Pitrou
On Thu, 2 Aug 2018 14:58:05 -0700 Nathaniel Smith wrote: > > Now if you see "religion" there, then what does that tell you? Maybe > it means that these people are really excited about protecting > oppressive religions. Or... maybe it means that they're opposed to > anti-semitism, Islamophobia, et

Re: [Numpy-discussion] Adoption of a Code of Conduct

2018-08-02 Thread Antoine Pitrou
On Wed, 1 Aug 2018 21:26:35 -0700 Nathaniel Smith wrote: > On Wed, Aug 1, 2018 at 8:34 PM, Ryan May wrote: > > So I hear all the arguments about people feeling unsafe due to some truly > > despicable, discriminatory behavior, and I want absolutely no parts of > > protecting that. However, I also

Re: [Numpy-discussion] PEP 574 - zero-copy pickling with out of band data

2018-07-03 Thread Antoine Pitrou
On Mon, 2 Jul 2018 17:16:00 -0600 Charles R Harris wrote: > Maybe somewhat off topic, but we have had trouble with a 2 GiB limit on > file writes on OS X. See https://github.com/numpy/numpy/issues/3858. Does > your implementation work around that? No, it's not the same topic at all. I'd recomm

[Numpy-discussion] PEP 574 - zero-copy pickling with out of band data

2018-07-02 Thread Antoine Pitrou
Hello, Some of you might know that I've been working on a PEP in order to improve pickling performance of large (or huge) data. The PEP, numbered 574 and titled "Pickle protocol 5 with out-of-band data", allows participating data types to be pickled without any memory copy. https://www.python.o

Re: [Numpy-discussion] A roadmap for NumPy - longer term planning

2018-06-04 Thread Antoine Pitrou
Hi, Do you plan to consider trying to add PEP 574 / pickle5 support? There's an implementation ready (and a PyPI backport) that you can play with. https://www.python.org/dev/peps/pep-0574/ PEP 574 implicits targets Numpy arrays as one of its primary producers, since Numpy arrays is how large sc

Re: [Numpy-discussion] proposal: smaller representation of string arrays

2017-04-20 Thread Antoine Pitrou
On Thu, 20 Apr 2017 10:26:13 -0700 Stephan Hoyer wrote: > > I agree with Anne here. Variable-length encoding would be great to have, > but even fixed length UTF-8 (in terms of memory usage, not characters) > would solve NumPy's Python 3 string problem. NumPy's memory model needs a > fixed size pe

Re: [Numpy-discussion] Long term plans for dropping Python 2.7

2017-04-16 Thread Antoine Pitrou
On Fri, 14 Apr 2017 22:19:42 -0700 Nathaniel Smith wrote: > > From numpy's perspective, I feel like the most important reason to > continue supporting 2.7 is our ability to convince people to keep > upgrading. (Not the only reason, but the most important.) What I mean > is: if we dropped 2.7 suppo