[Numpy-discussion] NumPy 1.13.1 released

2017-07-06 Thread Charles R Harris
Hi All, On behalf of the NumPy team, I am pleased to announce the release of NumPy 1.13.1. This is a bugfix release for problems found in 1.13.0. The major changes are: - fixes for the new memory overlap detection, - fixes for the new temporary elision capability, - reversion of the rem

Re: [Numpy-discussion] Making a 1.13.2 release

2017-07-06 Thread Juan Nunez-Iglesias
Just chiming in with a +1 to releasing 1.13.1 before SciPy. It will certainly save the skimage tutorial a lot of headaches! Not that I’ll be there but I look out for my own. =P On 7 Jul 2017, 3:54 AM +1000, Nathaniel Smith , wrote: > It's also possible to work around the 3.6.1 problem with a sma

Re: [Numpy-discussion] record data previous to Numpy use

2017-07-06 Thread Chris Barker
On Thu, Jul 6, 2017 at 10:55 AM, wrote: > > It's is just a reflexion, but for huge files one solution might be to > split/write/build first the array in a dedicated file (2x o(n) iterations - > one to identify the blocks size - additional one to get and write), and > then to load it in memory and

Re: [Numpy-discussion] record data previous to Numpy use

2017-07-06 Thread Robert Kern
On Thu, Jul 6, 2017 at 3:19 AM, wrote: > > Thanks Rober for your effort - I'll have a look on it > > ... the goal is be guide in how to proceed (and to understand), and not to have a "ready-made solution" ... but I appreciate honnestly :-) Sometimes it's easier to just write the code than to try

Re: [Numpy-discussion] record data previous to Numpy use

2017-07-06 Thread paul . carrico
Thanks all for your advices Well many thing to look for, but it's obvious now that I've first to work on (better) strategy than the one I was thinking previously (i.e. load all the files and results in one step). It's is just a reflexion, but for huge files one solution might be to split/write

Re: [Numpy-discussion] Making a 1.13.2 release

2017-07-06 Thread Nathaniel Smith
It's also possible to work around the 3.6.1 problem with a small preprocessor hack. On my phone but there's a link in the bug report discussion. On Jul 6, 2017 6:10 AM, "Charles R Harris" wrote: > Hi All, > > I've delayed the NumPy 1.13.2 release hoping for Python 3.6.2 to show up > fixing #2994

Re: [Numpy-discussion] Scipy 2017 NumPy sprint

2017-07-06 Thread Stephan Hoyer
On Thu, Jul 6, 2017 at 9:42 AM, Chris Barker wrote: > In NumPy, this could go along with NDArrayOperatorsMixins in >> numpy/lib/mixins.py >> >> > > Yes! I had no idea that existed. > It's brand new

Re: [Numpy-discussion] Scipy 2017 NumPy sprint

2017-07-06 Thread Stephan Hoyer
On Thu, Jul 6, 2017 at 4:42 AM, Ben Rowland wrote: > Slightly off topic, but as someone who has just spent a fair amount of > time implementing various > subclasses of nd-array, I am interested (and a little concerned), that the > consensus is not to use > them. Is there anything available which

Re: [Numpy-discussion] Scipy 2017 NumPy sprint

2017-07-06 Thread Chris Barker
On Wed, Jul 5, 2017 at 11:05 AM, Stephan Hoyer wrote: > That is, the boilerplate needed for multi-dimensional indexing and >> slicing, etc... >> >> That could be a nice little sprint-able project. >> > > Indeed. Let me highlight a few mixins >

Re: [Numpy-discussion] Making a 1.13.2 release

2017-07-06 Thread Chris Barker
On Thu, Jul 6, 2017 at 6:10 AM, Charles R Harris wrote: > I've delayed the NumPy 1.13.2 release hoping for Python 3.6.2 to show up > fixing #29943 so we can close #9272 > , but the Python release has > been delayed

Re: [Numpy-discussion] Making a 1.13.2 release

2017-07-06 Thread Charles R Harris
On Thu, Jul 6, 2017 at 9:53 AM, Matthew Brett wrote: > On Thu, Jul 6, 2017 at 3:37 PM, Charles R Harris > wrote: > > > > > > On Thu, Jul 6, 2017 at 7:15 AM, Matthew Brett > > wrote: > >> > >> Hi, > >> > >> On Thu, Jul 6, 2017 at 2:10 PM, Charles R Harris > >> wrote: > >> > Hi All, > >> > > >>

Re: [Numpy-discussion] record data previous to Numpy use

2017-07-06 Thread Chris Barker
OK, you have two performance "issues" 1) memory use: IF yu need to read a file to build a numpy array, and dont know how big it is when you start, you need to accumulate the values first, and then make an array out of them. And numpy arrays are fixed size, so they can not efficiently accumulate v

Re: [Numpy-discussion] Making a 1.13.2 release

2017-07-06 Thread Matthew Brett
On Thu, Jul 6, 2017 at 3:37 PM, Charles R Harris wrote: > > > On Thu, Jul 6, 2017 at 7:15 AM, Matthew Brett > wrote: >> >> Hi, >> >> On Thu, Jul 6, 2017 at 2:10 PM, Charles R Harris >> wrote: >> > Hi All, >> > >> > I've delayed the NumPy 1.13.2 release hoping for Python 3.6.2 to show up >> > fix

Re: [Numpy-discussion] Making a 1.13.2 release

2017-07-06 Thread Charles R Harris
On Thu, Jul 6, 2017 at 7:15 AM, Matthew Brett wrote: > Hi, > > On Thu, Jul 6, 2017 at 2:10 PM, Charles R Harris > wrote: > > Hi All, > > > > I've delayed the NumPy 1.13.2 release hoping for Python 3.6.2 to show up > > fixing #29943 so we can close #9272, but the Python release has been > > dela

Re: [Numpy-discussion] Making a 1.13.2 release

2017-07-06 Thread Matthew Brett
Hi, On Thu, Jul 6, 2017 at 2:10 PM, Charles R Harris wrote: > Hi All, > > I've delayed the NumPy 1.13.2 release hoping for Python 3.6.2 to show up > fixing #29943 so we can close #9272, but the Python release has been > delayed to July 11 (expected). The Python problem means that NumPy compiled

[Numpy-discussion] Making a 1.13.2 release

2017-07-06 Thread Charles R Harris
Hi All, I've delayed the NumPy 1.13.2 release hoping for Python 3.6.2 to show up fixing #29943 so we can close #9272 , but the Python release has been delayed to July 11 (expected). The Python problem means that NumP

Re: [Numpy-discussion] Scipy 2017 NumPy sprint

2017-07-06 Thread Ben Rowland
> On 5 Jul 2017, at 19:05, Stephan Hoyer wrote: > > On Wed, Jul 5, 2017 at 10:40 AM, Chris Barker > wrote: > Along those lines, there was some discussion of having a set of utilities (or > maybe eve3n an ABC?) that would make it easier to create a ndarray-like > o

Re: [Numpy-discussion] record data previous to Numpy use

2017-07-06 Thread paul . carrico
Thanks Rober for your effort - I'll have a look on it ... the goal is be guide in how to proceed (and to understand), and not to have a "ready-made solution" ... but I appreciate honnestly :-) Paul Le 2017-07-06 11:51, Robert Kern a écrit : > On Thu, Jul 6, 2017 at 1:49 AM, wrote: >> >> D

Re: [Numpy-discussion] record data previous to Numpy use

2017-07-06 Thread Robert Kern
On Thu, Jul 6, 2017 at 1:49 AM, wrote: > > Dear All > > First of all thanks for the answers and the information’s (I’ll ding into it) and let me trying to add comments on what I want to : > > My asci file mainly contains data (float and int) in a single column > (it is not always the case but I ca

Re: [Numpy-discussion] record data previous to Numpy use

2017-07-06 Thread paul . carrico
Dear All First of all thanks for the answers and the information's (I'll ding into it) and let me trying to add comments on what I want to : * My asci file mainly contains data (float and int) in a single column * (it is not always the case but I can easily manage it - as well I