[Numpy-discussion] building inplace with numpy.distutils?

2009-05-13 Thread Robert Cimrman
Hi (David)! I am evaluating numpy.distutils as a build/install system for my project - is it possible to build the extension modules in-place so that the project can be used without installing it? A pointer to documentation concerning this would be handy... Currently I use a regular Makefile f

Re: [Numpy-discussion] copy and paste arrays from matlab

2009-05-13 Thread Robin
[crossposted to numpy-discussion and mlabwrap-user] Hi, Please find attached Python code for the opposite direction - ie format Python arrays for copy and pasting into an interactive Matlab session. It doesn't look as nice because newlines are row seperators in matlab so I put everything on one

Re: [Numpy-discussion] copy and paste arrays from matlab

2009-05-13 Thread josef . pktd
On Wed, May 13, 2009 at 12:39 PM, Robin wrote: > [crossposted to numpy-discussion and mlabwrap-user] > > Hi, > > Please find attached Python code for the opposite direction - ie > format Python arrays for copy and pasting into an interactive Matlab > session. > > It doesn't look as nice because ne

[Numpy-discussion] (no subject)

2009-05-13 Thread David J Strozzi
Hi, [You may want to edit the numpy homepage numpy.scipy.org to tell people they must subscribe to post, and adding a link to http://www.scipy.org/Mailing_Lists] Many of you probably know of the interpreter yorick by Dave Munro. As a Livermoron, I use it all the time. There are some built-in

Re: [Numpy-discussion] Are masked arrays slower for processing than ndarrays?

2009-05-13 Thread Pierre GM
All, I just committed (r6994) some modifications to numpy.ma.getdata (Eric Firing's patch) and to the ufunc wrappers that were too slow with large arrays. We're roughly 3 times faster than we used to, but still slower than the equivalent classic ufuncs (no surprise here). Here's the catch: i

Re: [Numpy-discussion] Are masked arrays slower for processing than ndarrays?

2009-05-13 Thread Stéfan van der Walt
Hi Pierre 2009/5/14 Pierre GM : > This playing around with the error status may (or may not, I don't > know) cause some problems down the road. I see the buildbot is complaining on SPARC. Not sure if it is complaining about your commit, but might be worth checking out nontheless. Cheers Stéfan

Re: [Numpy-discussion] FAIL: Test bug in reduceat with structured arrays

2009-05-13 Thread David Warde-Farley
On 11-May-09, at 10:55 AM, Pauli Virtanen wrote: > Wonder why buildbot's 64-bit SPARC boxes don't see this if it's > something > connected to 64-bitness... Different endianness, maybe? That seems even weirder, honestly. David ___ Numpy-discussion mai

Re: [Numpy-discussion] Are masked arrays slower for process ing than ndarrays?

2009-05-13 Thread Matt Knox
Hi Pierre, > Here's the catch: it's basically cheating. I got rid of the pre- > processing (where a mask was calculated depending on the domain and > the input set to a filling value depending on this mask, before the > actual computation). Instead, I force > np.seterr(divide='ignore',inva

Re: [Numpy-discussion] Are masked arrays slower for processing than ndarrays?

2009-05-13 Thread Pierre GM
On May 13, 2009, at 7:36 PM, Matt Knox wrote: > >> Here's the catch: it's basically cheating. I got rid of the pre- >> processing (where a mask was calculated depending on the domain and >> the input set to a filling value depending on this mask, before the >> actual computation). Instead, I forc

Re: [Numpy-discussion] Are masked arrays slower for processing than ndarrays?

2009-05-13 Thread Matthew Brett
Hi, > Whine. I was afraid of something like that... > 2 options, then: > * We revert to computing a mask beforehand. That looks like the part > that takes the most time w/ domained operations (according to Robert > K's profiler. Robert, you deserve a statue for this tool). And that > doesn't solve

Re: [Numpy-discussion] Are masked arrays slower for processing than ndarrays?

2009-05-13 Thread Robert Kern
On Wed, May 13, 2009 at 18:36, Matt Knox wrote: > Hi Pierre, > >> Here's the catch: it's basically cheating. I got rid of the pre- >> processing (where a mask was calculated depending on the domain and >> the input set to a filling value depending on this mask, before the >> actual computation). I

Re: [Numpy-discussion] Are masked arrays slower for process ing than ndarrays?

2009-05-13 Thread Matt Knox
> Robert Kern gmail.com> writes: > > seterr() uses thread-local storage. Oh. I stand corrected. Ignore my earlier objections then. > Pierre GM gmail.com> writes: > > Also, importing numpy.ma currently calls numpy.seterr(all='ignore') > anyway... hmm. While this doesn't affect me personally..

Re: [Numpy-discussion] Are masked arrays slower for processing than ndarrays?

2009-05-13 Thread Pierre GM
On May 13, 2009, at 8:07 PM, Matt Knox wrote: > > hmm. While this doesn't affect me personally... I wonder if everyone > is aware of > this. Importing modules generally shouldn't have side effects either > I would > think. Has this always been the case for the masked array module? Well, can't

Re: [Numpy-discussion] FAIL: Test bug in reduceat with structured arrays

2009-05-13 Thread Charles R Harris
On Wed, May 13, 2009 at 5:18 PM, David Warde-Farley wrote: > On 11-May-09, at 10:55 AM, Pauli Virtanen wrote: > > > Wonder why buildbot's 64-bit SPARC boxes don't see this if it's > > something > > connected to 64-bitness... > > Different endianness, maybe? That seems even weirder, honestly. > I

Re: [Numpy-discussion] building inplace with numpy.distutils?

2009-05-13 Thread David Cournapeau
Robert Cimrman wrote: > Hi (David)! > > I am evaluating numpy.distutils as a build/install system for my project > - is it possible to build the extension modules in-place so that the > project can be used without installing it? A pointer to documentation > concerning this would be handy... Cur

[Numpy-discussion] numpy slices limited to 32 bit values?

2009-05-13 Thread Glenn Tarbox, PhD
I'm using the latest version of Sage (3.4.2) which is python 2.5 and numpy something or other (I will do more digging presently) I'm able to map large files and access all the elements unless I'm using slices so, for example: fp = np.memmap("/mnt/hdd/data/mmap/numpy1e10.mmap", dtype='float64', m

Re: [Numpy-discussion] building inplace with numpy.distutils?

2009-05-13 Thread Robert Cimrman
David Cournapeau wrote: > Robert Cimrman wrote: >> Hi (David)! >> >> I am evaluating numpy.distutils as a build/install system for my project >> - is it possible to build the extension modules in-place so that the >> project can be used without installing it? A pointer to documentation >> conce

Re: [Numpy-discussion] numpy slices limited to 32 bit values?

2009-05-13 Thread Charles R Harris
On Wed, May 13, 2009 at 10:50 PM, Glenn Tarbox, PhD wrote: > I'm using the latest version of Sage (3.4.2) which is python 2.5 and numpy > something or other (I will do more digging presently) > > I'm able to map large files and access all the elements unless I'm using > slices > > so, for example:

Re: [Numpy-discussion] numpy slices limited to 32 bit values?

2009-05-13 Thread Glenn Tarbox, PhD
On Wed, May 13, 2009 at 11:04 PM, Charles R Harris < charlesr.har...@gmail.com> wrote: > > > On Wed, May 13, 2009 at 10:50 PM, Glenn Tarbox, PhD wrote: > >> I'm using the latest version of Sage (3.4.2) which is python 2.5 and numpy >> something or other (I will do more digging presently) >> >> I'm