Re: [Numpy-discussion] low level optimization in NumPy and minivect

2013-06-27 Thread mark florisson
On 27 June 2013 01:48, Frédéric Bastien wrote: > > > > On Wed, Jun 26, 2013 at 7:30 AM, mark florisson > wrote: >> >> On 26 June 2013 09:05, Dag Sverre Seljebotn >> wrote: >> > On 06/25/2013 04:21 PM, Frédéric Bastien wrote: >> >> >>

Re: [Numpy-discussion] low level optimization in NumPy and minivect

2013-06-26 Thread mark florisson
optimization >> > like using SSE instruction. I think it is great. >> > >> > Last year, Mark Florisson released the minivect[1] project that he >> > worked on during is master thesis. minivect is a compiler for >> > element-wise expression that do some

Re: [Numpy-discussion] low level optimization in NumPy and minivect

2013-06-26 Thread mark florisson
est/manpower to maintain support for > vectorization in the long term (so it was better to not add the feature than > have a badly supported feature). > > My understanding is that Numba is based on minivect and not on dynd, so it's > more of a competitor. > > Perhaps Mark Flori

Re: [Numpy-discussion] lazy evaluation

2012-06-05 Thread mark florisson
On 5 June 2012 22:36, Dag Sverre Seljebotn wrote: > On 06/05/2012 10:47 PM, mark florisson wrote: >> On 5 June 2012 20:17, Nathaniel Smith  wrote: >>> On Tue, Jun 5, 2012 at 7:08 PM, mark florisson >>>  wrote: >>>> On 5 June 2012 17:38, Nathaniel Smith  w

Re: [Numpy-discussion] lazy evaluation

2012-06-05 Thread mark florisson
On 5 June 2012 22:29, Nathaniel Smith wrote: > On Tue, Jun 5, 2012 at 9:47 PM, mark florisson > wrote: >> On 5 June 2012 20:17, Nathaniel Smith wrote: >>> On Tue, Jun 5, 2012 at 7:08 PM, mark florisson >>> wrote: >>>> On 5 June 2012 17:38, Nathaniel Sm

Re: [Numpy-discussion] lazy evaluation

2012-06-05 Thread mark florisson
On 5 June 2012 20:17, Nathaniel Smith wrote: > On Tue, Jun 5, 2012 at 7:08 PM, mark florisson > wrote: >> On 5 June 2012 17:38, Nathaniel Smith wrote: >>> On Tue, Jun 5, 2012 at 4:12 PM, mark florisson >>> wrote: >>>> On 5 June 2012 14:58, Nathaniel

Re: [Numpy-discussion] lazy evaluation

2012-06-05 Thread mark florisson
On 5 June 2012 17:38, Nathaniel Smith wrote: > On Tue, Jun 5, 2012 at 4:12 PM, mark florisson > wrote: >> On 5 June 2012 14:58, Nathaniel Smith wrote: >>> On Tue, Jun 5, 2012 at 12:55 PM, mark florisson >>> wrote: >>>> It would be great if we impl

Re: [Numpy-discussion] lazy evaluation

2012-06-05 Thread mark florisson
On 5 June 2012 18:21, Neal Becker wrote: > Would lazy eval be able to eliminate temps in doing operations such as: > > np.sum (u != 23)? > > That is, now ops involving selecting elements of matrixes are often performed > by > first constructing temp matrixes, and the operating on them. > > __

Re: [Numpy-discussion] lazy evaluation

2012-06-05 Thread mark florisson
On 5 June 2012 14:58, Nathaniel Smith wrote: > On Tue, Jun 5, 2012 at 12:55 PM, mark florisson > wrote: >> It would be great if we implement the NEP listed above, but with a few >> extensions. I think Numpy should handle the lazy evaluation part, and >> determine wh

[Numpy-discussion] lazy evaluation

2012-06-05 Thread mark florisson
Hey, Another discussion on lazy evaluation, given the recent activity here: https://github.com/ContinuumIO/numba/pull/6#issuecomment-6117091 A somewhat recent previous thread can be found here: http://mail.scipy.org/pipermail/numpy-discussion/2012-February/060862.html , and a NEP here: https://git

Re: [Numpy-discussion] pre-PEP for making creative forking of NumPy less destructive

2012-05-18 Thread mark florisson
On 17 May 2012 23:53, Dag Sverre Seljebotn wrote: > I'm repeating myself a bit, but my previous thread of this ended up > being about something else, and also since then I've been on an > expedition to the hostile waters of python-dev. > > I'm crazy enough to believe that I'm proposing a technical

Re: [Numpy-discussion] Fixing issue of future opaqueness of ndarray this summer

2012-05-15 Thread mark florisson
On 14 May 2012 21:54, David Cournapeau wrote: > > > On Mon, May 14, 2012 at 5:31 PM, mark florisson > wrote: >> >> On 12 May 2012 22:55, Dag Sverre Seljebotn >> wrote: >> > On 05/11/2012 03:37 PM, mark florisson wrote: >> >> >> &

Re: [Numpy-discussion] Fixing issue of future opaqueness of ndarray this summer

2012-05-15 Thread mark florisson
On 14 May 2012 21:36, Dag Sverre Seljebotn wrote: > On 05/14/2012 06:31 PM, mark florisson wrote: >> >> On 12 May 2012 22:55, Dag Sverre Seljebotn >>  wrote: >>> >>> On 05/11/2012 03:37 PM, mark florisson wrote: >>>> >>>&

Re: [Numpy-discussion] Fixing issue of future opaqueness of ndarray this summer

2012-05-14 Thread mark florisson
On 12 May 2012 22:55, Dag Sverre Seljebotn wrote: > On 05/11/2012 03:37 PM, mark florisson wrote: >> >> On 11 May 2012 12:13, Dag Sverre Seljebotn >>  wrote: >>> >>> (NumPy devs: I know, I get too many ideas. But this time I *really* >>> believe &g

Re: [Numpy-discussion] Fixing issue of future opaqueness of ndarray this summer

2012-05-11 Thread mark florisson
On 11 May 2012 12:13, Dag Sverre Seljebotn wrote: > (NumPy devs: I know, I get too many ideas. But this time I *really* believe > in it, I think this is going to be *huge*. And if Mark F. likes it it's not > going to be without manpower; and as his mentor I'd pitch in too here and > there.) > > (M

Re: [Numpy-discussion] Fixing issue of future opaqueness of ndarray this summer

2012-05-11 Thread mark florisson
On 11 May 2012 12:13, Dag Sverre Seljebotn wrote: > (NumPy devs: I know, I get too many ideas. But this time I *really* believe > in it, I think this is going to be *huge*. And if Mark F. likes it it's not > going to be without manpower; and as his mentor I'd pitch in too here and > there.) > > (M

Re: [Numpy-discussion] (no subject)

2012-04-06 Thread mark florisson
Could someone please ban this person from the mailing list, he keeps sending spam. On 6 April 2012 12:41, Jean-Baptiste Rudant wrote: > http://alumnos.digicap.cl/images/rmngl.html > > ___ > NumPy-Discussion mailing list > NumPy-Discussion@scipy.org > h

Re: [Numpy-discussion] subclassing array in c

2012-03-30 Thread mark florisson
On 30 March 2012 21:40, mark florisson wrote: > On 30 March 2012 21:38, mark florisson wrote: >> On 30 March 2012 19:53, Chris Barker wrote: >>> On Fri, Mar 30, 2012 at 10:57 AM, mark florisson >>> wrote: >>>> Although the segfault was caused by a bug

Re: [Numpy-discussion] subclassing array in c

2012-03-30 Thread mark florisson
On 30 March 2012 21:38, mark florisson wrote: > On 30 March 2012 19:53, Chris Barker wrote: >> On Fri, Mar 30, 2012 at 10:57 AM, mark florisson >> wrote: >>> Although the segfault was caused by a bug in NumPy, you should >>> probably also consider using Cython,

Re: [Numpy-discussion] subclassing array in c

2012-03-30 Thread mark florisson
On 30 March 2012 19:53, Chris Barker wrote: > On Fri, Mar 30, 2012 at 10:57 AM, mark florisson > wrote: >> Although the segfault was caused by a bug in NumPy, you should >> probably also consider using Cython, which can make a lot of this pain >> and boring stuff go a

Re: [Numpy-discussion] subclassing array in c

2012-03-30 Thread mark florisson
On 29 March 2012 09:07, Christoph Gohle wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > > Am 08.03.2012 um 20:39 schrieb Pauli Virtanen: > >> 08.03.2012 17:37, Christoph Gohle kirjoitti: >>> thanks for testing. I have now tried on different platforms. I get >>> all kinds of crashes on

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-21 Thread mark florisson
nputs optimally. Otherwise one might as well >> start from scratch. I'll leave that for Mark to figure out... >> >> Dag >> -- >> Sent from my Android phone with K-9 Mail. Please excuse my brevity. >> >> >> Olivier Delalleau wrote: >>> >>&g

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-21 Thread mark florisson
On 21 March 2012 05:20, Dag Sverre Seljebotn wrote: > On 03/20/2012 12:56 PM, Francesc Alted wrote: >> On Mar 20, 2012, at 2:29 PM, Dag Sverre Seljebotn wrote: >>> Francesc Alted  wrote: >>> >>>> On Mar 20, 2012, at 12:49 PM, mark florisson wrote: &g

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread mark florisson
On 13 March 2012 18:18, Travis Oliphant wrote: >>> >>> (Mark F., how does the above match how you feel about this?) >> >> I would like collaboration, but from a technical perspective I think >> this would be much more involved than just dumping the AST to an IR >> and generating some code from the

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-13 Thread mark florisson
On 13 March 2012 09:19, Travis Oliphant wrote: > > On Mar 13, 2012, at 12:58 AM, Dag Sverre Seljebotn wrote: > > On 03/10/2012 10:35 PM, Travis Oliphant wrote: > > Hey all, > > > I gave a lightning talk this morning on numba which is the start of a > > Python compiler to machine code through the L

Re: [Numpy-discussion] @Dag re numpy.pxd

2012-02-12 Thread mark florisson
On 12 February 2012 15:18, Dag Sverre Seljebotn wrote: > On 02/11/2012 10:27 PM, mark florisson wrote: >> On 11 February 2012 20:31, Charles R Harris   >> wrote: >>> Hi Dag, >>> >>> This probably needs to be on the cython mailing list at some point, but I

Re: [Numpy-discussion] @Dag re numpy.pxd

2012-02-11 Thread mark florisson
On 11 February 2012 21:45, Mark Wiebe wrote: > On Sat, Feb 11, 2012 at 3:27 PM, mark florisson > wrote: >> >> On 11 February 2012 20:31, Charles R Harris >> wrote: >> > Hi Dag, >> > >> > This probably needs to be on the cython mailing list a

Re: [Numpy-discussion] @Dag re numpy.pxd

2012-02-11 Thread mark florisson
On 11 February 2012 20:31, Charles R Harris wrote: > Hi Dag, > > This probably needs to be on the cython mailing list at some point, but I > thought I'd start the discussion here. Numpy is going to begin deprecating > direct access to ndarray/dtype internals, ala arr->data etc. There are > current

Re: [Numpy-discussion] On making Numpy 1.7 a long term support release.

2012-02-10 Thread mark florisson
On 5 February 2012 07:19, Ralf Gommers wrote: > > > On Sun, Feb 5, 2012 at 7:33 AM, Travis Oliphant wrote: >> >> I think supporting Python 2.5 and above is completely fine.  I'd even be >> in favor of bumping up to Python 2.6 for NumPy 1.7 and certainly for NumPy >> 2.8 >> > +1 for dropping Pytho

Re: [Numpy-discussion] Cython question

2012-02-09 Thread mark florisson
On 9 February 2012 15:29, Charles R Harris wrote: > Hi All, > > Does anyone know how to make Cython emit a C macro? I would like to be able > to > > #define NO_DEPRECATED_API > > and can do so by including a header file or futzing with the generator > script, but I was wondering if there was an ea

Re: [Numpy-discussion] Testing the python buffer protocol (bf_getbuffer / tp_as_buffer)

2011-12-17 Thread mark florisson
What version of numpy are you using? IIRC the new buffer protocol has been supported since numpy 1.5. On 17 December 2011 08:42, Soeren Sonnenburg wrote: > Doesn't work, complaining that the object has no __buffer__ attribute. > > Digging into the numpy c code it seems numpy doesn't even support

Re: [Numpy-discussion] failure to register ufunc loops for user defined types

2011-12-05 Thread mark florisson
On 5 December 2011 17:57, mark florisson wrote: > On 5 December 2011 17:48, Mark Wiebe wrote: >> On Mon, Dec 5, 2011 at 9:37 AM, mark florisson >> wrote: >>> >>> On 5 December 2011 17:25, Mark Wiebe wrote: >>> > On Sun, De

Re: [Numpy-discussion] failure to register ufunc loops for user defined types

2011-12-05 Thread mark florisson
On 5 December 2011 17:48, Mark Wiebe wrote: > On Mon, Dec 5, 2011 at 9:37 AM, mark florisson > wrote: >> >> On 5 December 2011 17:25, Mark Wiebe wrote: >> > On Sun, Dec 4, 2011 at 11:37 PM, Geoffrey Irving wrote: >> >> >> >> >> >

Re: [Numpy-discussion] failure to register ufunc loops for user defined types

2011-12-05 Thread mark florisson
On 5 December 2011 17:25, Mark Wiebe wrote: > On Sun, Dec 4, 2011 at 11:37 PM, Geoffrey Irving wrote: >> >> >> >> >> Back to the bugs: here's a branch with all the changes I needed to get >> rational arithmetic to work: >> >>    https://github.com/girving/numpy >> >> I discovered two more after

Re: [Numpy-discussion] NumPy nogil API

2011-11-01 Thread mark florisson
2011/10/31 Stéfan van der Walt : > On Mon, Oct 31, 2011 at 11:28 AM, Zachary Pincus > wrote: >>> As an example, it'd be nice to have scipy.ndimage available without the GIL: >>> http://docs.scipy.org/doc/scipy/reference/ndimage.html >>> >>> Now, this *can* easily be done as the core is written in

Re: [Numpy-discussion] NumPy nogil API

2011-10-31 Thread mark florisson
On 31 October 2011 09:50, Pauli Virtanen wrote: > 31.10.2011 09:44, mark florisson kirjoitti: > [clip] >> Ah, that's too bad. Is it anywhere near ready, or was it abandoned for >> ironclad? Could you point me to the code? > > It's quite ready and working, and as

Re: [Numpy-discussion] NumPy nogil API

2011-10-31 Thread mark florisson
possible to go even given > the refactored numpy core. > -- > Sent from my Android phone with K-9 Mail. Please excuse my brevity. > > Pauli Virtanen wrote: >> >> 31.10.2011 09:44, mark florisson kirjoitti: [clip] > Ah, that's too bad. >> Is it anywhere near ready

Re: [Numpy-discussion] NumPy nogil API

2011-10-31 Thread mark florisson
On 30 October 2011 21:01, Pauli Virtanen wrote: > 30.10.2011 21:48, mark florisson kirjoitti: >> First, I'd like to report a bug. It seems ndarray does not implement >> tp_traverse or tp_clear, so if you have a reference cycle in an >> ndarray with dtype object none of

[Numpy-discussion] NumPy nogil API

2011-10-30 Thread mark florisson
Hello, First, I'd like to report a bug. It seems ndarray does not implement tp_traverse or tp_clear, so if you have a reference cycle in an ndarray with dtype object none of those objects will ever be collected. Secondly, please bear with me, I'm not a NumPy expert, but would it be possible to ha