Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Sebastian Berg
On Tue, 2018-06-26 at 22:26 -0700, Robert Kern wrote: > On Tue, Jun 26, 2018 at 10:21 PM Juan Nunez-Iglesias com> wrote: > > Let me start by thanking Robert for articulating my viewpoints far > > better than I could have done myself. I want to explicitly flag the > > following statements for endor

Re: [Numpy-discussion] Revised NEP-18, __array_function__ protocol

2018-06-26 Thread Hameer Abbasi
On 27. Jun 2018 at 07:48, Stephan Hoyer wrote: After much discussion (and the addition of three new co-authors!), I’m pleased to present a significantly revision of NumPy Enhancement Proposal 18: A dispatch mechanism for NumPy's high level array functions: http://www.numpy.org/neps/nep-0018-arra

[Numpy-discussion] Revised NEP-18, __array_function__ protocol

2018-06-26 Thread Stephan Hoyer
After much discussion (and the addition of three new co-authors!), I’m pleased to present a significantly revision of NumPy Enhancement Proposal 18: A dispatch mechanism for NumPy's high level array functions: http://www.numpy.org/neps/nep-0018-array-function-protocol.html The full text is also in

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Stephan Hoyer
On Tue, Jun 26, 2018 at 10:22 PM Robert Kern wrote: > We certainly could make the conservative choice of only adopting 4 for now >> and leaving further cleanup for later. I guess this uncertainty about >> whether direct indexing should be more like vindex[] or oindex[] in the >> long term is a go

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 10:21 PM Juan Nunez-Iglesias wrote: > Let me start by thanking Robert for articulating my viewpoints far better > than I could have done myself. I want to explicitly flag the following > statements for endorsement: > > *I would still reserve warnings and deprecation for th

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 9:50 PM Stephan Hoyer wrote: > On Tue, Jun 26, 2018 at 12:46 AM Robert Kern > wrote: > >> I think having more self-contained descriptions of the semantics of each >> of these would be a good idea. The current description of `.vindex` spends >> more time talking about what

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Juan Nunez-Iglesias
Let me start by thanking Robert for articulating my viewpoints far better than I could have done myself. I want to explicitly flag the following statements for endorsement: > *I would still reserve warnings and deprecation for the cases where > the current behavior gives us something that no one wa

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Stephan Hoyer
On Tue, Jun 26, 2018 at 12:46 AM Robert Kern wrote: > I think having more self-contained descriptions of the semantics of each > of these would be a good idea. The current description of `.vindex` spends > more time talking about what it doesn't do, compared to the other methods, > than what it d

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 6:47 PM Stephan Hoyer wrote: > > On Tue, Jun 26, 2018 at 6:39 PM Robert Kern wrote: > >> I'd still prefer not talking deprecation, per se, in this NEP (but my >> objection is weaker). I would definitely start adding in informative, noisy >> warnings in these cases, though

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Stephan Hoyer
On Tue, Jun 26, 2018 at 6:39 PM Robert Kern wrote: > I'd still prefer not talking deprecation, per se, in this NEP (but my > objection is weaker). I would definitely start adding in informative, noisy > warnings in these cases, though. Along the lines of, "Hey, this is a dodgy > construction that

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 6:14 PM Stephan Hoyer wrote: > On Tue, Jun 26, 2018 at 4:34 PM Robert Kern wrote: > >> I maintain that considering deprecation is premature at this time. Please >> take it out of this NEP. Let us get a feel for how people actually use >> .oindex/.vindex. Then we can talk

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Stephan Hoyer
On Tue, Jun 26, 2018 at 9:38 AM Eric Wieser wrote: > We can expose some of the internals > > These could be expressed as methods on the internal indexing objects I > proposed in the first reply to this thread, which has seen no responses. > > I think Hameer Abbasi is looking for something like >

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Stephan Hoyer
On Tue, Jun 26, 2018 at 4:34 PM Robert Kern wrote: > I maintain that considering deprecation is premature at this time. Please > take it out of this NEP. Let us get a feel for how people actually use > .oindex/.vindex. Then we can talk about deprecation. This NEP gets my > enthusiastic approval,

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 3:50 AM Sebastian Berg wrote: > > On Tue, 2018-06-26 at 02:27 -0700, Robert Kern wrote: > > On Tue, Jun 26, 2018 at 1:36 AM Sebastian Berg > s.net> wrote: > > > On Tue, 2018-06-26 at 01:21 -0700, Robert Kern wrote: > > > > On Tue, Jun 26, 2018 at 12:58 AM Sebastian Berg >

Re: [Numpy-discussion] rackspace ssl certificates

2018-06-26 Thread Matthew Brett
Hi, On Tue, Jun 26, 2018 at 10:43 PM, Matti Picus wrote: > On 19/06/18 10:57, Matthew Brett wrote: >> >> Hi, >> >> On Tue, Jun 19, 2018 at 6:27 PM, Matti Picus >> wrote: >>> >>> On 19/06/18 09:58, Charles R Harris wrote: > > What I was curious about is that there were no more "daily" bui

Re: [Numpy-discussion] rackspace ssl certificates

2018-06-26 Thread Matti Picus
On 19/06/18 10:57, Matthew Brett wrote: Hi, On Tue, Jun 19, 2018 at 6:27 PM, Matti Picus wrote: On 19/06/18 09:58, Charles R Harris wrote: What I was curious about is that there were no more "daily" builds of master. Is that right? That there were daily builds of master, on Appveyor? I don'

Re: [Numpy-discussion] Allowing broadcasting of code dimensions in generalized ufuncs

2018-06-26 Thread Marten van Kerkwijk
Hi All, Matti asked me to make a PR accepting my own NEP - https://github.com/numpy/numpy/pull/11429 Any objections? As noted in my earlier summary of the discussion, in principle we can choose to accept only parts, although I think it became clear that the most contentious is also the one argua

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Eric Wieser
We can expose some of the internals These could be expressed as methods on the internal indexing objects I proposed in the first reply to this thread, which has seen no responses. I think Hameer Abbasi is looking for something like OrthogonalIndexer(...).to_vindex() -> VectorizedIndexer such that

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Sebastian Berg
On Tue, 2018-06-26 at 04:01 -0400, Hameer Abbasi wrote: > I second this design. If we were to consider the general case of a > tuple `idx`, then we’d not be moving forward at all. Design changes > would be impossible. I’d argue that this newer model would be easier > for library maintainers overall

[Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Kevin Sheppard
This seems like progress and a clear method to outer indexing will help many users. As for names, I prefer .ox and .vx for shorthand of .oindex and .vindex. I don’t like the .ox_ or .o_ syntax. Before any deprecation warnings or any other warnings are added it would be helpful to have some wa

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Sebastian Berg
On Tue, 2018-06-26 at 02:27 -0700, Robert Kern wrote: > On Tue, Jun 26, 2018 at 1:36 AM Sebastian Berg s.net> wrote: > > On Tue, 2018-06-26 at 01:21 -0700, Robert Kern wrote: > > > On Tue, Jun 26, 2018 at 12:58 AM Sebastian Berg > > > wrote: > > > > > > > > > > > > > > Yes, that is true, but

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 1:36 AM Sebastian Berg wrote: > On Tue, 2018-06-26 at 01:21 -0700, Robert Kern wrote: > > On Tue, Jun 26, 2018 at 12:58 AM Sebastian Berg > > wrote: > > > > > > > > > Yes, that is true, but I doubt you will find a lot of code path > > > that > > > need the current indexi

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 1:49 AM Hameer Abbasi wrote: > > On 26. Jun 2018 at 10:33, Robert Kern wrote: > > > I'd suggest that the NEP explicitly disclaim deprecating current behavior. Let the NEP just be about putting the new features out there. Once we have some experience with them for a year or

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Hameer Abbasi
I would disagree here. For libraries like Dask, XArray, pydata/sparse, XND, etc., it would be bad for them if there was continued use of “weird” indexing behaviour (no warnings means more code written that’s… well… not exactly the best design). Of course, we could just choose to not support it. Bu

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Sebastian Berg
On Tue, 2018-06-26 at 04:23 -0400, Hameer Abbasi wrote: > > Boolean indices are not supported. All indices must be integers, > integer arrays or slices. > > I would hope that there’s at least some way to do boolean indexing. I > often find myself needing it. I realise that > `arr.vindex[np.nonzero

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Sebastian Berg
On Tue, 2018-06-26 at 01:21 -0700, Robert Kern wrote: > On Tue, Jun 26, 2018 at 12:58 AM Sebastian Berg > wrote: > > > > Yes, that is true, but I doubt you will find a lot of code path > > that > > need the current indexing as opposed to vindex here, > > That's probably true! But I think it's

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Hameer Abbasi
I actually had to think a lot, read docs, use SO and so on to realise what those meant the first time around, I didn’t understand them on sight. And I had to keep coming back to the docs from time to time as I wasn’t exactly using them too much (for exactly this reason, when some problems could be

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 1:26 AM Travis Oliphant wrote: > I like the proposal generally. NumPy could use a good orthogonal indexing > method and a vectorized-indexing method is fine too. > > Robert Kern is spot on with his concerns as well. Please do not change > what arr[idx] does except to pro

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Eric Wieser
Another thing I’d say is arr.?index should be replaced with arr.?idx. Or perhaps arr.o_[] and arr.v_[], to match the style of our existing np.r_, np.c_, np.s_, etc? ___ NumPy-Discussion mailing list NumPy-Discussion@python.org https://mail.python.org/mai

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Travis Oliphant
I like the proposal generally. NumPy could use a good orthogonal indexing method and a vectorized-indexing method is fine too. Robert Kern is spot on with his concerns as well. Please do not change what arr[idx] does except to provide warnings and perhaps point people to new .oix and .vix method

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Hameer Abbasi
> Boolean indices are not supported. All indices must be integers, integer arrays or slices. I would hope that there’s at least some way to do boolean indexing. I often find myself needing it. I realise that `arr.vindex[np.nonzero(boolean_idx)]` works, but it is slightly too verbose for my liking

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 12:58 AM Sebastian Berg wrote: > On Tue, 2018-06-26 at 17:30 +1000, Andrew Nelson wrote: > > On Tue, 26 Jun 2018 at 17:12, Eric Wieser > m> wrote: > > > > I don't think it should be relegated to the "officially > > > discouraged" ghetto of `.legacy_index` > > > > > > The

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Hameer Abbasi
I second this design. If we were to consider the general case of a tuple `idx`, then we’d not be moving forward at all. Design changes would be impossible. I’d argue that this newer model would be easier for library maintainers overall (who are the kind of people using this), reducing maintenance

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Sebastian Berg
On Tue, 2018-06-26 at 17:30 +1000, Andrew Nelson wrote: > On Tue, 26 Jun 2018 at 17:12, Eric Wieser m> wrote: > > > I don't think it should be relegated to the "officially > > discouraged" ghetto of `.legacy_index` > > > > The way I read it, the new spelling lof that would be the explicit > > but

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 12:46 AM Robert Kern wrote: > On Tue, Jun 26, 2018 at 12:13 AM Eric Wieser > wrote: > >> > I would reserve warnings for the cases where the current behavior is >> something no one really wants, like mixing slices and integer arrays. >> >> These are the cases that would on

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Robert Kern
On Tue, Jun 26, 2018 at 12:13 AM Eric Wieser wrote: > > I don't think it should be relegated to the "officially discouraged" > ghetto of `.legacy_index` > > The way I read it, the new spelling lof that would be the explicit but not > discouraged `image.vindex[rr, cc]`. > Okay, I missed that the

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Andrew Nelson
On Tue, 26 Jun 2018 at 17:12, Eric Wieser wrote: > > I don't think it should be relegated to the "officially discouraged" > ghetto of `.legacy_index` > > The way I read it, the new spelling lof that would be the explicit but not > discouraged `image.vindex[rr, cc]`. > If I'm understanding correc

Re: [Numpy-discussion] NEP 21: Simplified and explicit advanced indexing

2018-06-26 Thread Eric Wieser
> I don't think it should be relegated to the "officially discouraged" ghetto of `.legacy_index` The way I read it, the new spelling lof that would be the explicit but not discouraged `image.vindex[rr, cc]`. > I would reserve warnings for the cases where the current behavior is something no one r