Re: Add a UUID type to the Arrow format

2018-02-15 Thread Wes McKinney
hi Uwe, This seems like a good idea to me given the widespread use of UUIDs, and would make use more natural for application developers. - Wes On Tue, Feb 13, 2018 at 10:03 AM, Uwe L. Korn wrote: > Hello, > > I just opened https://issues.apache.org/jira/browse/ARROW-2152 to

Re: indicating an error during a streaming response

2018-02-15 Thread Wes McKinney
hi Ben, The stream writer and reader classes that exist now are fairly primitive. We've been discussing a richer RPC protocol using http2 or GRPC that would permit more nuanced control messages, errors, and other. This would be a great area for new members of the dev community to make some

Re: Decimal NaNs

2018-02-15 Thread Wes McKinney
hey Phillip, Replying so we have a record on the mailing list about this. For the user's use case, it seems that having reasonable null support for decimals incoming from Python would be sufficient. I agree it's probably not worth supporting NaN decimals in the Arrow format for now given the

Re: Making the next JavaScript Arrow release

2018-02-15 Thread Brian Hulette
Wes, We're still working on generated API documentation (ARROW-951), but that doesn't need to hold up the release. I also just opened one more small PR, but once we merge the two open JS PRs I think we're ready for a release vote. Brian On 02/15/2018 04:53 PM, Wes McKinney wrote: hi

Making the next JavaScript Arrow release

2018-02-15 Thread Wes McKinney
hi folks, With all the work that's happened in JavaScript, my understanding from Slack and GitHub conversations is that we'd like to do a JS-0.3.0 and get updates published thereafter to NPM. I see there's an open PR at the moment -- anything else that needs to get done before I kick off a

[jira] [Created] (ARROW-2165) enhance AllocatorListener to listen for child allocator addition and removal

2018-02-15 Thread Vanco Buca (JIRA)
Vanco Buca created ARROW-2165: - Summary: enhance AllocatorListener to listen for child allocator addition and removal Key: ARROW-2165 URL: https://issues.apache.org/jira/browse/ARROW-2165 Project: Apache

Re: Arrow for MATLAB?

2018-02-15 Thread Wes McKinney
hi Nick, I would strongly encourage you to focus your energies on supporting the general Arrow streaming and file formats as described in http://arrow.apache.org/docs/ipc.html. It's fine to support Feather, so long as you restrict yourself to the API defined in

[jira] [Created] (ARROW-2164) [C++] Clean up unnecessary decimal module refs

2018-02-15 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2164: Summary: [C++] Clean up unnecessary decimal module refs Key: ARROW-2164 URL: https://issues.apache.org/jira/browse/ARROW-2164 Project: Apache Arrow Issue

[jira] [Created] (ARROW-2163) Install apt dependencies separate from built-in Travis commands, retry on flakiness

2018-02-15 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2163: --- Summary: Install apt dependencies separate from built-in Travis commands, retry on flakiness Key: ARROW-2163 URL: https://issues.apache.org/jira/browse/ARROW-2163

Re: Arrow for MATLAB?

2018-02-15 Thread Nick Haddad
Uwe and Joris, I work for MathWorks. We plan to contribute Feather read/write capability in the near future. Interesting idea about MATLAB and Arrow. We’ll take a look as well. Thanks -Nick On 2/14/18, 3:39 AM, "Joris Peeters" wrote: Yeah, pinging