Re: 4.0 release preparation

2021-04-13 Thread Micah Kornfield
I'll try to take a look tonight but it might be tight if there is substantial feedback. On Tue, Apr 13, 2021 at 5:29 PM Wes McKinney wrote: > I agree it would be good to get the ORC writer in this release. > > On Tue, Apr 13, 2021 at 7:20 PM Ying Zhou wrote: > > > > What about this one? You

Re: [DISCUSS] [Rust] Move Rust components to new repos and process

2021-04-13 Thread Andy Grove
There has been a lot of discussion both in this email thread and in comments in the Google document and all the comment threads in the document have been resolved. Is there more work that needs to happen in the proposal before we go to a vote, or do we have enough detail for us to move forward

Re: 4.0 release preparation

2021-04-13 Thread Wes McKinney
I agree it would be good to get the ORC writer in this release. On Tue, Apr 13, 2021 at 7:20 PM Ying Zhou wrote: > > What about this one? You know, the C++/Python ORC writer. > https://github.com/apache/arrow/pull/8648 > > > Ying > > On Apr 13, 2021,

Re: 4.0 release preparation

2021-04-13 Thread Ying Zhou
What about this one? You know, the C++/Python ORC writer. https://github.com/apache/arrow/pull/8648 Ying > On Apr 13, 2021, at 12:52 PM, Neal Richardson > wrote: > > I think we're getting close to closing out 4.0. Let's give until the end of >

Arrow sync call April 14 at 12:00 US/Eastern, 16:00 UTC

2021-04-13 Thread Neal Richardson
Hi all, Our biweekly call is coming up tomorrow at https://meet.google.com/vtm-teks-phx. All are welcome to join. Notes will be shared with the mailing list afterward. Neal

Re: [Github] @mentions in commits.

2021-04-13 Thread Andrew Lamb
Wow this is great news. I had been getting overwhelmed with similar notifications over the last few days. On Tue, Apr 13, 2021 at 5:13 PM Wes McKinney wrote: > Thanks, Diana! > > On Tue, Apr 13, 2021 at 4:06 PM Diana Clarke > wrote: > > > > I've resolved the following ticket, as GitHub says

Re: [Github] @mentions in commits.

2021-04-13 Thread Wes McKinney
Thanks, Diana! On Tue, Apr 13, 2021 at 4:06 PM Diana Clarke wrote: > > I've resolved the following ticket, as GitHub says the notification > bug has been fixed. > > [Developer] Remove @-mentions from commit messages in merge tool > https://issues.apache.org/jira/browse/ARROW-12280 > >

Re: [Github] @mentions in commits.

2021-04-13 Thread Neal Richardson
Thanks for staying on top of this, Diana! Neal On Tue, Apr 13, 2021 at 2:06 PM Diana Clarke wrote: > I've resolved the following ticket, as GitHub says the notification > bug has been fixed. > > [Developer] Remove @-mentions from commit messages in merge tool >

Re: [Github] @mentions in commits.

2021-04-13 Thread Diana Clarke
I've resolved the following ticket, as GitHub says the notification bug has been fixed. [Developer] Remove @-mentions from commit messages in merge tool https://issues.apache.org/jira/browse/ARROW-12280 --diana On Sun, Apr 11, 2021 at 10:56 PM Diana Clarke wrote: > > I don't think we

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

2021-04-13 Thread David Li
Hi Tiffany, I was just curious about the status of the FlightSQL proposal. Given that the 4.0.0 development cycle will be concluding soon, it doesn't seem FlightSQL will make it, but is there interest in trying to get it into 5.0.0? Similarly, there was the related effort to expand Flight's auth

Re: [INFO_REQUEST][FLIGHT] - Dynamic schema changes in ArrowFlight streams

2021-04-13 Thread Nate Bauernfeind
> possibly in coordination with the Deephaven/Barrage team, if they're also still interested Good opportunity for me to chime in =). I think we still have interest in this feature. On the other thread, it took a little cajoling, but I've come around to agree with the conclusions of taking a

Re: 4.0 release preparation

2021-04-13 Thread Neal Richardson
I think we're getting close to closing out 4.0. Let's give until the end of Wednesday to get any outstanding pull requests reviewed and merged, and Krisztián will plan to cut a release candidate on Thursday. If there are any objections, please speak up! Neal On Sun, Apr 11, 2021 at 9:15 AM

Re: [Rust] [DataFusion] Proposal for datafusion test reorganization

2021-04-13 Thread Daniël Heres
Late reply, but I agree these tests modules need a bit of reorganization. I also found myself adding tests to context.rs / sql.rs just because related/similar tests are included there. Sounds like a good reorganization to me! On Fri, Apr 9, 2021, 20:44 Andrew Lamb wrote: > As Jorge points out

Re: [INFO_REQUEST][FLIGHT] - Dynamic schema changes in ArrowFlight streams

2021-04-13 Thread David Li
Thanks for the details. I'll note a few things, but adding schema evolution to Flight is reasonable, if you'd like to put together a proposal for discussion (possibly in coordination with the Deephaven/Barrage team, if they're also still interested). >3. Assume that there is a strong reason

Re: [Website] Blog post announcing Ballista donation

2021-04-13 Thread Andy Grove
The blog post is now live. Thanks for the feedback on the PR. If any edits are needed, please let me know (or go ahead and PR them on the arrow-site repo). https://arrow.apache.org/blog/2021/04/12/ballista-donation/ On Sun, Apr 11, 2021 at 11:46 AM Andy Grove wrote: > I took the first pass at

Re: [INFO_REQUEST][FLIGHT] - Dynamic schema changes in ArrowFlight streams

2021-04-13 Thread Gosh Arzumanyan
Hi David, Thanks for sharing the link! Here is how a potential use case might look like: 1. Assume that we have a service S which accepts expressions in some language X. 2. Assume that a typical query to this service requests entities A_1, A_2,..,A_K. Each of those entities

Re: Standard/Reserved Metadata keys

2021-04-13 Thread Joris Van den Bossche
On Thu, 8 Apr 2021 at 19:52, Micah Kornfield wrote: > 1. Do the standard libraries handle that metadata key automatically ? > > C++, Python and Java have facilities to support them automatically > (extensions needs to register themselves), I'm not sure about other > languages. > > 2. Are there