Re: [Rust] [Discuss] proposal to redesign Arrow crate to resolve safety violations

2021-07-09 Thread Jorge Cardoso Leitão
Thanks a lot Wes, I am not sure how to proceed from here: 1. how do we generate the html from the xml? I.e. https://incubator.apache.org/ip-clearance/arrow-rust-ballista.html 2. how do I trigger the the process to start? can I just email the incubator with the proposal? Best, Jorge On Mon,

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-09 Thread Neal Richardson
Congrats Weston! On Fri, Jul 9, 2021 at 11:53 AM Micah Kornfield wrote: > Congrats! > > On Fri, Jul 9, 2021 at 7:56 AM Benjamin Kietzman > wrote: > > > Congrats! > > > > On Fri, Jul 9, 2021, 08:48 Wes McKinney wrote: > > > > > On behalf of the Arrow PMC, I'm happy to announce that Weston has

Re: [Rust] Preparing for the 5.0.0 release and the 5.x release line

2021-07-09 Thread Andrew Lamb
I have created a `release-blocker` label we can use to label issues: https://github.com/apache/arrow-rs/issues?q=is%3Aissue+is%3Aopen+label%3Arelease-blocker Adam Lippai pointed out https://github.com/apache/arrow-rs/issues/458 as another one that would be nice to fix On Fri, Jul 9, 2021 at 7:55

Re: Apache Arrow Cookbook

2021-07-09 Thread Wes McKinney
Some benefits of separating the cookbook from the documentation would be to decouple its release / publication from Arrow releases, so you can roll out new content to the published version as soon as it's merged into the repository, where in the same fashion we might not want to publish

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-09 Thread Micah Kornfield
Congrats! On Fri, Jul 9, 2021 at 7:56 AM Benjamin Kietzman wrote: > Congrats! > > On Fri, Jul 9, 2021, 08:48 Wes McKinney wrote: > > > On behalf of the Arrow PMC, I'm happy to announce that Weston has > accepted > > an > > invitation to become a committer on Apache Arrow. Welcome, and thank

Re: [DISCUSS] Binary Values in Key value pairs WAS: Re: [INFO_REQUEST][FLIGHT] - Dynamic schema changes in ArrowFlight streams

2021-07-09 Thread Wes McKinney
The cost of an empty vector in Flatbuffers appears to be 4 bytes. On Wed, Jul 7, 2021 at 5:50 PM Micah Kornfield wrote: > > Retitling and forking the discussion to talk about key value pairs. > > What is the byte cost of an empty list? Another option would be to > introduce a new BinaryKeyValue

Re: [INFO_REQUEST][FLIGHT] - Dynamic schema changes in ArrowFlight streams

2021-07-09 Thread Wes McKinney
It sounds like we may want to discuss some potential evolutions of the Arrow binary protocol (for example: new Message types). Certainly a can of worms but rather than trying to bolt some new functionality onto the existing structures, it might be better to support the new use cases through some

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-09 Thread Benjamin Kietzman
Congrats! On Fri, Jul 9, 2021, 08:48 Wes McKinney wrote: > On behalf of the Arrow PMC, I'm happy to announce that Weston has accepted > an > invitation to become a committer on Apache Arrow. Welcome, and thank you > for your contributions! > > Wes >

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-09 Thread Yibo Cai
Congrats Weston! From: Wes McKinney Sent: Friday, July 9, 2021 8:47 PM To: dev Subject: [ANNOUNCE] New Arrow committer: Weston Pace On behalf of the Arrow PMC, I'm happy to announce that Weston has accepted an invitation to become a committer on Apache Arrow.

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-09 Thread Rok Mihevc
Congrats Weston! On Fri, Jul 9, 2021 at 3:44 PM Nic wrote: > > Congrats Weston! :) > > On Fri, 9 Jul 2021 at 14:43, Eduardo Ponce wrote: > > > Congratulations Weston and thanks for your hard work! > > > > ~Eduardo > > > > ~Eduardo > > > > > > From: David Li > >

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-09 Thread Nic
Congrats Weston! :) On Fri, 9 Jul 2021 at 14:43, Eduardo Ponce wrote: > Congratulations Weston and thanks for your hard work! > > ~Eduardo > > ~Eduardo > > > From: David Li > Sent: Friday, July 9, 2021 9:14:19 AM > To: dev@arrow.apache.org > Subject: Re:

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-09 Thread Eduardo Ponce
Congratulations Weston and thanks for your hard work! ~Eduardo ~Eduardo From: David Li Sent: Friday, July 9, 2021 9:14:19 AM To: dev@arrow.apache.org Subject: Re: [ANNOUNCE] New Arrow committer: Weston Pace Congrats Weston! On Fri, Jul 9, 2021, at 08:47, Wes

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-09 Thread David Li
Congrats Weston! On Fri, Jul 9, 2021, at 08:47, Wes McKinney wrote: > On behalf of the Arrow PMC, I'm happy to announce that Weston has accepted an > invitation to become a committer on Apache Arrow. Welcome, and thank you > for your contributions! > > Wes >

[ANNOUNCE] New Arrow committer: Weston Pace

2021-07-09 Thread Wes McKinney
On behalf of the Arrow PMC, I'm happy to announce that Weston has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! Wes

Re: Distributing the Arrow C++ library through vcpkg

2021-07-09 Thread Wes McKinney
hi Ian, Thank you for driving this effort — I agree that having the vcpkg installation path maintained by the Arrow community will help yield a more consistent experience for users of the libraries, similar to Homebrew and other packages we maintain. As an aside, and speaking of documenting the

[Rust] Preparing for the 5.0.0 release and the 5.x release line

2021-07-09 Thread Andrew Lamb
I plan to create a 5.0.0 arrow-rs release candidate (from master) early next week,. The 5.0 release will include breaking API changes Here is the list of issues I think are blockers: * https://github.com/apache/arrow-rs/issues/529 * https://github.com/apache/arrow-rs/issues/463 (improved