Re: Help drafting Arrow 2022-01 board report

2022-01-12 Thread Wes McKinney
hi Kou, Yes, I will submit it. Thanks for collecting the information Wes On Tue, Jan 11, 2022 at 7:13 PM Sutou Kouhei wrote: > > Hi Wes, > > Could you submit the draft to ASF? > Thanks to everyone who help drafting this report. > > Thanks, > -- > kou > > In <20220106.094048.190616206847894889..

Re: Arrow streaming computation engine

2022-01-12 Thread Weston Pace
> Would appreciate it if you can give some pointers to how to > start playing with that code. I have a (somewhat) minimal example here: https://gist.github.com/westonpace/e555a3b1c269c31de7176d34f47a2fb0 The PR I mentioned earlier (https://github.com/apache/arrow/pull/12033) has more examples (tha

Re: Arrow streaming computation engine

2022-01-12 Thread Li Jin
Weston - Thanks for the pointer. The C++ streaming engine you pointed out is a lot like what I have in mind. Will take a close look at that. Would appreciate it if you can give some pointers to how to start playing with that code. Hou - Glad to hear that the DataFusion community has similar ideas.

[Rust][DataFusion][DISCUSS] DataFusion Resource(Memory + Disk) API

2022-01-12 Thread Andrew Lamb
Greetings fellow Rustaceans, I wanted to bring some extra attention to a PR[1] contributed by Yijie Shen that adds an initial resource management API to datafusion. While the implementation will likely undergo the normal iteration, iterating on the APIs will likely be more disruptive. Thus I woul

Re: [DISCUSS] Adding new columnar memory layouts to Arrow (in-memory, IPC, C ABI)

2022-01-12 Thread Andrew Lamb
I also agree that splitting the StringView proposal into its own thing would be beneficial for discussion clarity On Wed, Jan 12, 2022 at 5:34 AM Antoine Pitrou wrote: > > Le 12/01/2022 à 01:49, Wes McKinney a écrit : > > hi all, > > > > Thank you for all the comments on this mailing list thread

[RESULT] [VOTE][RUST] Release Apache Arrow Rust 7.0.0 RC1

2022-01-12 Thread Andrew Lamb
With 3 +1 votes, the release is approved It is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-rs-7.0.0 It has also been uploaded to crates.io: https://crates.io/crates/arrow/7.0.0 https://crates.io/crates/arrow-flight/7.0.0 https://crates.io/crates/parquet/7.0.0 https://cr

Re: [DISCUSS] Adding new columnar memory layouts to Arrow (in-memory, IPC, C ABI)

2022-01-12 Thread Antoine Pitrou
Le 12/01/2022 à 01:49, Wes McKinney a écrit : hi all, Thank you for all the comments on this mailing list thread and in the Google document. There is definitely a lot of work to take some next steps from here, so I think it would make sense to fork off each of the proposed additions into dedic