Re: [VOTE] Remove compute from Arrow JS

2021-11-02 Thread Micah Kornfield
I'd suggest maybe two things: 1. If possible add deprecation warnings for the next release, and delete the release after (we don't have a formal policy but if would be good to give user heads up before out-right deletion). 2. If 1 isn't an option then please add something to the 6.0.0 release

Re: Arrow in HPC

2021-11-02 Thread Jed Brown
"David Li" writes: > Thanks for the clarification Yibo, looking forward to the results. Even if it > is a very hacky PoC it will be interesting to see how it affects performance, > though as Keith points out there are benefits in general to UCX (or similar > library), and we can work out the

Re: [VOTE] Remove compute from Arrow JS

2021-11-02 Thread Dominik Moritz
+1 from me as well. That brings us to 3 times +1 and no -1 or +0. Thank you, all. We will remove the compute code in the next Arrow version. On Nov 2, 2021 at 16:12:02, Paul Taylor wrote: > +1 from me as well > > On Oct 27, 2021, at 6:58 PM, Brian Hulette wrote: > >  > +1 > > I don't think

Re: [VOTE] Remove compute from Arrow JS

2021-11-02 Thread Paul Taylor
+1 from me as well > On Oct 27, 2021, at 6:58 PM, Brian Hulette wrote: > >  > +1 > > I don't think there's much reason to keep the compute code around when > there's a more performant, easier to use alternative. I think the only unique > feature of the arrow compute code was the ability to

RE: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

2021-11-02 Thread Matthew Topol
The patch to the release-6.0.0 branch to fix the Go issue has been merged and is ready for a 6.0.1 release once everything else is. --Matt -Original Message- From: Ian Cook Sent: Friday, October 29, 2021 11:48 AM To: dev@arrow.apache.org Subject: Re: [VOTE][RESULT] Release Apache

Re: Synergies with Apache Avro?

2021-11-02 Thread Micah Kornfield
> > Wrt to row iterations and native rows: my understanding is that even > though most Avro APIs present themselves as iterators of rows, internally > they read a whole compressed serialized block into memory, decompress it, > and then deserialize item by item into a row ("read block -> decompress

RE: Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

2021-11-02 Thread Daijiro Fukuda
I have created Homebrew packages PR (12). daipom 1. [done] bump version numbers 2. [done] upload source 3. [done] upload binaries 4. [done] update website 5. [depends-on-brew] upload ruby gems 6. [done] upload js packages 8. [done] upload C# packages 10. [in-pr] update conda recipes 11. [done]

Re: Who monitors the Github Actions Cron jobs?

2021-11-02 Thread Krisztián Szűcs
Agree, we should move them to crossbow. On Mon, Nov 1, 2021 at 10:01 PM Sutou Kouhei wrote: > > +1 > > In <20211101160628.6f5de9d0@fsol> > "Who monitors the Github Actions Cron jobs?" on Mon, 1 Nov 2021 16:06:28 > +0100, > Antoine Pitrou wrote: > > > > > Hello, > > > > It appears the C++

Re: Synergies with Apache Avro?

2021-11-02 Thread Jorge Cardoso Leitão
Thank you all for all your comments. The first comments: thanks a lot for your suggestions. I tried with mimalloc and there is indeed a -25% improvement for avro-rs. =) This sentence is a little bit hard to parse. Is a row of 3 strings or a > row of 1 string consisting of 3 bytes? Was the

Re: [VOTE][RUST] Release Apache Arrow Rust 6.1.0 RC1

2021-11-02 Thread Andrew Lamb
A defect in the changelog [1] for 6.1.0 RC1 has been discovered. Since this release has not yet been approved / released, are there any opinions on creating a new release candidate or releasing the RC1 candidate? Thanks, Andrew [1] https://github.com/apache/arrow-rs/pull/905 On Sun, Oct 31,