Re: New Pandas-Apache repo

2023-01-27 Thread Adesola Adedewe
Thanks for taking the time for reviewing . It work great for my use-case, as i am doing a one shot loading and data manipulation on big data. And the data is basically immutable for the rest of the lifetime of the process, just read. but i know from testing and benchmarking that it is limited by th

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 17.0.0 RC2

2023-01-27 Thread L. C. Hsieh
+1 (binding) Verified on Intel Mac. Thanks Andy! On Fri, Jan 27, 2023 at 9:50 AM Andrew Lamb wrote: > > +1 > > I reviewed the release notes and ran the script -- thanks Andy! > > On Fri, Jan 27, 2023 at 11:21 AM Andy Grove wrote: > > > Hi, > > > > I would like to propose a release of Apache Ar

Re: [Discuss] C++ query builder/execution API

2023-01-27 Thread Weston Pace
+1 to what Ian said. I'll also add, as was brought up in the earlier pandas API discussion, that a blog post (once you've got something ready to use) would be a good idea. > On the other hand, making such an interface readily available alongside > `libarrow` could increase the adoption of Arrow

Re: New Pandas-Apache repo

2023-01-27 Thread Weston Pace
The new kernels are interesting. There has been some ask recently[1] for weighted averages and I think you have some of the pieces (if not all of it) here. We also recently plumbed in support for binary aggregates into Acero[2] so having more binary aggregate kernels would be nice. Outside of th

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 17.0.0 RC2

2023-01-27 Thread Andrew Lamb
+1 I reviewed the release notes and ran the script -- thanks Andy! On Fri, Jan 27, 2023 at 11:21 AM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > version 17.0.0. > > This release candidate is based on commit: > fbff8e27630bef42d3700

Re: [VOTE][RUST] Release Apache Arrow Rust 32.0.0 RC1

2023-01-27 Thread L. C. Hsieh
+1 (binding) Looks good. Verified on M1 Mac. Thank you! On Fri, Jan 27, 2023 at 8:52 AM Andrew Lamb wrote: > > +1 > > I reviewed the changlog (lots of great stuff) and verified the signature > and ran the verification script > > Thank you > > On Fri, Jan 27, 2023 at 11:34 AM Raphael Taylor-Davi

Re: [Discuss] C++ query builder/execution API

2023-01-27 Thread Ian Cook
Hi Shoumyo, This is exciting—thank you for the thoughtfulness you have put into this proposal. This topic of a C++ dataframe API for Arrow-native engine(s) has come up in the past [3], but the bulk of the previous discussion about this predated Substrait. With the Substrait project now quickly ga

Re: [VOTE][RUST] Release Apache Arrow Rust 32.0.0 RC1

2023-01-27 Thread Andrew Lamb
+1 I reviewed the changlog (lots of great stuff) and verified the signature and ran the verification script Thank you On Fri, Jan 27, 2023 at 11:34 AM Raphael Taylor-Davies wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 32.0.0. > > This releas

[VOTE][RUST] Release Apache Arrow Rust 32.0.0 RC1

2023-01-27 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 32.0.0. This release candidate is based on commit: 53a650a5daa5e7a181852b8a0cde9fe8fe66b9a7 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please downloa

[VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 17.0.0 RC2

2023-01-27 Thread Andy Grove
Hi, I would like to propose a release of Apache Arrow DataFusion Implementation, version 17.0.0. This release candidate is based on commit: fbff8e27630bef42d3700538af5abb5454cba1c6 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download

Re: [RESULT][VOTE] Release Apache Arrow 11.0.0 - RC0

2023-01-27 Thread Neal Richardson
Conda often happens automatically; looks like there is already a PR: https://github.com/conda-forge/arrow-cpp-feedstock/pull/941 On Fri, Jan 27, 2023 at 9:52 AM Raúl Cumplido wrote: > Hi, > > The current status of the post-release tasks. I will keep working on the > rest of tasks during the next

Re: [RESULT][VOTE] Release Apache Arrow 11.0.0 - RC0

2023-01-27 Thread Raúl Cumplido
Hi, The current status of the post-release tasks. I will keep working on the rest of tasks during the next days: - [done] Update the released milestone Date and set to "Closed" on GitHub - [done] Merge changes on release branch to maintenance branch for patch releases - [done] Add the new release