Re: [VOTE][RUST] Release Apache Arrow Rust 17.0.0 RC1

2022-06-24 Thread QP Hou
+1 (binding) On Fri, Jun 24, 2022 at 7:36 PM Remzi Yang <1371656737...@gmail.com> wrote: > > +1 (non-binding). Verified on Mac M1. > Thanks Andrew. > > Remzi > > On Sat, 25 Jun 2022 at 09:33, Chao Sun wrote: > > > +1 (non-binding). Verified on Intel Mac. > > > > Thanks Andrew. > > > > On Fri,

Re: [VOTE][RUST] Release Apache Arrow Rust 17.0.0 RC1

2022-06-24 Thread Remzi Yang
+1 (non-binding). Verified on Mac M1. Thanks Andrew. Remzi On Sat, 25 Jun 2022 at 09:33, Chao Sun wrote: > +1 (non-binding). Verified on Intel Mac. > > Thanks Andrew. > > On Fri, Jun 24, 2022 at 5:17 PM L. C. Hsieh wrote: > > > > +1 (non-binding) > > > > Verified on Intel Mac. > > > > Thank

Re: [VOTE][RUST] Release Apache Arrow Rust 17.0.0 RC1

2022-06-24 Thread Chao Sun
+1 (non-binding). Verified on Intel Mac. Thanks Andrew. On Fri, Jun 24, 2022 at 5:17 PM L. C. Hsieh wrote: > > +1 (non-binding) > > Verified on Intel Mac. > > Thank you, Andrew. > > On Fri, Jun 24, 2022 at 5:00 PM Andy Grove wrote: > > > > +1 (binding) > > > > Verified on Ubuntu 20.04.4 LTS. >

Re: [VOTE][RUST] Release Apache Arrow Rust 17.0.0 RC1

2022-06-24 Thread L. C. Hsieh
+1 (non-binding) Verified on Intel Mac. Thank you, Andrew. On Fri, Jun 24, 2022 at 5:00 PM Andy Grove wrote: > > +1 (binding) > > Verified on Ubuntu 20.04.4 LTS. > > Thanks, Andrew. > > On Fri, Jun 24, 2022 at 2:45 PM Andrew Lamb wrote: > > > Hi, > > > > I would like to propose a release of

Re: [VOTE][RUST] Release Apache Arrow Rust 17.0.0 RC1

2022-06-24 Thread Andy Grove
+1 (binding) Verified on Ubuntu 20.04.4 LTS. Thanks, Andrew. On Fri, Jun 24, 2022 at 2:45 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 17.0.0. > > This release candidate is based on commit: >

[VOTE][RUST] Release Apache Arrow Rust 17.0.0 RC1

2022-06-24 Thread Andrew Lamb
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 17.0.0. This release candidate is based on commit: 9f7b6004d365b0c0bac8e30170b49bdd66cc7df0 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download,

Re: vectorized processing for arrow::take()

2022-06-24 Thread Chak-Pong Chung
Hi Aldrin, Use Case: I am taking a subset of a really large input_array. It is used in places where OpenMP-like and MPI-like parallelism are used. So vectorization seems to be the next low-hanging fruit. I have added this to the original stackoverflow post. On Thu, Jun 23, 2022 at 5:53 PM

Re: user-defined Python-based data-sources in Arrow

2022-06-24 Thread Weston Pace
+1 for me. What you are describing is a good idea and having different ways to provide sources, especially through Substrait and Python, is something we can very much use right away. I think we are probably pretty close to having the components you describe. I'm not quite sure I follow all of

Re: [question] Arrow C GLib conda package

2022-06-24 Thread Ivan Ogasawara
got it now! thanks for the explanation sure thing, I am working on that today. thanks!! On Fri, Jun 24, 2022 at 10:51 AM Sutou Kouhei wrote: > Hi, > > Sorry, no. I wanted to say we need a new repository for > Apache Arrow C GLib. If we mix Apache Arrow C++ and Apache > Arrow C GLib into >

Re: [question] Arrow C GLib conda package

2022-06-24 Thread Sutou Kouhei
Hi, Sorry, no. I wanted to say we need a new repository for Apache Arrow C GLib. If we mix Apache Arrow C++ and Apache Arrow C GLib into https://github.com/conda-forge/arrow-cpp-feedstock, all arrow-cpp users need to install Apache Arrow C GLib too. So we need a new repository for Apache Arrow C

Re: [question] Arrow C GLib conda package

2022-06-24 Thread Ivan Ogasawara
Hi Sutou, thanks for your answer. > something like https://github.com/conda-forge/arrow-cpp-feedstock for it. So you mean to create a new output on arrow-cpp-feedstock for Apache Arrow C GLib? I like the idea, it could be easy to maintain everything in just one place. If it is ok, I can start

[Datafusion] Streaming - integration with kafka - kafka_writer

2022-06-24 Thread Jaroslaw Nowosad
Hi, I am just trying to integrate datafusion with kafka, final goal is to have end-to-end streaming. But I started from a "different side" -> step 1 is to publish output to kafka, so I copied code/ created kafka publisher:

Re: user-defined Python-based data-sources in Arrow

2022-06-24 Thread Yaron Gvili
I'm using schema-carrying tabular data as a more general term than a RecordBatch stream. For example, an ExecBatch stream or a vector of equal-length Arrays plus associated schema is also good. The Python data-source node would be responsible for converting from the Python data-source function