Re: [Discuss] [Rust] Arrow2/parquet2 going foward

I think it would also be fine to push “beta” arrow2 crates out of a repo under apache/ so long as they are not marked on crates.io as being Apache-official releases. There’s a possible slippery slope there, but as long as we are on a path to formalizing the releases I think it is okay. On Fri,

Re: Proposal to include JS bundle description fix in Arrow 5.0.1

Let's give it a few more days to see what other issues come up as more people install 5.0.0, then we can evaluate whether to do a general 5.0.1 patch release for all projects or if we should do something more targeted. A vote on source will be required either way, but we've taken steps to reduce

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Congrats Neville! On Fri, Jul 30, 2021 at 10:51 AM Andrew Lamb wrote: > Congratulations Neville, I look forward to (continuing) to work with you! > > Andrew > > On Fri, Jul 30, 2021 at 12:52 PM Chao Sun wrote: > > > Congrats Neville! > > > > On Fri, Jul 30, 2021 at 5:23 AM Krisztián Szűcs < >

Re: [Discuss] [Rust] Arrow2/parquet2 going foward

Jorge -- do you feel like we have a resolution on what to do with arrow2 in the near term? The current state of affairs seems to me that arrow2 is released from https://github.com/jorgecarleitao/arrow2 to crates.io (which is fine). Are you happy with keeping development in the jorgecarleitao

Re: [C++] Unable to getMutableValues from ArrayData

IPC reads do not return mutable buffers right now, so Buffer::mutable_data will return nullptr. You need to use Buffer::Copy https://github.com/apache/arrow/blob/master/cpp/src/arrow/buffer.h#L251 You could potentially use const_cast to get a mutable pointer to a buffer returned by IPC reads,

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Congratulations Neville, I look forward to (continuing) to work with you! Andrew On Fri, Jul 30, 2021 at 12:52 PM Chao Sun wrote: > Congrats Neville! > > On Fri, Jul 30, 2021 at 5:23 AM Krisztián Szűcs > > wrote: > > > Congrats Neville! > > > > On 2021. Jul 30., Fri at 13:14, Rok Mihevc

Re: [C++] Unable to getMutableValues from ArrayData

Hi Rares, ArrayData::GetMutableValues would return a nullptr if the requested buffer is not available. https://github.com/apache/arrow/blob/557a7c63d49aa04508564517c77c71f3657d19ff/cpp/src/arrow/array/data.h#L199 What does nAtts stand for? could it be that it is OOB? On Fri, Jul 30, 2021 at

Proposal to include JS bundle description fix in Arrow 5.0.1

Hi all, We introduced a regression in Arrow that sometimes leads JS code bundlers to emitting code that is missing some functionality. We have a patch for this problem in https://github.com/apache/arrow/pull/10826 that is now in master. I would like to propose to release Arrow JS 5.0.1 with this

[C++] Unable to getMutableValues from ArrayData

Hello, I have a RecordBatch that I read from an IPC file. I need to run a cumulative sum on one of the int64 arrays in the batch. I tried to do: std::shared_ptr pos_data = batch->column_data(nAtts); auto pos_values = pos_data->GetMutableValues(1); for (auto i = 1; i < pos_data->length; i++)

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Congrats Neville! On Fri, Jul 30, 2021 at 5:23 AM Krisztián Szűcs wrote: > Congrats Neville! > > On 2021. Jul 30., Fri at 13:14, Rok Mihevc wrote: > > > Congrats Neville! > > > > On Fri, Jul 30, 2021 at 12:52 PM Neville Dipale > > wrote: > > > > > > Thank you everyone :) > > > > > > On Fri,

Re: [DISCUSS] What tools go in the Arrow toolbox (i.e. git repo)

I'd like to add some other criteria here (agree with the ones proposed already): - for large net new contributions they are discussed first (if authors aren't familiar with the ml doing it concurrently with the pr) and someone has to be willing to review them. - original authors are willing to

Re: [C++][Discuss] Representing null union scalars

> > It's worth noting that convention 1 doesn't round trip > Note that https://github.com/apache/arrow/pull/10817 should hopefully > fix this by adding a `type_code` field to UnionScalar. We'd need to add a special case to MakeArrayFromScalar, which currently uses MakeArrayOfNull if

Re: [DISCUSS] What tools go in the Arrow toolbox (i.e. git repo)

On Fri, Jul 30, 2021 at 4:58 AM Antoine Pitrou wrote: > > > Le 29/07/2021 à 23:01, Weston Pace a écrit : > > In reviewing the RADOS PR (which I think is very cool) I am running > > into some interesting questions that might be good to flesh out here. > > > > The first of which is related to the

Re: [VOTE][RUST] Release Apache Arrow Rust 5.1.0 RC1

+1 I ran this on Intel macOS Catalina: ./dev/release/verify-release-candidate.sh 5.1.0 1 Got "Release candidate looks good!". Thanks. Sutou Kouhei 于 2021年7月30日周五 上午8:14写道： > +1 > > I ran the following command line on Debian GNU/Linux sid: > > dev/release/verify-release-candidate.sh 5.1.0 1

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Congrats Neville! On 2021. Jul 30., Fri at 13:14, Rok Mihevc wrote: > Congrats Neville! > > On Fri, Jul 30, 2021 at 12:52 PM Neville Dipale > wrote: > > > > Thank you everyone :) > > > > On Fri, 30 Jul 2021 at 12:38, David Li wrote: > > > > > Congrats, Neville! > > > > > > -David > > > > > >

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Congrats Neville! On Fri, Jul 30, 2021 at 12:52 PM Neville Dipale wrote: > > Thank you everyone :) > > On Fri, 30 Jul 2021 at 12:38, David Li wrote: > > > Congrats, Neville! > > > > -David > > > > On Fri, Jul 30, 2021, at 02:23, Daniël Heres wrote: > > > Congrats Neville! > > > > > > On Fri,

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Thank you everyone :) On Fri, 30 Jul 2021 at 12:38, David Li wrote: > Congrats, Neville! > > -David > > On Fri, Jul 30, 2021, at 02:23, Daniël Heres wrote: > > Congrats Neville! > > > > On Fri, Jul 30, 2021, 08:21 Jorge Cardoso Leitão < > jorgecarlei...@gmail.com> > > wrote: > > > > >

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Congrats, Neville! -David On Fri, Jul 30, 2021, at 02:23, Daniël Heres wrote: > Congrats Neville! > > On Fri, Jul 30, 2021, 08:21 Jorge Cardoso Leitão > wrote: > > > Congratulations, Neville :) > > > > On Fri, Jul 30, 2021 at 8:18 AM QP Hou wrote: > > > > > Well deserved, congratulations

Re: [DISCUSS] What tools go in the Arrow toolbox (i.e. git repo)

Le 29/07/2021 à 23:01, Weston Pace a écrit : In reviewing the RADOS PR (which I think is very cool) I am running into some interesting questions that might be good to flesh out here. The first of which is related to the scope of the Github repo. For context the RADOS PR introduces a Ceph

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Congrats Neville! On Fri, Jul 30, 2021, 08:21 Jorge Cardoso Leitão wrote: > Congratulations, Neville :) > > On Fri, Jul 30, 2021 at 8:18 AM QP Hou wrote: > > > Well deserved, congratulations Neville! > > > > On Thu, Jul 29, 2021 at 3:20 PM Wes McKinney > wrote: > > > > > > The Project

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Congratulations, Neville :) On Fri, Jul 30, 2021 at 8:18 AM QP Hou wrote: > Well deserved, congratulations Neville! > > On Thu, Jul 29, 2021 at 3:20 PM Wes McKinney wrote: > > > > The Project Management Committee (PMC) for Apache Arrow has invited > > Neville Dipale to become a PMC member and

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Well deserved, congratulations Neville! On Thu, Jul 29, 2021 at 3:20 PM Wes McKinney wrote: > > The Project Management Committee (PMC) for Apache Arrow has invited > Neville Dipale to become a PMC member and we are pleased to announce > that Neville has accepted. > > Congratulations and welcome!