Re: [DISCUSS][Python] Public Cython API

2021-10-28 Thread Eduardo Ponce
Hi all, I am helping resolve this GH issue [1] with this PR [2], where user wants to use `CRecordBatch.column_data()` method from Cython to access the underlying `CArrayData` but `column_data()` is not exposed in `CRecordBatch`. There is a workaround to access the `CArrayData` [3]. Nevertheless,

[Rust] 2021-10-28 Sync Notes

2021-10-28 Thread Andrew Lamb
Notes from the Arrow did our bi weekly sync [1] Attendees: Benson Muite Andrew Lamb QP Hou Remi Dettai Jordan Deitch Mtthew Turner Rich QP Discussed Datafusion 6.0.0 release * One blocking issue listed on [2] , please comment if there is anything else we should wait for * Hoping for a front page

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

2021-10-28 Thread Dominik Moritz
Hi Neal, Do we need a vote to make a 6.0.1 release or can we release a patch now? Cheers, Dominik On Oct 27, 2021 at 20:58:42, Neal Richardson wrote: > Looking ahead, is there anything we can add to CI and/or release > verification to catch things like this before the release? > > There

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

2021-10-28 Thread Dominik Moritz
https://issues.apache.org/jira/browse/ARROW-14508 and https://issues.apache.org/jira/browse/ARROW-14507. Instead of nightly releases, I think it would be awesome if we could make releases for (merged) pull requests as then one release would correspond to a change. But nightly releases would be

Re: [Discuss] Single offset per array has a non-trivial performance implication

2021-10-28 Thread Jörn Horstmann
Hi, On Wed, Oct 27, 2021 at 7:57 PM Antoine Pitrou wrote: > > This seems to assume that many or most arrays will have non-zero > offsets. Is this something that commonly happens in the Rust Arrow > world? In Arrow C++ I'm not sure non-zero offsets appear very frequently. > > Regards > >

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

2021-10-28 Thread Neal Richardson
Can you make a jira issue for this? Sounds like something that could be worked into the nightly builds, as we do for python wheels and conda packages already (and perhaps others). On Wed, Oct 27, 2021 at 9:43 PM Dominik Moritz wrote: > I think it would be good to make RC releases [1] for the

Re: [RUST] 6.0.0 Release Communication

2021-10-28 Thread Benson Muite
Andrew, Can write something over the weekend. Benson On 10/28/21 2:29 PM, Andrew Lamb wrote: Does anyone want to write up a blog post or more details on the 6.0.0 Rust Release? The 6.0.0 arrow blog post[1] is about to ship — I added a brief summary of the Rust content, but additional

[RUST] 6.0.0 Release Communication

2021-10-28 Thread Andrew Lamb
Does anyone want to write up a blog post or more details on the 6.0.0 Rust Release? The 6.0.0 arrow blog post[1] is about to ship — I added a brief summary of the Rust content, but additional content and feedback are welcome. In the past we have also done Rust specific release blog posts (e.g.