Re: Null buffer spec incompatibility between arrow2 and arrow-C++

2023-08-02 Thread Anja
Oh, thank you! It is true that I thought arrow2 was the one that was incorrect, but when I saw the low activity on recent issues, I assumed it was a project with lower maintenance capacities. Thank you for pointing out [3]! On Wed, 2 Aug 2023 at 10:09, Raphael Taylor-Davies wrote: > Hi Anja, >

Re: [DISCUSS] Canonical alternative layout proposal

2023-08-02 Thread Weston Pace
> I would welcome a draft PR showcasing the changes necessary in the IPC > format definition, and in the C Data Interface specification (no need to > actually implement them for now :-)). I've proposed something at [1]. > One sketch of an idea: define sets of types that we can call “kinds”** >

Re: Null buffer spec incompatibility between arrow2 and arrow-C++

2023-08-02 Thread Raphael Taylor-Davies
Hi Anja, I believe this was clarified in [1] with the addition of the following text to the standard >  The buffer pointers MAY be null only in two situations: > >   1. for the null bitmap buffer, if :c:member:`ArrowArray.null_count` is 0; >   2. for any buffer, if the size in bytes of the

Re: [VOTE] Release Apache Arrow 13.0.0 - RC2

2023-08-02 Thread Dane Pitkin
During the Arrow community meeting today, we decided to include the fix for the wide-dataframe performance regression due to its severity. The ETA is end-of-the-week for the patch. You can review the meeting notes here[1]. [1]

Null buffer spec incompatibility between arrow2 and arrow-C++

2023-08-02 Thread Anja
Hi! I opened two issues recently on a spec incompatibility between arrow2 and arrow-C++: https://github.com/apache/arrow/issues/36960 and https://github.com/jorgecarleitao/arrow2/issues/1524. Namely, there are situations where arrow-C++ will legally create a null buffer, and arrow2 does not

Re: [VOTE] Release Apache Arrow 13.0.0 - RC2

2023-08-02 Thread Austin Dickey
Hi all, We have generated a new report comparing the Python and R benchmark results from the contender 13.0.0 RC2 to the baseline 12.0.1 RC1 on the ursa-i9-9960x machine: http://crossbow.voltrondata.com/release_reports/arrow-release-report-13.0.0-rc2.html To dive deeper into the data, here is

[RESULT][VOTE][RUST] Release Apache Arrow Rust 45.0.0 RC1

2023-08-02 Thread Raphael Taylor-Davies
With 5 +1 votes (4 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-rs-45.0.0/ It has also been released to crates.io Thank you to everyone who helped verify this release On 01/08/2023 07:44, vin jake wrote: +1 (binding)

Arrow community meeting August 2 at 16:00 UTC

2023-08-02 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc:

Re: [VOTE] Release Apache Arrow 13.0.0 - RC2

2023-08-02 Thread Raúl Cumplido
Hi, As already shared on both Zulip and the Mailing list after creating RC 1 we found a couple of regressions on performance. One has been fixed and added as part of RC2 but the other is still in progress: https://github.com/apache/arrow/issues/36892 Based on conversations on Zulip it doesn't

[VOTE] Release Apache Arrow 13.0.0 - RC2

2023-08-02 Thread Raúl Cumplido
Hi, I would like to propose the following release candidate (RC2) of Apache Arrow version 13.0.0. This is a release consisting of 435 resolved JIRA issues[1]. This release candidate is based on commit: c604084e7c62747780f91d6f8419c47feb4b20fb [2] The source release rc2 is hosted at [3]. The