Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

I've got a fix[1] in for the verification script for C#. There are more details in the issue and the PR but IMO we are compatible with C#7 and C#6, we simply were not testing it correctly. I have run the tests locally with both 6.0 and 7.0 sdks and they passed. [1]

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

+1 (non binding) I had some verification tasks failing, but I guess it's normal and acceptable for a RC. I will take a deeper look during the weekend. Regards JB On Thu, Jan 19, 2023 at 11:06 AM Raúl Cumplido wrote: > > Hi, > > I would like to propose the following release candidate (RC0) of

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

I have investigated the issue of the system xsimd causing an error [1] and I don't think this should be a blocker as it can be circumvented by explicitly setting xsimd_SOURCE=BUNDLED. I don't think the incompatibility with C# 7 should be a blocker either, it should probably be documented that we

Re: Proposal: renaming the 'master' branch to 'main'

Thanks for moving this forward! In apache/arrow we have an umbrella issue [1] and I think we are at the point where we are ready to ask INFRA to rename the default branch to main. Thanks to Fiona and Kevin for their work on the hardcoded branch names in the dev tooling that was blocking this!

Re: [IPC] How to plugin a custom compression type?

Hi Rong, IMO, the purpose of IPC spec is for wide interoperability to ensure data can easily be interchanged. Therefore, I don't think we should be adding a pluggable codecs that can be used to write Arrow IPC files to the main repo. At the very least if we wanted to support custom codecs, we

Re: Proposal: renaming the 'master' branch to 'main'

yes, please! ——— Mauricio Vargas Sepulveda Master's Representative UofT Political Science From: Andy Grove Sent: January 19, 2023 2:44 PM To: dev@arrow.apache.org Subject: Re: Proposal: renaming the 'master' branch to 'main' I have filed issues in the

Re: Proposal: renaming the 'master' branch to 'main'

I have filed issues in the Arrow Rust repos (let me know if I missed any) https://github.com/apache/arrow-rs/issues/3569 https://github.com/apache/arrow-datafusion/issues/4994 https://github.com/apache/arrow-ballista/issues/618 https://github.com/apache/arrow-datafusion-python/issues/144 On

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

On a relatively fresh Ubuntu 22.04 without conda I had to apt install some libs (default-jdk maven libjemalloc-dev libgirepository1.0-dev libsqlite3-dev) and this passed fine: TEST_DEFAULT=0 TEST_SOURCE=1 dev/release/verify-release-candidate.sh +1 Rok On Thu, Jan 19, 2023 at 3:05 PM Raúl

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

Thanks Antoine, I can finally reproduce it. Thanks Jacob Wujciak for the pointer on the log, I couldn't find it: -- Building xsimd from source CMake Error at cmake_modules/ThirdpartyToolchain.cmake:2295 (add_library): add_library cannot create imported target "xsimd" because another target

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

I used the following command: LANG=C TEST_DEFAULT=0 TEST_CPP=1 ./dev/release/verify-release-candidate.sh 11.0.0 0 Here is the full output: https://gist.github.com/pitrou/3fdca2460fa71bba731b0706703b70b2 Regards Antoine. Le 19/01/2023 à 13:07, Raúl Cumplido a écrit : El jue, 19 ene

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

El jue, 19 ene 2023 a las 12:21, Antoine Pitrou () escribió: > > On Ubuntu 22.04, C++ source verification *without conda* fails because > it is attempting to find various libraries (re2, LLVM, rapidjson, etc.). > > Antoine, could you help me understand what the issue is here or how to reproduce

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

Thanks Antoine, It seems dotnet 7.0.0 was released in November and we never added new tasks for it [1]. I've tested locally on Ubuntu 22.04 with dotnet 6.0.202 successfully but can reproduce the same issue when I upgrade to 7.0.102. I've created an issue for it [2]. Thanks, Raúl [1]

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

On Ubuntu 22.04, C++ source verification *without conda* fails because it is attempting to find various libraries (re2, LLVM, rapidjson, etc.). C++ source verification succeeds with conda. Le 19/01/2023 à 11:06, Raúl Cumplido a écrit : Hi, I would like to propose the following release

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

On Ubuntu 22.04, C# verification fails: === Build and test C# libraries === └ Ensuring that C# is installed... └ Found C# at (.NET 7.0.102) ./dev/release/verify-release-candidate.sh: line 341: 28770 Segmentation fault dotnet tool install

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

Hi, I haven't run the verification tasks locally myself but I wanted to make people aware of this issue: https://github.com/apache/arrow/issues/15054 Which is causing some issues on some of the verification tasks. Thanks, Raúl El jue, 19 ene 2023 a las 11:06, Raúl Cumplido () escribió: > Hi,

[VOTE] Release Apache Arrow 11.0.0 - RC0

Hi, I would like to propose the following release candidate (RC0) of Apache Arrow version 11.0.0. This is a release consisting of 423 resolved GitHub issues[1]. This release candidate is based on commit: f10f5cfd1376fb0e602334588b3f3624d41dee7d [2] The source release rc0 is hosted at [3]. The

[IPC] How to plugin a custom compression type?

Hi all, We're using arrow IPC format for data transfer in our project. We have done some performance optimization by using a custom compression method to get better compression ratio and throughput. I've raised PR to add a pluggable custom codec,