Re: [VOTE] Release Apache Arrow 6.0.1 - RC0

-0.5 Unfortunately, I think ARROW-14620[1] might be blocking. It is a regression that was detected from StackOverflow[2] earlier today. There is not a great workaround for users that were using the pyarrow datasets for an 'append files' workflow (with a custom basename template). I just added a

Re: [VOTE] Release Apache Arrow 6.0.1 - RC0

+1 I ran the followings on Debian GNU/Linux sid: * LANG=C \ TZ=UTC \ ARROW_CMAKE_OPTIONS="-DBoost_NO_BOOST_CMAKE=ON" \ CUDA_TOOLKIT_ROOT=/usr \ dev/release/verify-release-candidate.sh source 6.0.1 0 * LANG=C \ PYTHON=python3 \ dev/release/verify-release-can

[VOTE] Release Apache Arrow 6.0.1 - RC0

Hi, I would like to propose the following release candidate (RC0) of Apache Arrow version 6.0.1. This is a release consisting of 19 resolved JIRA issues[1]. This release candidate is based on commit: 2233a108b212656464e02203b111c9b991d3c95d [2] The source release rc0 is hosted at [3]. The binary

Re: Create large IPC format record batch(es) in-place without copy or prior data analysis

Hi John, > > Any thoughts on creating large IPC format record batch(es) in-place in a > single pre-allocated buffer, that could be used with mmap? This seems doable today "by hand" today, it seems like this would be valuable to potentially contribute. The idea was to allow > record batch lengths

Re: [VOTE] Remove compute from Arrow JS

> > I added a note to the Arrow 6 release notes in > https://github.com/apache/arrow-site/pull/153/files#r741928109. Thank you. > We plan to rewrite a lot of the API in Arrow 7 Sorry I missed them on the mailing list. Were these plans discussed here (sorry if I missed them, sometimes I filter

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

I'm verifying 6.0.1 RC0 at https://github.com/apache/arrow/pull/11628 and local. I can send a vote email for 6.0.1 RC0 after that. Thanks, -- kou In "Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3" on Fri, 5 Nov 2021 23:51:39 +0200, Dominik Moritz wrote: > When can we expect the 6.

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

When can we expect the 6.0.1 release? I thought the plan was to release it before the announcement at https://arrow.apache.org/blog/2021/11/04/6.0.0-release/. On Nov 3, 2021 at 20:22:01, Sutou Kouhei wrote: > Oh, sorry for introducing wrong instruction. (merging into > release-6.0.0.) > > In >

Re: [Rust][Security] Request for Feedback / Review on Array Validation (

Many thanks to Jörn Horstmann for his feedback on #810. I think this PR is now ready to go and will plan to do so early next week unless anyone objects or would like more time to review. Thanks again, Andrew On Wed, Nov 3, 2021 at 5:02 PM Andrew Lamb wrote: > TDLR: does anyone have time for fee

Re: Independent JS patch releases

Hi Neal, Great questions. We could potentially add an integration test for major bundlers. However, then we would also need a way to test these packages in different environments like browsers and that’s a lot of work that I’m not sure will be proportional to the benefit. The issue in my experien

Re: Independent JS patch releases

Not expressing an opinion on the original question, but if the problem is "not getting everything right the first time", what can be done to reduce the likelihood of getting things wrong? Other languages/implementations have extensive CI and nightly builds, some of which test different packaging sc

CI for win/arm64

Hello, We recently upstreamed a patch to enable Apache arrow C++ and Python library support for the windows/arm64 platform. I would like to explore if it would be possible to add CI and release build support for win/arm64 platforms. There are no WoA64