[jira] [Created] (ARROW-8796) Allow parquet to be written directly to memory

Markus Westerlind created ARROW-8796: Summary: Allow parquet to be written directly to memory Key: ARROW-8796 URL: https://issues.apache.org/jira/browse/ARROW-8796 Project: Apache Arrow I

[NIGHTLY] Arrow Build Report for Job nightly-2020-05-14-0

Arrow Build Report for Job nightly-2020-05-14-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-14-0 Failed Tasks: - conda-osx-clang-py38: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-14-0-azure-conda-osx-clang-py38 - test

[jira] [Created] (ARROW-8797) [C++] Support Flight RPC among diffent endian platforms

Kazuaki Ishizaki created ARROW-8797: --- Summary: [C++] Support Flight RPC among diffent endian platforms Key: ARROW-8797 URL: https://issues.apache.org/jira/browse/ARROW-8797 Project: Apache Arrow

[jira] [Created] (ARROW-8798) [C++] Fix Parquet crashes on invalid input (OSS-Fuzz)

Antoine Pitrou created ARROW-8798: - Summary: [C++] Fix Parquet crashes on invalid input (OSS-Fuzz) Key: ARROW-8798 URL: https://issues.apache.org/jira/browse/ARROW-8798 Project: Apache Arrow

[jira] [Created] (ARROW-8799) [C++][Dataset] Reading list column as nested dictionary segfaults

Joris Van den Bossche created ARROW-8799: Summary: [C++][Dataset] Reading list column as nested dictionary segfaults Key: ARROW-8799 URL: https://issues.apache.org/jira/browse/ARROW-8799 Proje

Re: [VOTE] Release Apache Arrow 0.17.1 - RC0

I'm cutting RC1 - waiting for the last windows wheel to be built. On Thu, May 14, 2020 at 12:27 AM Krisztián Szűcs wrote: > > Thanks for the heads up! > > I'm trying to use the maintenance branch [1] for verification, but I > have not managed to verify the binaries yet because of recurring > netw

[jira] [Created] (ARROW-8800) [C++] Split arrow::ChunkedArray into arrow/chunked_array.h

Wes McKinney created ARROW-8800: --- Summary: [C++] Split arrow::ChunkedArray into arrow/chunked_array.h Key: ARROW-8800 URL: https://issues.apache.org/jira/browse/ARROW-8800 Project: Apache Arrow

[jira] [Created] (ARROW-8801) Pyarrow leaks memory on read from parquet file with UTC timestamps using pandas

Rauli Ruohonen created ARROW-8801: - Summary: Pyarrow leaks memory on read from parquet file with UTC timestamps using pandas Key: ARROW-8801 URL: https://issues.apache.org/jira/browse/ARROW-8801 Proje

[jira] [Created] (ARROW-8802) [C++][Dataset] Schema metadata are lost when reading a subset of columns

Joris Van den Bossche created ARROW-8802: Summary: [C++][Dataset] Schema metadata are lost when reading a subset of columns Key: ARROW-8802 URL: https://issues.apache.org/jira/browse/ARROW-8802

[VOTE] Release Apache Arrow 0.17.1 - RC1

Hi, I would like to propose the following release candidate (RC1) of Apache Arrow version 0.17.1. This is a release consisting of 19 resolved JIRA issues[1]. This release candidate is based on commit: ff7ee06020949daf66ac05090753e1a17736d9fa [2] The source release rc1 is hosted at [3]. The binar

[jira] [Created] (ARROW-8803) [Java] Row count should be set before loading buffers In VectorLoader

Rong Ma created ARROW-8803: -- Summary: [Java] Row count should be set before loading buffers In VectorLoader Key: ARROW-8803 URL: https://issues.apache.org/jira/browse/ARROW-8803 Project: Apache Arrow

Re: [VOTE] Release Apache Arrow 0.17.1 - RC1

+1 from me. I tested the sources on Ubuntu 18.04, with CUDA enabled. It worked until the Javascript step, which failed (as usual). I'm testing the binaries but it seems to download gigabytes of data as usual, so I'll probably stop it before it finishes. Regards Antoine. Le 14/05/2020 à 18:

Re: [VOTE] Release Apache Arrow 0.17.1 - RC1

I had gone to the effort of making the JS tests pass on machines that have a too-old Node but it got commented out because of issues running inside GHA, perhaps this code path can be made available by environment variable (opt-out so it can be disabled in GHA but used elsewhere)? https://github.co

Re: [VOTE] Release Apache Arrow 0.17.1 - RC1

I commented that out because the same logic is in the release verification guide, so it sounded like something that should be handled outside of the script (and yes, it caused the script to fail on GHA). https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates Neal On T

Re: [VOTE] Release Apache Arrow 0.17.1 - RC1

Binaries went fine in the end, and only 2.7 GB were downloaded! Regards Antoine. Le 14/05/2020 à 19:30, Antoine Pitrou a écrit : > > +1 from me. > > I tested the sources on Ubuntu 18.04, with CUDA enabled. It worked > until the Javascript step, which failed (as usual). > > I'm testing the

Re: [VOTE] Release Apache Arrow 0.17.1 - RC1

We install Go in the release script, though, for the same reason that it's slightly labor intensive to get a recent enough Go. On Thu, May 14, 2020 at 1:29 PM Neal Richardson wrote: > > I commented that out because the same logic is in the release verification > guide, so it sounded like somethin

[jira] [Created] (ARROW-8804) [R][CI] Followup to Rtools40 upgrade

Neal Richardson created ARROW-8804: -- Summary: [R][CI] Followup to Rtools40 upgrade Key: ARROW-8804 URL: https://issues.apache.org/jira/browse/ARROW-8804 Project: Apache Arrow Issue Type: Imp

[jira] [Created] (ARROW-8805) [CPP] Arrow (master) build error from sources

Tanveer created ARROW-8805: -- Summary: [CPP] Arrow (master) build error from sources Key: ARROW-8805 URL: https://issues.apache.org/jira/browse/ARROW-8805 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-8806) [C++][CI] Add a test job for iOS

Kouhei Sutou created ARROW-8806: --- Summary: [C++][CI] Add a test job for iOS Key: ARROW-8806 URL: https://issues.apache.org/jira/browse/ARROW-8806 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-8807) [Docs] Integration testing instructions for base docker image are incorrect

Andy Grove created ARROW-8807: - Summary: [Docs] Integration testing instructions for base docker image are incorrect Key: ARROW-8807 URL: https://issues.apache.org/jira/browse/ARROW-8807 Project: Apache A

[jira] [Created] (ARROW-8808) [Rust] Divide by zero in arrays/builder.rs

Andy Grove created ARROW-8808: - Summary: [Rust] Divide by zero in arrays/builder.rs Key: ARROW-8808 URL: https://issues.apache.org/jira/browse/ARROW-8808 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-8809) [Rust] schema mismatch in integration test

Andy Grove created ARROW-8809: - Summary: [Rust] schema mismatch in integration test Key: ARROW-8809 URL: https://issues.apache.org/jira/browse/ARROW-8809 Project: Apache Arrow Issue Type: Bug

Re: [VOTE] Release Apache Arrow 0.17.1 - RC1

+1 (binding) I ran the followings on Debian GNU/Linux sid: * JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \ CUDA_TOOLKIT_ROOT=/usr \ ARROW_CMAKE_OPTIONS=-DgRPC_SOURCE=BUNDLED \ dev/release/verify-release-candidate.sh source 0.17.1 1 * dev/release/verify-release-candidate.sh

[jira] [Created] (ARROW-8810) Append to parquet file?

Carl Boettiger created ARROW-8810: - Summary: Append to parquet file? Key: ARROW-8810 URL: https://issues.apache.org/jira/browse/ARROW-8810 Project: Apache Arrow Issue Type: Improvement

PSA: PR queue backlog is getting high.

Hi Everyone, The PR queue is starting to backup again a little bit. I did a triage pass on Java PRs. Could committers take a look at their respective languages and take the necessary steps to merge/close stale PRs? Thanks, Micah

Java builds are broken

I think some PRs I just merged had some unexpected conflicts. Looking into fixing them now.

[jira] [Created] (ARROW-8811) [Java] Fix build on master

Micah Kornfield created ARROW-8811: -- Summary: [Java] Fix build on master Key: ARROW-8811 URL: https://issues.apache.org/jira/browse/ARROW-8811 Project: Apache Arrow Issue Type: Bug

Re: Java builds are broken

Java builds on master should be fixed now. On Thu, May 14, 2020 at 10:20 PM Micah Kornfield wrote: > I think some PRs I just merged had some unexpected conflicts. Looking > into fixing them now. >