[jira] [Created] (ARROW-8780) [Python] A fsspec-compatible wrapper for pyarrow.fs filesystems

2020-05-13 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-8780: Summary: [Python] A fsspec-compatible wrapper for pyarrow.fs filesystems Key: ARROW-8780 URL: https://issues.apache.org/jira/browse/ARROW-8780 Project

[NIGHTLY] Arrow Build Report for Job nightly-2020-05-13-0

2020-05-13 Thread Crossbow
Arrow Build Report for Job nightly-2020-05-13-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-13-0 Failed Tasks: - test-conda-python-3.7-spark-master: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-13-0-github-test-conda-p

[jira] [Created] (ARROW-8781) [CI][C++] Enable ccache on GHA MinGW jobs

2020-05-13 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-8781: - Summary: [CI][C++] Enable ccache on GHA MinGW jobs Key: ARROW-8781 URL: https://issues.apache.org/jira/browse/ARROW-8781 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-8782) [Rust] [DataFusion] Add benchmarks based on NYC Taxi data set

2020-05-13 Thread Andy Grove (Jira)
Andy Grove created ARROW-8782: - Summary: [Rust] [DataFusion] Add benchmarks based on NYC Taxi data set Key: ARROW-8782 URL: https://issues.apache.org/jira/browse/ARROW-8782 Project: Apache Arrow

[jira] [Created] (ARROW-8783) [Rust] [DataFusion] Logical plan should have ParquetScan and CsvScan entries

2020-05-13 Thread Andy Grove (Jira)
Andy Grove created ARROW-8783: - Summary: [Rust] [DataFusion] Logical plan should have ParquetScan and CsvScan entries Key: ARROW-8783 URL: https://issues.apache.org/jira/browse/ARROW-8783 Project: Apache

[jira] [Created] (ARROW-8784) [Rust] [DataFusion] Remove use of Arc from LogicalPlan

2020-05-13 Thread Andy Grove (Jira)
Andy Grove created ARROW-8784: - Summary: [Rust] [DataFusion] Remove use of Arc from LogicalPlan Key: ARROW-8784 URL: https://issues.apache.org/jira/browse/ARROW-8784 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-8785) [Python][Packaging] Build the windows wheels with MIMALLOC enabled

2020-05-13 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-8785: -- Summary: [Python][Packaging] Build the windows wheels with MIMALLOC enabled Key: ARROW-8785 URL: https://issues.apache.org/jira/browse/ARROW-8785 Project: Apache

[jira] [Created] (ARROW-8786) [Packaging][rpm] Use bundled zstd in the CentOS 8 build

2020-05-13 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-8786: -- Summary: [Packaging][rpm] Use bundled zstd in the CentOS 8 build Key: ARROW-8786 URL: https://issues.apache.org/jira/browse/ARROW-8786 Project: Apache Arrow

Re: [C++] Runtime SIMD dispatching for Arrow

2020-05-13 Thread Wes McKinney
On Tue, May 12, 2020 at 11:12 PM Micah Kornfield wrote: > > > > > Since I develop on an AVX512-capable machine, if we have runtime > > dispatching then it should be able to test all variants of a function > > from a single executable / test run rather than having to produce > > multiple builds and

[jira] [Created] (ARROW-8787) [R] read_parquet() don't end

2020-05-13 Thread Masaru (Jira)
Masaru created ARROW-8787: - Summary: [R] read_parquet() don't end Key: ARROW-8787 URL: https://issues.apache.org/jira/browse/ARROW-8787 Project: Apache Arrow Issue Type: Bug Components: R

[jira] [Created] (ARROW-8788) [C#] Array builders to use bit-packed buffer builder rather than boolean array builder for validity map

2020-05-13 Thread Adam Szmigin (Jira)
Adam Szmigin created ARROW-8788: --- Summary: [C#] Array builders to use bit-packed buffer builder rather than boolean array builder for validity map Key: ARROW-8788 URL: https://issues.apache.org/jira/browse/ARROW-878

[jira] [Created] (ARROW-8789) [Rust] Add separate crate for integration test binaries

2020-05-13 Thread Andy Grove (Jira)
Andy Grove created ARROW-8789: - Summary: [Rust] Add separate crate for integration test binaries Key: ARROW-8789 URL: https://issues.apache.org/jira/browse/ARROW-8789 Project: Apache Arrow Issue

[VOTE] Release Apache Arrow 0.17.1 - RC0

2020-05-13 Thread Krisztián Szűcs
Hi, I would like to propose the following release candidate (RC0) of Apache Arrow version 0.17.1. This is a release consisting of 17 resolved JIRA issues[1]. This release candidate is based on commit: dd3d33e79a54159c7b5292b979b725849bbf3a82 [2] The source release rc0 is hosted at [3]. The binar

Arrow sync call May 13 at 12:00 US/Eastern, 16:00 UTC

2020-05-13 Thread Neal Richardson
Hi all, Last minute reminder that our biweekly call is coming up in a half hour at https://meet.google.com/vtm-teks-phx. All are welcome to join. Notes will be sent out to the mailing list afterward. Neal

[jira] [Created] (ARROW-8790) [C++][CI] enable arrow-flight-test on s390x

2020-05-13 Thread Kazuaki Ishizaki (Jira)
Kazuaki Ishizaki created ARROW-8790: --- Summary: [C++][CI] enable arrow-flight-test on s390x Key: ARROW-8790 URL: https://issues.apache.org/jira/browse/ARROW-8790 Project: Apache Arrow Issue

Re: Arrow sync call May 13 at 12:00 US/Eastern, 16:00 UTC

2020-05-13 Thread Ben Kietzman
Attendees: Micah Kornfield Francois Saint-Jacques Ben Kietzma Uwe Korn Mahmut Bulut Remi Dettai Prudhvi Porandla Discussion: * How to become a committer * to the rust subproject * SIMD dispatch * Following mailing list discussion "[C++] Runtime SIMD dispatching for Arrow" * How can writing c

[jira] [Created] (ARROW-8791) [RUST] Creating StringDictionaryBuilder with existing dictionary values

2020-05-13 Thread Jira
Jörn Horstmann created ARROW-8791: - Summary: [RUST] Creating StringDictionaryBuilder with existing dictionary values Key: ARROW-8791 URL: https://issues.apache.org/jira/browse/ARROW-8791 Project: Apac

Re: [VOTE] Release Apache Arrow 0.17.1 - RC0

2020-05-13 Thread Sutou Kouhei
-1 CentOS 8's arrow-lib package is broken. It depends libzstd but it's not available for now. It has been fixed by https://github.com/apache/arrow/pull/7166/commits/e4ecf59cb9221c3e2e4be605ff3f212ef5e78829 . I think that we can reuse RC0 by rebuilding CentOS 8 packages and reuploading them. In

Re: [VOTE] Release Apache Arrow 0.17.1 - RC0

2020-05-13 Thread Sutou Kouhei
FYI: We can't use dev/release/verify-release-candidate.sh at master for 0.17.1 as is for binaries/wheels verifications. We need the following change for binaries/wheels verifications: --- diff --git a/dev/release/download_rc_binaries.py b/dev/release/download_rc_binaries.py index 1c3da0e1e..a4c24

Re: [VOTE] Release Apache Arrow 0.17.1 - RC0

2020-05-13 Thread Krisztián Szűcs
Thanks for the heads up! I'm trying to use the maintenance branch [1] for verification, but I have not managed to verify the binaries yet because of recurring network issues. This time the release went more fluently, so it will be easier to cut a new release candidate if we encounter any blocking

[jira] [Created] (ARROW-8792) [C++] Improved declarative compute function / kernel development framework, normalize calling conventions

2020-05-13 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8792: --- Summary: [C++] Improved declarative compute function / kernel development framework, normalize calling conventions Key: ARROW-8792 URL: https://issues.apache.org/jira/browse/ARROW-8

[jira] [Created] (ARROW-8793) [C++] BitUtil::SetBitsTo probably doesn't need to be inline

2020-05-13 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8793: --- Summary: [C++] BitUtil::SetBitsTo probably doesn't need to be inline Key: ARROW-8793 URL: https://issues.apache.org/jira/browse/ARROW-8793 Project: Apache Arrow

[jira] [Created] (ARROW-8794) [C++] Expand benchmark coverage for arrow from parquet reading

2020-05-13 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-8794: -- Summary: [C++] Expand benchmark coverage for arrow from parquet reading Key: ARROW-8794 URL: https://issues.apache.org/jira/browse/ARROW-8794 Project: Apache Arro

[jira] [Created] (ARROW-8795) Limited iOS support

2020-05-13 Thread Ilija Puaca (Jira)
Ilija Puaca created ARROW-8795: -- Summary: Limited iOS support Key: ARROW-8795 URL: https://issues.apache.org/jira/browse/ARROW-8795 Project: Apache Arrow Issue Type: Improvement Compon