Re: [DISCUSS][Java] Design of the algorithm module

2019-10-14 Thread Fan Liya
Hi Micah, Thanks a lot for your valuable comments. I mostly agree with you points. Please note that in addition to algorithms directly related to Arrow features, there are algorithms indirectly related to Arrow features, and they should be attached a lower priority. An example is IPC -> dictionar

[jira] [Created] (ARROW-6887) [Java] Create prose documentation for using ValueVectors

2019-10-14 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-6887: -- Summary: [Java] Create prose documentation for using ValueVectors Key: ARROW-6887 URL: https://issues.apache.org/jira/browse/ARROW-6887 Project: Apache Arrow

[jira] [Created] (ARROW-6886) [C++] arrow::io header nvcc compiler warnings

2019-10-14 Thread Paul Taylor (Jira)
Paul Taylor created ARROW-6886: -- Summary: [C++] arrow::io header nvcc compiler warnings Key: ARROW-6886 URL: https://issues.apache.org/jira/browse/ARROW-6886 Project: Apache Arrow Issue Type: Ne

[jira] [Created] (ARROW-6885) [Python] Remove superfluous skipped timedelta test

2019-10-14 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-6885: Summary: [Python] Remove superfluous skipped timedelta test Key: ARROW-6885 URL: https://issues.apache.org/jira/browse/ARROW-6885 Project: Apache Arrow

Re: [DISCUSS] Understanding Arrow's CI problems and needs

2019-10-14 Thread Wes McKinney
The problems we're facing with our continuous integration are difficult to capture in a single JIRA ticket given the scope and complexity of the work involved. We could create some "umbrella" tickets with topics like "Eliminate Travis CI-specific logic from testing scripts" and attach child JIRA is

Re: build-support/update-flatbuffers.sh usage

2019-10-14 Thread Wes McKinney
That's a mistake. I must have made some changes to the file without testing it after the pre-generated file had already been checked in FORMAT_DIR=$CWD/../../format works for me On Mon, Oct 14, 2019 at 4:54 PM John Muehlhausen wrote: > > I'm missing something about this script. > > FORMAT_DIR=$

build-support/update-flatbuffers.sh usage

2019-10-14 Thread John Muehlhausen
I'm missing something about this script. FORMAT_DIR=$CWD/../.. How can any of the fbs files be in ../../ when they are in format/ ?

[jira] [Created] (ARROW-6884) [Python][Flight] Make server-side RPC exceptions more friendly?

2019-10-14 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-6884: --- Summary: [Python][Flight] Make server-side RPC exceptions more friendly? Key: ARROW-6884 URL: https://issues.apache.org/jira/browse/ARROW-6884 Project: Apache Arrow

[jira] [Created] (ARROW-6883) [C++] Support sending delta DictionaryBatch or replacement DictionaryBatch in IPC stream writer class

2019-10-14 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-6883: --- Summary: [C++] Support sending delta DictionaryBatch or replacement DictionaryBatch in IPC stream writer class Key: ARROW-6883 URL: https://issues.apache.org/jira/browse/ARROW-6883

[jira] [Created] (ARROW-6882) cannot create a chunked_array from dictionary_encoding result

2019-10-14 Thread Artem KOZHEVNIKOV (Jira)
Artem KOZHEVNIKOV created ARROW-6882: Summary: cannot create a chunked_array from dictionary_encoding result Key: ARROW-6882 URL: https://issues.apache.org/jira/browse/ARROW-6882 Project: Apache A

[jira] [Created] (ARROW-6881) [Rust] Remove "array_ops" in favor of the "compute" sub-module

2019-10-14 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6881: -- Summary: [Rust] Remove "array_ops" in favor of the "compute" sub-module Key: ARROW-6881 URL: https://issues.apache.org/jira/browse/ARROW-6881 Project: Apache Arrow

[jira] [Created] (ARROW-6880) [Rust] Add explicit SIMD for min/max kernel

2019-10-14 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6880: -- Summary: [Rust] Add explicit SIMD for min/max kernel Key: ARROW-6880 URL: https://issues.apache.org/jira/browse/ARROW-6880 Project: Apache Arrow Issue Type: Sub-

[jira] [Created] (ARROW-6879) [Rust] Add explicit SIMD for sum kernel

2019-10-14 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6879: -- Summary: [Rust] Add explicit SIMD for sum kernel Key: ARROW-6879 URL: https://issues.apache.org/jira/browse/ARROW-6879 Project: Apache Arrow Issue Type: Improvem

[jira] [Created] (ARROW-6878) [Python] pa.array() does not handle list of dicts with bytes keys correctly under python3

2019-10-14 Thread Zhuo Peng (Jira)
Zhuo Peng created ARROW-6878: Summary: [Python] pa.array() does not handle list of dicts with bytes keys correctly under python3 Key: ARROW-6878 URL: https://issues.apache.org/jira/browse/ARROW-6878 Proje

[jira] [Created] (ARROW-6877) [C++] Boost not found from the correct environment

2019-10-14 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-6877: Summary: [C++] Boost not found from the correct environment Key: ARROW-6877 URL: https://issues.apache.org/jira/browse/ARROW-6877 Project: Apache Arrow

[jira] [Created] (ARROW-6876) Reading parquet file becomes really slow for 0.15.0

2019-10-14 Thread Bob (Jira)
Bob created ARROW-6876: -- Summary: Reading parquet file becomes really slow for 0.15.0 Key: ARROW-6876 URL: https://issues.apache.org/jira/browse/ARROW-6876 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-6875) [Python][Flight] Implement Criteria for ListFlights RPC / list_flights method

2019-10-14 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-6875: --- Summary: [Python][Flight] Implement Criteria for ListFlights RPC / list_flights method Key: ARROW-6875 URL: https://issues.apache.org/jira/browse/ARROW-6875 Project: Ap

[jira] [Created] (ARROW-6874) Memory leak in Table.to_pandas() when nested columns are present

2019-10-14 Thread Sergey Mozharov (Jira)
Sergey Mozharov created ARROW-6874: -- Summary: Memory leak in Table.to_pandas() when nested columns are present Key: ARROW-6874 URL: https://issues.apache.org/jira/browse/ARROW-6874 Project: Apache Ar

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-10-14-0

2019-10-14 Thread Joris Van den Bossche
Many of the python related failures are due to the latest release of pytest-lazy-fixtures (I opened an issue at https://github.com/TvoroG/pytest-lazy-fixture/issues/42). Krisztian is pinning to an older version to fix those. On Mon, 14 Oct 2019 at 08:01, Crossbow wrote: > > Arrow Build Report fo

[jira] [Created] (ARROW-6873) [Python] Stale CColumn reference break Cython cimport pyarrow

2019-10-14 Thread Uwe Korn (Jira)
Uwe Korn created ARROW-6873: --- Summary: [Python] Stale CColumn reference break Cython cimport pyarrow Key: ARROW-6873 URL: https://issues.apache.org/jira/browse/ARROW-6873 Project: Apache Arrow Iss

Re: [DISCUSS] Reviewing Arrow commit/code review policy

2019-10-14 Thread Uwe L. Korn
Hello all, I also think we should stay with CTR for the moment. If we wanted to enforce RTC or at least a bit better notification for reviewers of certain parts of Arrow, we could setup a CODEOWNERS file[1] to add experts of a certain file/folder as a reviewer on PRs on Github. Cheers Uwe [1]

[NIGHTLY] Arrow Build Report for Job nightly-2019-10-14-0

2019-10-14 Thread Crossbow
Arrow Build Report for Job nightly-2019-10-14-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-10-14-0 Failed Tasks: - conda-osx-clang-py37: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-10-14-0-azure-conda-osx-clang-py37 - whee

[jira] [Created] (ARROW-6872) [C++][Python] Empty table with dictionary-columns raises ArrowNotImplementedError

2019-10-14 Thread Marco Neumann (Jira)
Marco Neumann created ARROW-6872: Summary: [C++][Python] Empty table with dictionary-columns raises ArrowNotImplementedError Key: ARROW-6872 URL: https://issues.apache.org/jira/browse/ARROW-6872 Proje