[jira] [Created] (ARROW-4888) [C++/Python] Test build with conda's defaults channel

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4888: -- Summary: [C++/Python] Test build with conda's defaults channel Key: ARROW-4888 URL: https://issues.apache.org/jira/browse/ARROW-4888 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4889) [C++] Add STATUS messages for Protobuf in CMake

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4889: -- Summary: [C++] Add STATUS messages for Protobuf in CMake Key: ARROW-4889 URL: https://issues.apache.org/jira/browse/ARROW-4889 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-4890) Spark+Arrow Grouped pandas UDAF - read length must be positive or -1

2019-03-15 Thread Abdeali Kothari (JIRA)
Abdeali Kothari created ARROW-4890: -- Summary: Spark+Arrow Grouped pandas UDAF - read length must be positive or -1 Key: ARROW-4890 URL: https://issues.apache.org/jira/browse/ARROW-4890 Project: Apach

Arrow Flight RPC usage

2019-03-15 Thread Maxim Novikov
Hello, I am evaluating Arrow RPC for usage with multidimensional Tensors. In my case, mostly 2D/3D images with multiple channels. Let's say I want to develop a service that applies a gaussian blur on a 2D image. >From my understanding expected workflow is the following: 1. DoPut $key, image data 2

[jira] [Created] (ARROW-4892) Move SQL parser and planner into sql package

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4892: - Summary: Move SQL parser and planner into sql package Key: ARROW-4892 URL: https://issues.apache.org/jira/browse/ARROW-4892 Project: Apache Arrow Issue Type: Sub-t

[jira] [Created] (ARROW-4891) [C++] ZLIB include directories not added

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4891: -- Summary: [C++] ZLIB include directories not added Key: ARROW-4891 URL: https://issues.apache.org/jira/browse/ARROW-4891 Project: Apache Arrow Issue Type: Improve

[jira] [Created] (ARROW-4893) [C++] conda packages should use $PREFIX inside of conda-build

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4893: -- Summary: [C++] conda packages should use $PREFIX inside of conda-build Key: ARROW-4893 URL: https://issues.apache.org/jira/browse/ARROW-4893 Project: Apache Arrow

[jira] [Created] (ARROW-4894) [Rust] [DataFusion] Remove all uses of panic! from aggregate.rs

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4894: - Summary: [Rust] [DataFusion] Remove all uses of panic! from aggregate.rs Key: ARROW-4894 URL: https://issues.apache.org/jira/browse/ARROW-4894 Project: Apache Arrow

[jira] [Created] (ARROW-4895) [Rust] [DataFusion] Move error.rs to top level package

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4895: - Summary: [Rust] [DataFusion] Move error.rs to top level package Key: ARROW-4895 URL: https://issues.apache.org/jira/browse/ARROW-4895 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-4896) [Rust] [DataFusion] Remove all uses of panic! from tests

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4896: - Summary: [Rust] [DataFusion] Remove all uses of panic! from tests Key: ARROW-4896 URL: https://issues.apache.org/jira/browse/ARROW-4896 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4897) [Rust] [DataFusion] Improve Rustdoc

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4897: - Summary: [Rust] [DataFusion] Improve Rustdoc Key: ARROW-4897 URL: https://issues.apache.org/jira/browse/ARROW-4897 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-4898) [C++] Old versions of FindProtobuf.cmake use ALL-CAPS for variables

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4898: -- Summary: [C++] Old versions of FindProtobuf.cmake use ALL-CAPS for variables Key: ARROW-4898 URL: https://issues.apache.org/jira/browse/ARROW-4898 Project: Apache Arrow

[jira] [Created] (ARROW-4899) [Rust] [DataFusion] Remove all uses of panic! from expression.rs

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4899: - Summary: [Rust] [DataFusion] Remove all uses of panic! from expression.rs Key: ARROW-4899 URL: https://issues.apache.org/jira/browse/ARROW-4899 Project: Apache Arrow

[jira] [Created] (ARROW-4900) mingw-w64 < 5 does not have __cpuidex

2019-03-15 Thread Jeroen (JIRA)
Jeroen created ARROW-4900: - Summary: mingw-w64 < 5 does not have __cpuidex Key: ARROW-4900 URL: https://issues.apache.org/jira/browse/ARROW-4900 Project: Apache Arrow Issue Type: Bug Compon

Re: Arrow Flight RPC usage

2019-03-15 Thread Wes McKinney
hi Maxim, What you're describing is presently an "off-label" use of Flight but it's perfectly valid if you're willing to roll up your sleeves a bit. Since we've focused on dealing with the columnar format as a multi-message stream, you'll find the APIs in Java, C++, and Python to be oriented aroun

[jira] [Created] (ARROW-4901) [Go] Run tests in Appveyor

2019-03-15 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4901: --- Summary: [Go] Run tests in Appveyor Key: ARROW-4901 URL: https://issues.apache.org/jira/browse/ARROW-4901 Project: Apache Arrow Issue Type: New Feature

CMake refactor Heads-up

2019-03-15 Thread Uwe L. Korn
Hello fellow Arrow Devs, we have merged the CMake refactor yesterday https://github.com/apache/arrow/pull/3688 and this means that the build system behaves a bit different. The main differences are: * If you're in a conda environment, we automatically detect this using the environment variable

Re: CMake refactor Heads-up

2019-03-15 Thread Wes McKinney
Thanks Uwe for seeing through this massive improvement to our C++ build system! This should help package managers build the project in precisely the way that's needed to make the Arrow C++ libraries available in more places. A couple notes: * I personally keep my C++ toolchain and conda environme

[jira] [Created] (ARROW-4902) [C++/Flight] Compilation fails due to unreachable code 

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4902: -- Summary: [C++/Flight] Compilation fails due to unreachable code  Key: ARROW-4902 URL: https://issues.apache.org/jira/browse/ARROW-4902 Project: Apache Arrow Issu

[jira] [Created] (ARROW-4903) [C++] Building tests using only static libs not possible

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4903: -- Summary: [C++] Building tests using only static libs not possible Key: ARROW-4903 URL: https://issues.apache.org/jira/browse/ARROW-4903 Project: Apache Arrow Iss

[jira] [Created] (ARROW-4904) [C++] Move implementations in arrow/ipc/test-common.h into libarrow_testing

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4904: -- Summary: [C++] Move implementations in arrow/ipc/test-common.h into libarrow_testing Key: ARROW-4904 URL: https://issues.apache.org/jira/browse/ARROW-4904 Project: Apache

Re: CMake refactor Heads-up

2019-03-15 Thread Philipp Moritz
Thanks Uwe for doing this! It's amazing how well the arrow build system is working given it supports so many different configurations (which makes Uwe's refactor all the more impressive). Big thanks for everybody helping to maintain it. On Fri, Mar 15, 2019 at 8:08 AM Wes McKinney wrote: > Than

[jira] [Created] (ARROW-4905) [C++][Plasma] Remove dlmalloc from client library

2019-03-15 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-4905: - Summary: [C++][Plasma] Remove dlmalloc from client library Key: ARROW-4905 URL: https://issues.apache.org/jira/browse/ARROW-4905 Project: Apache Arrow Issu

[jira] [Created] (ARROW-4906) [Format] Fix document to describe that SparseMatrixIndexCSR assumes indptr is sorted for each row

2019-03-15 Thread Kenta Murata (JIRA)
Kenta Murata created ARROW-4906: --- Summary: [Format] Fix document to describe that SparseMatrixIndexCSR assumes indptr is sorted for each row Key: ARROW-4906 URL: https://issues.apache.org/jira/browse/ARROW-4906

Re: CMake refactor Heads-up

2019-03-15 Thread Suvayu Ali
Hi Uwe, On Fri, Mar 15, 2019 at 10:38:32AM -0400, Uwe L. Korn wrote: > > we have merged the CMake refactor yesterday > https://github.com/apache/arrow/pull/3688 and this means that the build > system behaves a bit different. The main differences are: That's a lot of work! Thank you very much

[jira] [Created] (ARROW-4907) [CI] Add docker container to inspect docker context

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4907: -- Summary: [CI] Add docker container to inspect docker context Key: ARROW-4907 URL: https://issues.apache.org/jira/browse/ARROW-4907 Project: Apache Arrow Issue Ty

[jira] [Created] (ARROW-4908) [Rust] [DataFusion] Add support for parquet date/time in int32/64 encoding

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4908: - Summary: [Rust] [DataFusion] Add support for parquet date/time in int32/64 encoding Key: ARROW-4908 URL: https://issues.apache.org/jira/browse/ARROW-4908 Project: Apache Ar

[jira] [Created] (ARROW-4909) [CI] Use hadolint to lint Dockerfiles

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4909: -- Summary: [CI] Use hadolint to lint Dockerfiles Key: ARROW-4909 URL: https://issues.apache.org/jira/browse/ARROW-4909 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-4910) [Rust] [DataFusion] Remove all uses of unimplemented!

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4910: - Summary: [Rust] [DataFusion] Remove all uses of unimplemented! Key: ARROW-4910 URL: https://issues.apache.org/jira/browse/ARROW-4910 Project: Apache Arrow Issue Ty

[jira] [Created] (ARROW-4911) [R] Support for building package for Windows

2019-03-15 Thread Javier Luraschi (JIRA)
Javier Luraschi created ARROW-4911: -- Summary: [R] Support for building package for Windows Key: ARROW-4911 URL: https://issues.apache.org/jira/browse/ARROW-4911 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-4912) [C++, Python] Allow specifying column names to CSV reader

2019-03-15 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-4912: - Summary: [C++, Python] Allow specifying column names to CSV reader Key: ARROW-4912 URL: https://issues.apache.org/jira/browse/ARROW-4912 Project: Apache Arrow

[jira] [Created] (ARROW-4913) [Java][Memory] Limit number of ledgers and arrowbufs

2019-03-15 Thread Praveen Kumar Desabandu (JIRA)
Praveen Kumar Desabandu created ARROW-4913: -- Summary: [Java][Memory] Limit number of ledgers and arrowbufs Key: ARROW-4913 URL: https://issues.apache.org/jira/browse/ARROW-4913 Project: Apach

Re: CMake refactor Heads-up

2019-03-15 Thread Ravindra Pindikura
On Sat, Mar 16, 2019 at 2:38 AM Suvayu Ali wrote: > Hi Uwe, > > On Fri, Mar 15, 2019 at 10:38:32AM -0400, Uwe L. Korn wrote: > > > > we have merged the CMake refactor yesterday > https://github.com/apache/arrow/pull/3688 and this means that the build > system behaves a bit different. The main dif

Re: CMake refactor Heads-up

2019-03-15 Thread Suvayu Ali
On Sat, Mar 16, 2019 at 11:03:27AM +0530, Ravindra Pindikura wrote: > On Sat, Mar 16, 2019 at 2:38 AM Suvayu Ali > wrote: > > > Secondly, I was trying to compile with Gandiva enabled. But it seems the > > LLVM requirement has gone up to 7.0 (available only on F29 onwards). I had > > managed to