[jira] [Created] (ARROW-4865) [Rust] Support casting lists and primitives to lists

2019-03-13 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4865: - Summary: [Rust] Support casting lists and primitives to lists Key: ARROW-4865 URL: https://issues.apache.org/jira/browse/ARROW-4865 Project: Apache Arrow I

[Discuss][Java, Non-C++ generally] Support for 64-bit int array lengths?

2019-03-13 Thread Micah Kornfield
I was working on a proof of concept java implementation for LargeList [1] implementation (64-bit array offsets). Our Java implementation doesn't appear to support Vectors/Arrays larger then Integer.MAX_VALUE addressable space. It looks like Message.fbs was updated quite a while ago to support 64

Re: Sparse matrix formats

2019-03-13 Thread Jed Brown
Kenta Murata writes: > Hi Jed, > > I'd like to describe the current status of the implementation of SparseTensor. > I hope the following explanation will help you. > > First of all, I designed the current SparseTensor format as the first > interim implementation. > At this time I used scipy.spars

[jira] [Created] (ARROW-4864) [C++] gandiva-micro_benchmarks is broken in MSVC build

2019-03-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4864: --- Summary: [C++] gandiva-micro_benchmarks is broken in MSVC build Key: ARROW-4864 URL: https://issues.apache.org/jira/browse/ARROW-4864 Project: Apache Arrow Iss

Re: Sparse matrix formats

2019-03-13 Thread Kenta Murata
Hi Jed, I'd like to describe the current status of the implementation of SparseTensor. I hope the following explanation will help you. First of all, I designed the current SparseTensor format as the first interim implementation. At this time I used scipy.sparse as a reference. The reason why I s

[jira] [Created] (ARROW-4863) [Rust] [DataFusion] Parquet data source does not support complex types

2019-03-13 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4863: - Summary: [Rust] [DataFusion] Parquet data source does not support complex types Key: ARROW-4863 URL: https://issues.apache.org/jira/browse/ARROW-4863 Project: Apache Arrow

[jira] [Created] (ARROW-4862) [GLib] Add GArrowCastOptions::allow-invalid-utf8 property

2019-03-13 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4862: --- Summary: [GLib] Add GArrowCastOptions::allow-invalid-utf8 property Key: ARROW-4862 URL: https://issues.apache.org/jira/browse/ARROW-4862 Project: Apache Arrow

[jira] [Created] (ARROW-4861) [C++] Introduce MemoryPool::Memset method.

2019-03-13 Thread Pearu Peterson (JIRA)
Pearu Peterson created ARROW-4861: - Summary: [C++] Introduce MemoryPool::Memset method. Key: ARROW-4861 URL: https://issues.apache.org/jira/browse/ARROW-4861 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-4860) [C++] Build AWS C++ SDK for Windows in conda-forge

2019-03-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4860: --- Summary: [C++] Build AWS C++ SDK for Windows in conda-forge Key: ARROW-4860 URL: https://issues.apache.org/jira/browse/ARROW-4860 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-4859) [GLib] Add garrow_numeric_array_mean()

2019-03-13 Thread Yosuke Shiro (JIRA)
Yosuke Shiro created ARROW-4859: --- Summary: [GLib] Add garrow_numeric_array_mean() Key: ARROW-4859 URL: https://issues.apache.org/jira/browse/ARROW-4859 Project: Apache Arrow Issue Type: New Fea

Re: MATLAB, Arrow, ABI's and Linux

2019-03-13 Thread Joris Peeters
Yeah, precisely. We're aiming to simultaneously - maintain compatibility with quite old versions of MATLAB (down to R2009 at the moment), - where possible, make use of prebuilt libraries from Anaconda, e.g. for arrow-cpp, boost, gtest etc Our build infrastructure also doesn't easily support GCC 6.

[jira] [Created] (ARROW-4858) [Flight][Python] Enable custom FlightDataStream in Python

2019-03-13 Thread David Li (JIRA)
David Li created ARROW-4858: --- Summary: [Flight][Python] Enable custom FlightDataStream in Python Key: ARROW-4858 URL: https://issues.apache.org/jira/browse/ARROW-4858 Project: Apache Arrow Issue Ty

[jira] [Created] (ARROW-4857) [C++/Python/CI] docker-compose in manylinux1 crossbow jobs too old

2019-03-13 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4857: -- Summary: [C++/Python/CI] docker-compose in manylinux1 crossbow jobs too old Key: ARROW-4857 URL: https://issues.apache.org/jira/browse/ARROW-4857 Project: Apache Arrow

Re: Timeline for 0.13 Arrow release

2019-03-13 Thread Krisztián Szűcs
The proof of the pudding is in the eating. You convinced me. On Wed, Mar 13, 2019 at 3:31 PM Wes McKinney wrote: > Krisztian -- are you all right with proceeding with merging the CMake > refactor? I'm pretty committed to helping fix the problems that come > up. Since most consumers of the projec

Re: Timeline for 0.13 Arrow release

2019-03-13 Thread Wes McKinney
Krisztian -- are you all right with proceeding with merging the CMake refactor? I'm pretty committed to helping fix the problems that come up. Since most consumers of the project don't test until _after_ a release, we won't find out about some problems until we merge it and release it. Thus, IMHO i

[jira] [Created] (ARROW-4856) [Integration] The spark integration test exceeds the maximum time limit on travis

2019-03-13 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-4856: -- Summary: [Integration] The spark integration test exceeds the maximum time limit on travis Key: ARROW-4856 URL: https://issues.apache.org/jira/browse/ARROW-4856 P

[jira] [Created] (ARROW-4855) [Packaging] Generate default package version based on cpp tags in crossbow.py

2019-03-13 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-4855: -- Summary: [Packaging] Generate default package version based on cpp tags in crossbow.py Key: ARROW-4855 URL: https://issues.apache.org/jira/browse/ARROW-4855 Proje

[jira] [Created] (ARROW-4854) [Rust] Use Array Slice for limit kernel

2019-03-13 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4854: - Summary: [Rust] Use Array Slice for limit kernel Key: ARROW-4854 URL: https://issues.apache.org/jira/browse/ARROW-4854 Project: Apache Arrow Issue Type: Im

[jira] [Created] (ARROW-4853) [Rust] Array slice doesn't work on ListArray and StructArray

2019-03-13 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4853: - Summary: [Rust] Array slice doesn't work on ListArray and StructArray Key: ARROW-4853 URL: https://issues.apache.org/jira/browse/ARROW-4853 Project: Apache Arrow

Re: MATLAB, Arrow, ABI's and Linux

2019-03-13 Thread Uwe L. Korn
Hello all, the conda packages from conda-forge use gcc and libstdc++ 7.3, i.e. are a major version newer than the ones that come with Matlab. Thus the missing symbols and the need for LD_PRELOAD. As long as Matlab is using an older version of gcc/libstdc++, the missing symbols will continue to

Re: MATLAB, Arrow, ABI's and Linux

2019-03-13 Thread Hatem Helal
Hi Joris, Nice to hear from you! I'd like the understand the need to use LD_PRELOAD for picking up a different libstdc++. In case haven't found this already, MATLAB even vendors a libstdc++ as per: (pwd = matlabroot) % more sys/os/glnxa64/README.libstdc++ The GCC runtime libraries included h

Re: MATLAB, Arrow, ABI's and Linux

2019-03-13 Thread Joris Peeters
Hello Uwe, Yes, it would appear that was the case. Aggregating yours and Wes' suggestions, I'm now: - Compiling arrow-cpp myself, explicitly with the new ABI, and publishing this on our internal conda channel (as gsa-arrow-cpp, so it can be explicitly depended upon). Did this by tweaking https://

[jira] [Created] (ARROW-4852) [Go] add shmem allocator

2019-03-13 Thread Sebastien Binet (JIRA)
Sebastien Binet created ARROW-4852: -- Summary: [Go] add shmem allocator Key: ARROW-4852 URL: https://issues.apache.org/jira/browse/ARROW-4852 Project: Apache Arrow Issue Type: Improvement