[jira] [Created] (ARROW-6972) C# should support StructField arrays

2019-10-22 Thread Cameron Murray (Jira)
Cameron Murray created ARROW-6972: - Summary: C# should support StructField arrays Key: ARROW-6972 URL: https://issues.apache.org/jira/browse/ARROW-6972 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-6971) [Rust] Replace "RecordBatchReader" with "BatchIterator"

2019-10-22 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6971: -- Summary: [Rust] Replace "RecordBatchReader" with "BatchIterator" Key: ARROW-6971 URL: https://issues.apache.org/jira/browse/ARROW-6971 Project: Apache Arrow

Re: [DISCUSS][Java] Design of the algorithm module

2019-10-22 Thread Fan Liya
Hi Micah, Thank you for reading through my previous email. > Is the conversation about rejecting the changes in Flink something you can link to? I found [1] which seems to allow for Arrow, in what seem like reasonable places, just not inside the core planner (and even that is a possibility with

Re: Possible Arrow 0.15.1 release

2019-10-22 Thread Wes McKinney
I just removed ARROW-6895 from 0.15.1. You can cut an RC anytime now On Tue, Oct 22, 2019 at 7:40 PM Krisztián Szűcs wrote: > > Cherry picked 1ae946c8bfebd31ceca8d54b66313d4aaa2f029c > > We have one issue left. > > On Wed, Oct 23, 2019 at 1:45 AM Antoine Pitrou wrote: > > > > >

Re: Possible Arrow 0.15.1 release

2019-10-22 Thread Krisztián Szűcs
Cherry picked 1ae946c8bfebd31ceca8d54b66313d4aaa2f029c We have one issue left. On Wed, Oct 23, 2019 at 1:45 AM Antoine Pitrou wrote: > > https://github.com/apache/arrow/pull/5701 was merged, you may cherry > pick it. > > Regards > > Antoine. > > > Le 22/10/2019 à 16:16, Krisztián Szűcs a écrit

Re: Possible Arrow 0.15.1 release

2019-10-22 Thread Antoine Pitrou
https://github.com/apache/arrow/pull/5701 was merged, you may cherry pick it. Regards Antoine. Le 22/10/2019 à 16:16, Krisztián Szűcs a écrit : > The packaging builds are passing without the following patches too: > - ARROW-6631: [C++] Do not build any compression libraries by default in >

Re: PyArrow Size in 0.15 version

2019-10-22 Thread Wes McKinney
Someone might try writing a "slim" version of https://github.com/apache/arrow/blob/master/python/manylinux1/build_arrow.sh That would be the place to start On Tue, Oct 22, 2019 at 5:17 PM Tim Paine wrote: > > Arrow has lots of configuration arguments, and PyArrow allows you to build > certain

Re: PyArrow Size in 0.15 version

2019-10-22 Thread Tim Paine
Arrow has lots of configuration arguments, and PyArrow allows you to build certain subsets of Arrow’s functionality. Depending on what you need, you can probably start out by building from source and turning off Parquet, Plasma, and Gandiva support. When running cmake, use -DARROW_PARQUET=OFF

PyArrow Size in 0.15 version

2019-10-22 Thread Kiran Padmanabhui
Hi, I am trying to use PyArrow in AWS Lambda but the size is 190 MB which is too big for AWS Lambda. Is there a way I can compile it and reduce it to less than 20-30 MB? Thanks Kiran

[jira] [Created] (ARROW-6970) [Packaging][RPM] Add support for CentOS 8

2019-10-22 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-6970: --- Summary: [Packaging][RPM] Add support for CentOS 8 Key: ARROW-6970 URL: https://issues.apache.org/jira/browse/ARROW-6970 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-6969) [C++][Dataset] ParquetScanTask eagerly load file

2019-10-22 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-6969: - Summary: [C++][Dataset] ParquetScanTask eagerly load file Key: ARROW-6969 URL: https://issues.apache.org/jira/browse/ARROW-6969 Project: Apache

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-10-22-0

2019-10-22 Thread Neal Richardson
I ticketed the R sanitizer failure here: https://issues.apache.org/jira/browse/ARROW-6957 Will try to take a look sometime this week, but it's safe to ignore in the meantime--it's a setup failure, not an actual sanitizer error. Neal On Tue, Oct 22, 2019 at 7:12 AM Krisztián Szűcs wrote: > >

[jira] [Created] (ARROW-6968) [Python] 0.14.1 to 0.15.0 upgrade produces AttributeError

2019-10-22 Thread Michael Wheeler (Jira)
Michael Wheeler created ARROW-6968: -- Summary: [Python] 0.14.1 to 0.15.0 upgrade produces AttributeError Key: ARROW-6968 URL: https://issues.apache.org/jira/browse/ARROW-6968 Project: Apache Arrow

[jira] [Created] (ARROW-6967) [C++] Add filter expressions for IN, COALESCE, and DROP_NULL

2019-10-22 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-6967: --- Summary: [C++] Add filter expressions for IN, COALESCE, and DROP_NULL Key: ARROW-6967 URL: https://issues.apache.org/jira/browse/ARROW-6967 Project: Apache Arrow

[jira] [Created] (ARROW-6966) [Go] 32bit memset is null

2019-10-22 Thread Jonathan A Sternberg (Jira)
Jonathan A Sternberg created ARROW-6966: --- Summary: [Go] 32bit memset is null Key: ARROW-6966 URL: https://issues.apache.org/jira/browse/ARROW-6966 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-6965) [C++][Dataset] Optionally expose partition keys as materialized columns

2019-10-22 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-6965: - Summary: [C++][Dataset] Optionally expose partition keys as materialized columns Key: ARROW-6965 URL: https://issues.apache.org/jira/browse/ARROW-6965

[jira] [Created] (ARROW-6964) [C++][Dataset] Expose a nested parellel option for Scanner

2019-10-22 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-6964: - Summary: [C++][Dataset] Expose a nested parellel option for Scanner Key: ARROW-6964 URL: https://issues.apache.org/jira/browse/ARROW-6964 Project:

Re: Possible Arrow 0.15.1 release

2019-10-22 Thread Krisztián Szűcs
The packaging builds are passing without the following patches too: - ARROW-6631: [C++] Do not build any compression libraries by default in C++ build - ARROW-6831: [R] Update R macOS/Windows builds for change in cmake compression defaults - ARROW-6855: [FlightRPC][C++][Python] Flight middleware

[jira] [Created] (ARROW-6963) [Packaging] Use crossbow's command to deploy artifacts from travis builds

2019-10-22 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-6963: -- Summary: [Packaging] Use crossbow's command to deploy artifacts from travis builds Key: ARROW-6963 URL: https://issues.apache.org/jira/browse/ARROW-6963 Project:

[jira] [Created] (ARROW-6962) [C++] [CI] Stop compiling with -Weverything

2019-10-22 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-6962: - Summary: [C++] [CI] Stop compiling with -Weverything Key: ARROW-6962 URL: https://issues.apache.org/jira/browse/ARROW-6962 Project: Apache Arrow Issue

[NIGHTLY] Arrow Build Report for Job nightly-2019-10-22-0

2019-10-22 Thread Crossbow
Arrow Build Report for Job nightly-2019-10-22-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-10-22-0 Failed Tasks: - docker-clang-format: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-10-22-0-circle-docker-clang-format -

Re: Possible Arrow 0.15.1 release

2019-10-22 Thread Antoine Pitrou
Le 22/10/2019 à 03:50, Wes McKinney a écrit : > I'm still trying to get ARROW-6910 merged which I'd like to have in > 0.15.1. I need some help -- I won't be able to spend much time on this > in the next 24 hours, so if someone could take over > > https://github.com/apache/arrow/pull/5701 > > *

[jira] [Created] (ARROW-6961) [C++][Gandiva] Add lower_utf8 function in Gandiva

2019-10-22 Thread Prudhvi Porandla (Jira)
Prudhvi Porandla created ARROW-6961: --- Summary: [C++][Gandiva] Add lower_utf8 function in Gandiva Key: ARROW-6961 URL: https://issues.apache.org/jira/browse/ARROW-6961 Project: Apache Arrow