[jira] [Created] (ARROW-6078) [Java] Implement dictionary-encoded subfields for List type

2019-07-30 Thread Ji Liu (JIRA)
Ji Liu created ARROW-6078: - Summary: [Java] Implement dictionary-encoded subfields for List type Key: ARROW-6078 URL: https://issues.apache.org/jira/browse/ARROW-6078 Project: Apache Arrow Issue

[jira] [Created] (ARROW-6077) [C++][Parquet] Build logical schema tree mapping Arrow fields to Parquet schema levels

2019-07-30 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-6077: --- Summary: [C++][Parquet] Build logical schema tree mapping Arrow fields to Parquet schema levels Key: ARROW-6077 URL: https://issues.apache.org/jira/browse/ARROW-6077

[jira] [Created] (ARROW-6076) [C++][Parquet] RecordReader::Reset logic is inefficient for small reads

2019-07-30 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-6076: --- Summary: [C++][Parquet] RecordReader::Reset logic is inefficient for small reads Key: ARROW-6076 URL: https://issues.apache.org/jira/browse/ARROW-6076 Project: Apache

Re: New version(s) on JIRA

2019-07-30 Thread Sutou Kouhei
Hi, I think that "2.0.0" is better. Because we'll not release "1.1.0". See also: https://lists.apache.org/thread.html/d0ab931b15e75f745f8ae5a348f6c26a3e1f0bb98dc38a9a2c9888d3@%3Cdev.arrow.apache.org%3E Thanks, -- kou In "New version(s) on JIRA" on Tue, 30 Jul 2019 19:20:00 +0200,

Re: BigQuery Storage API now supports Arow

2019-07-30 Thread Micah Kornfield
> > If the current gRPC stub definitions are reasonably stable (in your > opinion), I might try implementing support. I would guess that is relatively stable, but I don't think I can make any guarantees (as far as I know there are no guarantees made between beta and GA API versions). So while I

Re: BigQuery Storage API now supports Arow

2019-07-30 Thread Micah Kornfield
> > This is nice. Reading the original ML thread [1], does this mean that > high-speed Avro-to-Arrow parsing has become less important now? I think this is still important from an Arrow perspective. Avro is still a very popular serialization format and probably the most popular one Arrow

[jira] [Created] (ARROW-6075) [FlightRPC] Handle uncaught exceptions in middleware

2019-07-30 Thread lidavidm (JIRA)
lidavidm created ARROW-6075: --- Summary: [FlightRPC] Handle uncaught exceptions in middleware Key: ARROW-6075 URL: https://issues.apache.org/jira/browse/ARROW-6075 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-6074) [FlightRPC] Implement middleware

2019-07-30 Thread lidavidm (JIRA)
lidavidm created ARROW-6074: --- Summary: [FlightRPC] Implement middleware Key: ARROW-6074 URL: https://issues.apache.org/jira/browse/ARROW-6074 Project: Apache Arrow Issue Type: Improvement

Re: Parquet to Arrow in Java

2019-07-30 Thread Micah Kornfield
Hi Anoop, There isn't currently anything in the Arrow Java library that does this. It is something that I think we want to add at some point. Dremio [1] has some Parquet related code, but I haven't looked at it to understand how easy it is to use as a standalone library and whether is supports

[jira] [Created] (ARROW-6073) Decimal128Builder is not reset in Finish()

2019-07-30 Thread Kenneth Jung (JIRA)
Kenneth Jung created ARROW-6073: --- Summary: Decimal128Builder is not reset in Finish() Key: ARROW-6073 URL: https://issues.apache.org/jira/browse/ARROW-6073 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-6072) [C++] Implement casting List <-> LargeList

2019-07-30 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-6072: - Summary: [C++] Implement casting List <-> LargeList Key: ARROW-6072 URL: https://issues.apache.org/jira/browse/ARROW-6072 Project: Apache Arrow Issue

[jira] [Created] (ARROW-6071) [C++] Implement casting Binary <-> LargeBinary

2019-07-30 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-6071: - Summary: [C++] Implement casting Binary <-> LargeBinary Key: ARROW-6071 URL: https://issues.apache.org/jira/browse/ARROW-6071 Project: Apache Arrow Issue

New version(s) on JIRA

2019-07-30 Thread Antoine Pitrou
Hi, Should we create a "1.1.0" (and/or "2.0.0") version on JIRA, to start assigning non-urgent issues? Regards Antoine.

Re: Ursabot configuration within Arrow

2019-07-30 Thread Krisztián Szűcs
Ok, but the configuration movement to arrow is orthogonal to the local reproducibility feature. Could we proceed with that? On Tue, Jul 30, 2019 at 4:38 PM Wes McKinney wrote: > I will defer to others to investigate this matter further but I would > really like to see a concrete and practical

Re: Ursabot configuration within Arrow

2019-07-30 Thread Wes McKinney
I will defer to others to investigate this matter further but I would really like to see a concrete and practical path to local reproducibility before moving forward on any changes to our current CI. On Tue, Jul 30, 2019 at 7:38 AM Krisztián Szűcs wrote: > > Fixed it and restarted a bunch of

Re: Ursabot configuration within Arrow

2019-07-30 Thread Krisztián Szűcs
Fixed it and restarted a bunch of builds. On Tue, Jul 30, 2019 at 5:13 AM Wes McKinney wrote: > By the way, can you please disable the Buildbot builders that are > causing builds on master to fail? We haven't had a passing build in > over a week. Until we reconcile the build configurations we

Re: [VOTE] Adopt FORMAT and LIBRARY SemVer-based version schemes for Arrow 1.0.0 and beyond

2019-07-30 Thread Antoine Pitrou
+1 from me. Regards Antoine. On Fri, 26 Jul 2019 14:33:30 -0500 Wes McKinney wrote: > hello, > > As discussed on the mailing list thread [1], Micah Kornfield has > proposed a version scheme for the project to take effect starting with > the 1.0.0 release. See document [2] containing a

[jira] [Created] (ARROW-6070) [Java] Avoid creating new schema before IPC sending

2019-07-30 Thread Liya Fan (JIRA)
Liya Fan created ARROW-6070: --- Summary: [Java] Avoid creating new schema before IPC sending Key: ARROW-6070 URL: https://issues.apache.org/jira/browse/ARROW-6070 Project: Apache Arrow Issue Type:

Re: Ursabot configuration within Arrow

2019-07-30 Thread Krisztián Szűcs
On Tue, Jul 30, 2019 at 3:23 AM Wes McKinney wrote: > On Mon, Jul 29, 2019 at 7:58 PM Krisztián Szűcs > wrote: > > > > On Tue, Jul 30, 2019 at 1:38 AM Wes McKinney > wrote: > > > > > hi Krisztian, > > > > > > Before talking about any code donations or where to run builds, I > > > think we

[jira] [Created] (ARROW-6069) [Rust] [Parquet] Implement Converter to convert record reader to arrow primitive array.

2019-07-30 Thread Renjie Liu (JIRA)
Renjie Liu created ARROW-6069: - Summary: [Rust] [Parquet] Implement Converter to convert record reader to arrow primitive array. Key: ARROW-6069 URL: https://issues.apache.org/jira/browse/ARROW-6069

[jira] [Created] (ARROW-6068) [Python] Hypothesis test failure

2019-07-30 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-6068: - Summary: [Python] Hypothesis test failure Key: ARROW-6068 URL: https://issues.apache.org/jira/browse/ARROW-6068 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-6067) [Python] Large memory test failures

2019-07-30 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-6067: - Summary: [Python] Large memory test failures Key: ARROW-6067 URL: https://issues.apache.org/jira/browse/ARROW-6067 Project: Apache Arrow Issue Type: Bug