[jira] [Created] (ARROW-5788) [Rust] Use { version = "...", path = "../..." } for arrow and parquet dependencies

2019-06-28 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5788: --- Summary: [Rust] Use { version = "...", path = "../..." } for arrow and parquet dependencies Key: ARROW-5788 URL: https://issues.apache.org/jira/browse/ARROW-5788 Projec

[jira] [Created] (ARROW-5787) [Release][Rust] Use local modules to verify RC

2019-06-28 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5787: --- Summary: [Release][Rust] Use local modules to verify RC Key: ARROW-5787 URL: https://issues.apache.org/jira/browse/ARROW-5787 Project: Apache Arrow Issue Type:

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-28 Thread Sutou Kouhei
Hi, Binary artifacts are built. I'm uploading them to Bintray but I reach Bintray's API limit... https://bintray.com/docs/api/#_limits says > Limits only apply to resources that do not belong to a > user or to the organization the user is part of. So I request to join https://bintray.com/apache

Re: [Discuss][Java][Typical use cases for dictionary encoding string vectors]

2019-06-28 Thread Jacques Nadeau
I think we need to start separating out dataset behavior from base IPC behavior. Having worked with this kind of structure in both Drill (where things were entirely late bound dynamic) and Dremio (where we start with schema and restart if we identify schema change), I strongly recommend that "datas

Re: Spark and Arrow Flight

2019-06-28 Thread Jacques Nadeau
My initial inclination is towards #3 but I'd be curious what others think. In the case of #3, I wonder if it makes sense to then pull the Schema off the GetFlightInfo response... On Fri, Jun 28, 2019 at 10:57 AM Ryan Murray wrote: > Hi All, > > I have been working on building an arrow flight sou

[jira] [Created] (ARROW-5786) [Release] Use arrow-jni profile in dev/release/01-prepare.sh

2019-06-28 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5786: --- Summary: [Release] Use arrow-jni profile in dev/release/01-prepare.sh Key: ARROW-5786 URL: https://issues.apache.org/jira/browse/ARROW-5786 Project: Apache Arrow

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-28 Thread Sutou Kouhei
Hi, ursabot doesn't support --arrow-version crossbow.py option. So I used ursa-labs/crossbow from command line. Crossbow build: https://github.com/ursa-labs/crossbow/branches/all?utf8=%E2%9C%93&query=build-660 I'll send a release vote e-mail when these builds are completed and uploads built bin

[jira] [Created] (ARROW-5785) Rust datafusion implementation should not depend on rustyline

2019-06-28 Thread Marius Seritan (JIRA)
Marius Seritan created ARROW-5785: - Summary: Rust datafusion implementation should not depend on rustyline Key: ARROW-5785 URL: https://issues.apache.org/jira/browse/ARROW-5785 Project: Apache Arrow

[jira] [Created] (ARROW-5784) [Release][GLib] Run only c_glib/autogen.sh and replace c_glib/ in dev/release/02-source.sh

2019-06-28 Thread Yosuke Shiro (JIRA)
Yosuke Shiro created ARROW-5784: --- Summary: [Release][GLib] Run only c_glib/autogen.sh and replace c_glib/ in dev/release/02-source.sh Key: ARROW-5784 URL: https://issues.apache.org/jira/browse/ARROW-5784

[jira] [Created] (ARROW-5783) [Release][C#] Exclude dummy.git from RAT check

2019-06-28 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5783: --- Summary: [Release][C#] Exclude dummy.git from RAT check Key: ARROW-5783 URL: https://issues.apache.org/jira/browse/ARROW-5783 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-5782) [Release] Setup test data for Flight in dev/release/01-perform.sh

2019-06-28 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5782: --- Summary: [Release] Setup test data for Flight in dev/release/01-perform.sh Key: ARROW-5782 URL: https://issues.apache.org/jira/browse/ARROW-5782 Project: Apache Arrow

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-28 Thread Wes McKinney
I've made some more additions and edits in https://docs.google.com/document/d/1ljkW5tBh7cDfPRg_z6YY-1cbXfXxpfpRUlSatbV8128/edit# If anyone would like to fill in some additional information, I can convert it to Markdown when the time comes next week to publish on the website On Fri, Jun 28, 2019

Re: 0.14.0: Javadoc failed with OpenJDK 11

2019-06-28 Thread Bryan Cutler
I agree with Wes that JDK8 is still the main production version. On Fri, Jun 28, 2019 at 2:22 PM Wes McKinney wrote: > I think you can make the release with JDK8 since that's consistent > with past releases. > > On Fri, Jun 28, 2019 at 4:17 PM Sutou Kouhei wrote: > > > > Thanks Wes! > > > > I'm

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-28 Thread Wes McKinney
hi Kou, You can already push to https://github.com/ursa-labs/crossbow so I think if you use that as your Crossbow queue then you can benefit from having the CI systems pre-configured On Fri, Jun 28, 2019 at 4:20 PM Sutou Kouhei wrote: > > Hi Krisztián, > > OK. I'll use ursabot! > > > Thanks, > -

Re: 0.14.0: Javadoc failed with OpenJDK 11

2019-06-28 Thread Wes McKinney
I think you can make the release with JDK8 since that's consistent with past releases. On Fri, Jun 28, 2019 at 4:17 PM Sutou Kouhei wrote: > > Thanks Wes! > > I'm still waiting for comments from Java developers. > > -- > kou > > In > "Re: 0.14.0: Javadoc failed with OpenJDK 11" on Thu, 27 Jun

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-28 Thread Sutou Kouhei
Hi Krisztián, OK. I'll use ursabot! Thanks, -- kou In "Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items" on Fri, 28 Jun 2019 15:02:32 +0200, Krisztián Szűcs wrote: > @Kou I suggest You to use ursa-labs/crossbow repository for building the > binaries, because the packaging

Re: 0.14.0: Javadoc failed with OpenJDK 11

2019-06-28 Thread Sutou Kouhei
Thanks Wes! I'm still waiting for comments from Java developers. -- kou In "Re: 0.14.0: Javadoc failed with OpenJDK 11" on Thu, 27 Jun 2019 16:40:44 -0500, Wes McKinney wrote: > hi Kou, > > I think that JDK8 is still treated as the "main production JDK > version" but based on > > https

Re: How should a Python/C++ project depend on Arrow (issues with ABI and wheel)?

2019-06-28 Thread Antoine Pitrou
On Fri, 28 Jun 2019 09:43:07 -0700 Zhuo Peng wrote: > > Or maybe we could disallow STL classes in arrow's public headers. This > might not be feasible, because std::shared_ptr and std::vector are used > everywhere. Indeed I'm not sure how that would be possible. Also I suppose *any* piece of so

[jira] [Created] (ARROW-5781) [Archery] Ensure benchmark clone accepts remotes in revision

2019-06-28 Thread Francois Saint-Jacques (JIRA)
Francois Saint-Jacques created ARROW-5781: - Summary: [Archery] Ensure benchmark clone accepts remotes in revision Key: ARROW-5781 URL: https://issues.apache.org/jira/browse/ARROW-5781 Project:

Spark and Arrow Flight

2019-06-28 Thread Ryan Murray
Hi All, I have been working on building an arrow flight source for spark. The goal here is for Spark to be able to use a group of arrow flight endpoints to get a dataset pulled over to spark in parallel. I am unsure of the best model for the spark <-> flight conversation and wanted to get your op

Re: [DISCUSS] Ongoing Travis CI service degradation

2019-06-28 Thread Wes McKinney
Based on the discussion in https://issues.apache.org/jira/browse/INFRA-18533 it does not appear to be ASF Infra's inclination to allow projects to donate money to the Foundation to get more build resources on Travis CI. Our likely only solution is going to be to reduce our dependence on Travis CI.

Re: How should a Python/C++ project depend on Arrow (issues with ABI and wheel)?

2019-06-28 Thread Zhuo Peng
Thanks everyone. I think there are two issues being discussed here and I'd like to keep them separate: 1. the ABI compatibility of Arrow's pip binary release. It's true that there is no ABI standard and the topic is messy, but as Antoine pointed out: > If you'd like to benefit from the PyArrow bi

[jira] [Created] (ARROW-5780) [C++] Add benchmark for Decimal128 operations

2019-06-28 Thread Micah Kornfield (JIRA)
Micah Kornfield created ARROW-5780: -- Summary: [C++] Add benchmark for Decimal128 operations Key: ARROW-5780 URL: https://issues.apache.org/jira/browse/ARROW-5780 Project: Apache Arrow Issue

[jira] [Created] (ARROW-5779) [R][CI] R's docker image fails due to incompatibility

2019-06-28 Thread Francois Saint-Jacques (JIRA)
Francois Saint-Jacques created ARROW-5779: - Summary: [R][CI] R's docker image fails due to incompatibility Key: ARROW-5779 URL: https://issues.apache.org/jira/browse/ARROW-5779 Project: Apache

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-28 Thread Krisztián Szűcs
@Kou I suggest You to use ursa-labs/crossbow repository for building the binaries, because the packaging builds are using azure pipelines, travis and appveyor now. You may setup azure pipelines for your crossbow instance as well, but it is possibly easier to use ursa-labs' one. Also You can use the

Re: [jira] [Created] (ARROW-5772) [GLib][Plasma][CUDA] Plasma::Client#refer_object test is failed

2019-06-28 Thread Anas .E
unsubscribe Le ven. 28 juin 2019 à 07:25, Sutou Kouhei (JIRA) a écrit : > Sutou Kouhei created ARROW-5772: > --- > > Summary: [GLib][Plasma][CUDA] Plasma::Client#refer_object > test is failed > Key: ARROW-5772 > URL:

[jira] [Created] (ARROW-5778) Extract the logic for vector data copying to the super classes

2019-06-28 Thread Liya Fan (JIRA)
Liya Fan created ARROW-5778: --- Summary: Extract the logic for vector data copying to the super classes Key: ARROW-5778 URL: https://issues.apache.org/jira/browse/ARROW-5778 Project: Apache Arrow Is

[jira] [Created] (ARROW-5777) [C++] BasicDecimal128 is a small object it doesn't always make sense to pass by const ref

2019-06-28 Thread Micah Kornfield (JIRA)
Micah Kornfield created ARROW-5777: -- Summary: [C++] BasicDecimal128 is a small object it doesn't always make sense to pass by const ref Key: ARROW-5777 URL: https://issues.apache.org/jira/browse/ARROW-5777

[jira] [Created] (ARROW-5776) [Gandiva][Crossbow] Revert template to have commit ids.

2019-06-28 Thread Praveen Kumar Desabandu (JIRA)
Praveen Kumar Desabandu created ARROW-5776: -- Summary: [Gandiva][Crossbow] Revert template to have commit ids. Key: ARROW-5776 URL: https://issues.apache.org/jira/browse/ARROW-5776 Project: Apa

0.14.0: Java OrcReaderTest.testOrcJniReader test is failed

2019-06-28 Thread Sutou Kouhei
Hi, I'm trying to run dev/release/00-prepare.sh that is the first script to create RC. OrcReaderTest.testOrcJniReader test is failed in the script. Could someone help me? Error log: [INFO] [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.348 s <<< FAILURE! - in org.ap