Re: [DISCUSS][Java] Design of the algorithm module

2019-09-23 Thread Micah Kornfield
Hi Liya Fan, I started reviewing but haven't gotten all the way through it. I will try to leave more comments over the next few days. Thanks again for the write-up I think it will help frame a productive conversation. -Micah On Tue, Sep 17, 2019 at 1:47 AM Fan Liya wrote: > Hi Micah, > > Thank

Re: [Discuss] [Java] DateMilliVector.getObject() return type (LocalDateTime vs LocalDate)

2019-09-23 Thread Micah Kornfield
Hi David, Is the suggestion to add something like a LocalDate getDate method? Thanks, Micah On Tue, Sep 17, 2019 at 7:39 AM David Li wrote: > Maybe a utility method to get a date instead of a datetime at least would > be useful? And/or documentation of the fact that the default behavior is > se

Re: Parquet file reading performance

2019-09-23 Thread Wes McKinney
hi Maarten, Are you using the master branch or 0.14.1? There are a number of performance regressions in 0.14.0/0.14.1 that are addressed in the master branch, to appear as 0.15.0 relatively soon. As a file format, Parquet (and columnar formats in general) is not known to perform well with more th

Re: How can I help?

2019-09-23 Thread Wes McKinney
I think writing on JIRA is the best place. Once you have a PR we can discuss on PRs On Mon, Sep 23, 2019 at 3:49 PM Weston Platter wrote: > > Wes and Nick, > > Thanks for the direction for where to pick in. > > Getting starting on the work today and working on it this week. > > For getting feedba

Re: How can I help?

2019-09-23 Thread Weston Platter
Wes and Nick, Thanks for the direction for where to pick in. Getting starting on the work today and working on it this week. For getting feedback on POC/solutions, what's preferable - updating this thread, updating Jira, something else? Thanks. On Wed, Sep 18, 2019 at 1:55 AM SemanticBeeng . <

Re: Collecting Arrow critique and our roadmap on that

2019-09-23 Thread Uwe L. Korn
Thanks to the all contributions that already came in. I made some more additions and hope to turn this into a PR to the site soon. Uwe On Fri, Sep 20, 2019, at 10:46 AM, Micah Kornfield wrote: > I think this is a good idea, as well. I added comments and additions on > the document. > > On Thu,

[jira] [Created] (ARROW-6670) [CI][R] Fix fix for R nightly jobs

2019-09-23 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-6670: -- Summary: [CI][R] Fix fix for R nightly jobs Key: ARROW-6670 URL: https://issues.apache.org/jira/browse/ARROW-6670 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-6669) [Rust] [DataFusion] Implement physical expression for binary expressions

2019-09-23 Thread Andy Grove (Jira)
Andy Grove created ARROW-6669: - Summary: [Rust] [DataFusion] Implement physical expression for binary expressions Key: ARROW-6669 URL: https://issues.apache.org/jira/browse/ARROW-6669 Project: Apache Arro

[jira] [Created] (ARROW-6668) [Rust] [DataFusion] Implement CAST expression

2019-09-23 Thread Andy Grove (Jira)
Andy Grove created ARROW-6668: - Summary: [Rust] [DataFusion] Implement CAST expression Key: ARROW-6668 URL: https://issues.apache.org/jira/browse/ARROW-6668 Project: Apache Arrow Issue Type: Sub-

[jira] [Created] (ARROW-6667) [Python] Avoid Reference Cycles in pyarrow.parquet

2019-09-23 Thread Aaron Opfer (Jira)
Aaron Opfer created ARROW-6667: -- Summary: [Python] Avoid Reference Cycles in pyarrow.parquet Key: ARROW-6667 URL: https://issues.apache.org/jira/browse/ARROW-6667 Project: Apache Arrow Issue Typ

[jira] [Created] (ARROW-6666) [Rust] [DataFusion] Implement string literal expression

2019-09-23 Thread Andy Grove (Jira)
Andy Grove created ARROW-: - Summary: [Rust] [DataFusion] Implement string literal expression Key: ARROW- URL: https://issues.apache.org/jira/browse/ARROW- Project: Apache Arrow Issue

[jira] [Created] (ARROW-6665) [Rust] [DataFusion] Implement numeric literal expressions

2019-09-23 Thread Andy Grove (Jira)
Andy Grove created ARROW-6665: - Summary: [Rust] [DataFusion] Implement numeric literal expressions Key: ARROW-6665 URL: https://issues.apache.org/jira/browse/ARROW-6665 Project: Apache Arrow Issu

[NIGHTLY] Arrow Build Report for Job nightly-2019-09-23-0

2019-09-23 Thread Crossbow
Arrow Build Report for Job nightly-2019-09-23-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-09-23-0 Failed Tasks: - docker-spark-integration: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-09-23-0-circle-docker-spark-integrati

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-09-22-0

2019-09-23 Thread Joris Van den Bossche
The dask-integration failure is being handled on the dask side (there is a PR open), and I think no changes are required on the Arrow side. On Sun, 22 Sep 2019 at 20:51, Crossbow wrote: > > Arrow Build Report for Job nightly-2019-09-22-0 > > All tasks: > https://github.com/ursa-labs/crossbow/bra