[jira] [Created] (ARROW-3841) [C++] warning: catching polymorphic type by value

2018-11-20 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-3841: --- Summary: [C++] warning: catching polymorphic type by value Key: ARROW-3841 URL: https://issues.apache.org/jira/browse/ARROW-3841 Project: Apache Arrow Issue Ty

[jira] [Created] (ARROW-3842) [R] RecordBatchStreamWriter api

2018-11-20 Thread JIRA
Romain François created ARROW-3842: -- Summary: [R] RecordBatchStreamWriter api Key: ARROW-3842 URL: https://issues.apache.org/jira/browse/ARROW-3842 Project: Apache Arrow Issue Type: New Feat

Re: Rust IPC and Integration Testing

2018-11-20 Thread Chao Sun
I think I suggested this. The idea is to isolate the auto-generated code from the other source files, and also to isolate future changes due to updates on either format or flatbuffers versions. IMO this makes the repo cleaner and more organized. Of course, ideally we should auto-generate these file

Re: [DISCUSS] Rust add adapter for parquet

2018-11-20 Thread Wes McKinney
hi folks, Would you all be interested in moving forward the parquet-rs project? I have a little more bandwidth to help with the code donation in the next month or two. I know we voted on the Parquet mailing list about the donation already. One big question is whether you want to create an apache/

Re: [DISCUSS] Rust add adapter for parquet

2018-11-20 Thread Chao Sun
Yes, we'd be interested to move forward. I'm inclined to merge this into Arrow because of the issues that you pointed out with parquet c++ merge, and I do see a tight relationship between the two projects, and potential sharing of common libraries. @Ivan Sadikov what do you think? Chao On Tue, N

[jira] [Created] (ARROW-3844) [C++] Remove ARROW_USE_SSE and ARROW_SSE3

2018-11-20 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-3844: - Summary: [C++] Remove ARROW_USE_SSE and ARROW_SSE3 Key: ARROW-3844 URL: https://issues.apache.org/jira/browse/ARROW-3844 Project: Apache Arrow Issue Type:

Re: [DISCUSS] Rust add adapter for parquet

2018-11-20 Thread Andy Grove
This sounds like a great idea. With support for both CSV and Parquet in the Arrow crate, it would be nice to design a standard interface for Arrow data sources. Maybe this is as simple as implementing `Iterator`. Andy. On Tue, Nov 20, 2018 at 11:46 AM Chao Sun wrote: > Yes, we'd be interested

Re: Rust IPC and Integration Testing

2018-11-20 Thread Krisztián Szűcs
Auto generation sounds like a good idea, similarly like rust-bindgen does it: https://rust-lang-nursery.github.io/rust-bindgen/tutorial-3.html Of course it depends on the complexity of manual edits. We can still separate the crates later if that's desired. On Tue, Nov 20, 2018 at 6:39 PM Chao Sun

Re: Rust IPC and Integration Testing

2018-11-20 Thread Chao Sun
Yes it is possible - we have done similar things in parquet-rs to generate Thrift files, using build.rs (see here ). Once the manual edits are not required we can explore that path. On Tue, Nov 20, 2018 a

[jira] [Created] (ARROW-3845) [Gandiva] [GLib] Add GGandivaNode

2018-11-20 Thread Yosuke Shiro (JIRA)
Yosuke Shiro created ARROW-3845: --- Summary: [Gandiva] [GLib] Add GGandivaNode Key: ARROW-3845 URL: https://issues.apache.org/jira/browse/ARROW-3845 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-3846) [Gandiva] Build on Windows

2018-11-20 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3846: --- Summary: [Gandiva] Build on Windows Key: ARROW-3846 URL: https://issues.apache.org/jira/browse/ARROW-3846 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-3847) [GLib] Remove unnecessary “\”.

2018-11-20 Thread Yosuke Shiro (JIRA)
Yosuke Shiro created ARROW-3847: --- Summary: [GLib] Remove unnecessary “\”. Key: ARROW-3847 URL: https://issues.apache.org/jira/browse/ARROW-3847 Project: Apache Arrow Issue Type: Improvement

Re: [DISCUSS] Joda Time -> Java8 Time

2018-11-20 Thread Praveen Kumar
Jacques, Shyam is trying to build dremio against the patch to assess impact. Will keep the list posted as we progress. Thx. On Fri, Nov 16, 2018 at 9:46 AM Jacques Nadeau wrote: > I'm worried about the change from Millis to Nanos. It seems not so good. I > think we (dremio) need to better unde