Re: Gandiva Initiative

2018-06-22 Thread Wes McKinney
Thanks Jacques -- sounds good to me. I'll be interested in the feedback of others, but speaking for myself at least I'm definitely committed to helping you move quickly, and dividing some of the burdens of developing the initiative (particularly around packaging and deployment) may actually make th

Re: [DISCUSS] issue tracker

2018-06-22 Thread Jacques Nadeau
+1 On Fri, Jun 22, 2018 at 2:17 AM, Antoine Pitrou wrote: > > Le 22/06/2018 à 05:36, Wes McKinney a écrit : > > To summarize the thread: a lot of people don't like change, but > > sometimes change is good. Some people have complained privately to me > > that Arrow doesn't work like any other ran

Re: Gandiva Initiative

2018-06-22 Thread Jacques Nadeau
Hey Wes et al, Our goal at Dremio was to contribute the project to the Apache Arrow project if people think that makes sense. (So much so that you have noticed many things are already namespaced Apache.) Gandiva is another way we can continue to have Apache projects drive the vision of a deconstr

Re: Gandiva Initiative

2018-06-22 Thread Julian Hyde
This is exciting. We have wanted to build an Arrow adapter in Calcite for some time and have a prototype (see https://issues.apache.org/jira/browse/CALCITE-2173 ) but I hope that we can use Gandiva. I know that Gandiva has Java bindings, but w

[jira] [Created] (ARROW-2731) Allow usage of external ORC library

2018-06-22 Thread Michael Sarahan (JIRA)
Michael Sarahan created ARROW-2731: -- Summary: Allow usage of external ORC library Key: ARROW-2731 URL: https://issues.apache.org/jira/browse/ARROW-2731 Project: Apache Arrow Issue Type: Impr

Re: Gandiva Initiative

2018-06-22 Thread ravindrap
Hi everyone, I'm Ravindra and I'm a developer on the Gandiva project. I do believe that the combination of arrow and llvm for efficient expression evaluation is powerful, and has a broad range of use-cases. We've just started and hope to finesse and add a lot of functionality over the next few

Re: Build system discussion for Arrow (and Orc?)

2018-06-22 Thread Michael Sarahan
Thanks for the reminder. I only very recently was able to finish up my work on our arrow package. https://github.com/AnacondaRecipes/arrow-cpp-feedstock/tree/master/recipe There are some bugs in the patches I've just noticed - ORC_VENDORED isn't set properly, copy paste error. I'd also like to p

[JIRA] -ARROW-1780 - JDBC Adapter - resolved.

2018-06-22 Thread Atul Dambalkar
Hi Wes, Uwe, Sid, Laurent, I have now marked the JDBC Adapter related JIRA (https://issues.apache.org/jira/browse/ARROW-1780) as resolved. Uwe/Wes had already marked the feature for 0.10.0 release. I will continue to monitor and support the feature for any issues. I remember, Uwe wanted to use

Re: Gandiva Initiative

2018-06-22 Thread Wes McKinney
This is cool, thanks for putting together a prototype! > it would be great if we could find a good solution to integrate the two > projects and build systems At the moment I'm thinking of Gandiva as analogous to Plasma, a subcomponent of the C++ codebase to stand alongside the core Arrow codebas

Re: Gandiva Initiative

2018-06-22 Thread Philipp Moritz
This is really exciting, thanks a lot for sharing! In case anybody wants to try this out from Python, I wrote up some Cython bindings (very limited so far, but they can already be used to construct some computation graphs and do some benchmarks): https://github.com/apache/arrow/pull/2153 They are

Re: Build system discussion for Arrow (and Orc?)

2018-06-22 Thread Wes McKinney
hi Michael, I wanted to rekindle this discussion so that we can resolve these issues before Arrow 0.10.0 is released. Can you let us know what needs to be changed or submit a PR? I have a PR coming in for ARROW-902 shortly (offline builds), and I think it would be a good idea to enable all third p

Re: [DISCUSS] issue tracker

2018-06-22 Thread Antoine Pitrou
Le 22/06/2018 à 05:36, Wes McKinney a écrit : > To summarize the thread: a lot of people don't like change, but > sometimes change is good. Some people have complained privately to me > that Arrow doesn't work like any other random project on GitHub. > Anyone who doesn't contribute to the project

[jira] [Created] (ARROW-2730) [C++] Set up CMAKE_C_FLAGS more thoughtfully instead of using CMAKE_CXX_FLAGS

2018-06-22 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2730: --- Summary: [C++] Set up CMAKE_C_FLAGS more thoughtfully instead of using CMAKE_CXX_FLAGS Key: ARROW-2730 URL: https://issues.apache.org/jira/browse/ARROW-2730 Project: Ap