Re: Compute kernels and Gandiva operators

2019-02-13 Thread Ravindra Pindikura
Thanks, Wes and Francois. > On Feb 13, 2019, at 10:16 PM, Francois Saint-Jacques > wrote: > > Hi, > > I also agree that we should follow a model similar to what you propose. I > think the plan is, correct me if I'm wrong Wes, to write the logical plan > operators, then write a small execution

Re: Compute kernels and Gandiva operators

2019-02-13 Thread Francois Saint-Jacques
Hi, I also agree that we should follow a model similar to what you propose. I think the plan is, correct me if I'm wrong Wes, to write the logical plan operators, then write a small execution engine prototype and produce a proper design document out of this experiment. There's also a placeholder t

Re: Compute kernels and Gandiva operators

2019-02-13 Thread Wes McKinney
hi Ravindra, On Wed, Feb 13, 2019 at 1:34 AM Ravindra Pindikura wrote: > > Hi, > > I was looking at the recent checkin for arrow kernels, and started to think > of how they would work alongside Gandiva. > > Here are my thoughts : > > 1. Gandiva already has two high-level operators namely projec

Compute kernels and Gandiva operators

2019-02-12 Thread Ravindra Pindikura
Hi, I was looking at the recent checkin for arrow kernels, and started to think of how they would work alongside Gandiva. Here are my thoughts : 1. Gandiva already has two high-level operators namely project and filter, with runtime code generation * It already supports 100s of functions (eg.