Re: Gandiva Initiative

2018-06-27 Thread Pindikura Ravindra
libraries. I expect the developers who have been working on > this > >> will introduce themselves soon. To read more about it, take a look at > our > >> Ravindra's blog post (he's the lead developer driving this work): [2]. > >> Hopefully people will find this interesting/useful. > >> > >> Let us know what you all think! > >> > >> thanks, > >> Jacques > >> > >> > >> [1] https://github.com/dremio/gandiva > >> [2] > https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/ > >> > >

Re: Arrow and oamap [was: Re: Gandiva Initiative]

2018-06-25 Thread Jim Pivarski
; >> >>>> l_returnflag,> > >> >>>> l_linestatus;> > >> >>>> > >> >>>> Julian> > >> >>>> > >> >>>> [1] http://www.vldb.org/pvldb/vol4/p539-neumann.pdf < > >> http://www.vldb.org/pvldb/vol4/p539-neumann.pdf>> > >> >>>> > >> >>>> [2] > >> > http://blog.memsql.com/how-careful-engineering-lead-to-processing-over-a-trillion-rows-per-second/ > >> < > >> > http://blog.memsql.com/how-careful-engineering-lead-to-processing-over-a-trillion-rows-per-second/ > >> >> > >> >>>> > >> >>>> [3] https://dl.acm.org/citation.cfm?id=3183713.3190658 < > >> https://dl.acm.org/citation.cfm?id=3183713.3190658>> > >> >>>> > >> >>>> [4] https://dl.acm.org/citation.cfm?id=3183713.3190655 < > >> https://dl.acm.org/citation.cfm?id=3183713.3190655>> > >> >>>> > >> >>>>> On Jun 22, 2018, at 7:22 AM, ravind...@gmail.com wrote:> > >> >>>>>> > >> >>>>> Hi everyone,> > >> >>>>>> > >> >>>>> I'm Ravindra and I'm a developer on the Gandiva project. I do > >> believe that the combination of arrow and llvm for efficient expression > >> evaluation is powerful, and has a broad range of use-cases. We've just > >> started and hope to finesse and add a lot of functionality over the next > >> few months.> > >> >>>>>> > >> >>>>> Welcome your feedback and participation in gandiva !!> > >> >>>>>> > >> >>>>> thanks & regards,> > >> >>>>> ravindra.> > >> >>>>>> > >> >>>>> On 2018/06/21 19:15:20, Jacques Nadeau wrote: > > > >> >>>>>> Hey Guys,> > >> >>>>>>> > >> >>>>>> Dremio just open sourced a new framework for processing data in > >> Arrow data> > >> >>>>>> structures [1], built on top of the Apache Arrow C++ APIs and > >> leveraging> > >> >>>>>> LLVM (Apache licensed). It also includes Java APIs that leverage > >> the Apache> > >> >>>>>> Arrow Java libraries. I expect the developers who have been > working > >> on this> > >> >>>>>> will introduce themselves soon. To read more about it, take a > look > >> at our> > >> >>>>>> Ravindra's blog post (he's the lead developer driving this work): > >> [2].> > >> >>>>>> Hopefully people will find this interesting/useful.> > >> >>>>>>> > >> >>>>>> Let us know what you all think!> > >> >>>>>>> > >> >>>>>> thanks,> > >> >>>>>> Jacques> > >> >>>>>>> > >> >>>>>>> > >> >>>>>> [1] https://github.com/dremio/gandiva> > >> >>>>>> [2] > >> https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/> > >> >>>>>>> > >> >>>> > >> >> > >> >> — > >> >> Martin Durant > >> >> martin.dur...@utoronto.ca > >> >> > >> >> > >> >> > >> > >> — > >> Martin Durant > >> martin.dur...@utoronto.ca > >> > >> > >> > >> >

Re: Arrow and oamap [was: Re: Gandiva Initiative]

2018-06-25 Thread Wes McKinney
ldb.org/pvldb/vol4/p539-neumann.pdf>> >> >>>> >> >>>> [2] >> http://blog.memsql.com/how-careful-engineering-lead-to-processing-over-a-trillion-rows-per-second/ >> < >> http://blog.memsql.com/how-careful-engineering-lead-to-p

Re: Arrow and oamap [was: Re: Gandiva Initiative]

2018-06-25 Thread Jim Pivarski
3.3190655 < > https://dl.acm.org/citation.cfm?id=3183713.3190655>> > >>>> > >>>>> On Jun 22, 2018, at 7:22 AM, ravind...@gmail.com wrote:> > >>>>>> > >>>>> Hi everyone,> > >>>>&

Re: Arrow and oamap [was: Re: Gandiva Initiative]

2018-06-25 Thread Martin Durant
>>>> >>>>> On Jun 22, 2018, at 7:22 AM, ravind...@gmail.com wrote:> >>>>>> >>>>> Hi everyone,> >>>>>> >>>>> I'm Ravindra and I'm a developer on the Gandiva project. I do believe >>>>>

Arrow and oamap [was: Re: Gandiva Initiative]

2018-06-25 Thread Wes McKinney
erful, and has a broad range of use-cases. We've just started and hope >>>> to finesse and add a lot of functionality over the next few months.> >>>>> >>>> Welcome your feedback and participation in gandiva !!> >>>>> >>>> thanks & regards,> >>>> ravindra.> >>>>> >>>> On 2018/06/21 19:15:20, Jacques Nadeau wrote: > >>>>> Hey Guys,> >>>>>> >>>>> Dremio just open sourced a new framework for processing data in Arrow >>>>> data> >>>>> structures [1], built on top of the Apache Arrow C++ APIs and leveraging> >>>>> LLVM (Apache licensed). It also includes Java APIs that leverage the >>>>> Apache> >>>>> Arrow Java libraries. I expect the developers who have been working on >>>>> this> >>>>> will introduce themselves soon. To read more about it, take a look at our> >>>>> Ravindra's blog post (he's the lead developer driving this work): [2].> >>>>> Hopefully people will find this interesting/useful.> >>>>>> >>>>> Let us know what you all think!> >>>>>> >>>>> thanks,> >>>>> Jacques> >>>>>> >>>>>> >>>>> [1] https://github.com/dremio/gandiva> >>>>> [2] >>>>> https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/> >>>>>> >>> > > — > Martin Durant > martin.dur...@utoronto.ca > > >

Re: Gandiva Initiative

2018-06-25 Thread Martin Durant
ote: > >>>> Hey Guys,> >>>>> >>>> Dremio just open sourced a new framework for processing data in Arrow >>>> data> >>>> structures [1], built on top of the Apache Arrow C++ APIs and leveraging> >>>> LLVM (Apache licensed). It also includes Java APIs that leverage the >>>> Apache> >>>> Arrow Java libraries. I expect the developers who have been working on >>>> this> >>>> will introduce themselves soon. To read more about it, take a look at our> >>>> Ravindra's blog post (he's the lead developer driving this work): [2].> >>>> Hopefully people will find this interesting/useful.> >>>>> >>>> Let us know what you all think!> >>>>> >>>> thanks,> >>>> Jacques> >>>>> >>>>> >>>> [1] https://github.com/dremio/gandiva> >>>> [2] >>>> https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/> >>>>> >> — Martin Durant martin.dur...@utoronto.ca

Re: Gandiva Initiative

2018-06-25 Thread Praveen Kumar
row C++ APIs and leveraging> > >> LLVM (Apache licensed). It also includes Java APIs that leverage the > >> Apache> > >> Arrow Java libraries. I expect the developers who have been working on > >> this> > >> will introduce themselves soon. To read more about it, take a look at our> > >> Ravindra's blog post (he's the lead developer driving this work): [2].> > >> Hopefully people will find this interesting/useful.> > >> > > >> Let us know what you all think!> > >> > > >> thanks,> > >> Jacques> > >> > > >> > > >> [1] https://github.com/dremio/gandiva> > >> [2] > >> https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/> > >> > > >

Re: Gandiva Initiative

2018-06-24 Thread Uwe L. Korn
just open sourced a new framework for processing data in Arrow data > >>> structures [1], built on top of the Apache Arrow C++ APIs and leveraging > >>> LLVM (Apache licensed). It also includes Java APIs that leverage the > >>> Apache > >>> Arrow Jav

Re: Gandiva Initiative

2018-06-24 Thread Antoine Pitrou
pache >>> Arrow Java libraries. I expect the developers who have been working on this >>> will introduce themselves soon. To read more about it, take a look at our >>> Ravindra's blog post (he's the lead developer driving this work): [2]. >>> Hopefully people will find this interesting/useful. >>> >>> Let us know what you all think! >>> >>> thanks, >>> Jacques >>> >>> >>> [1] https://github.com/dremio/gandiva >>> [2] https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/ >>>

Re: Gandiva Initiative

2018-06-24 Thread Phillip Cloud
This is super exciting. In particular, I think for ibis ( http://docs.ibis-project.org/) building up expressions and executing them using gandiva would fit nicely as another in-memory backend alongside the pandas backend. I think it would also drive some use cases forward for more complex datatype

Re: Gandiva Initiative

2018-06-23 Thread Jacques Nadeau
> > I'd be willing to carve out some extra time to make sure patches are > getting > merged promptly until Ravindra or others become committers. > Thanks! > I think the fact that Philipp incorporated Gandiva into the Arrow > codebase and built Python bindings in less than 24 hours is a pretty

Re: Gandiva Initiative

2018-06-22 Thread Wes McKinney
rk for processing data in Arrow >> data >> >> structures [1], built on top of the Apache Arrow C++ APIs and leveraging >> >> LLVM (Apache licensed). It also includes Java APIs that leverage the >> Apache >> >> Arrow Java libraries. I expect the develo

Re: Gandiva Initiative

2018-06-22 Thread Jacques Nadeau
o read more about it, take a look at > our > >> Ravindra's blog post (he's the lead developer driving this work): [2]. > >> Hopefully people will find this interesting/useful. > >> > >> Let us know what you all think! > >> > >> thanks, > >> Jacques > >> > >> > >> [1] https://github.com/dremio/gandiva > >> [2] https://www.dremio.com/announcing-gandiva-initiative- > for-apache-arrow/ > >> >

Re: Gandiva Initiative

2018-06-22 Thread Julian Hyde
;> Ravindra's blog post (he's the lead developer driving this work): [2]. >> Hopefully people will find this interesting/useful. >> >> Let us know what you all think! >> >> thanks, >> Jacques >> >> >> [1] https://github.com/dremio/gandiva >> [2] https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/ >>

Re: Gandiva Initiative

2018-06-22 Thread ravindrap
s the lead developer driving this work): [2]. > Hopefully people will find this interesting/useful. > > Let us know what you all think! > > thanks, > Jacques > > > [1] https://github.com/dremio/gandiva > [2] https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/ >

Re: Gandiva Initiative

2018-06-22 Thread Wes McKinney
gt;> >> structures [1], built on top of the Apache Arrow C++ APIs and leveraging >> >> LLVM (Apache licensed). It also includes Java APIs that leverage the >> Apache >> >> Arrow Java libraries. I expect the developers who have been working on >> this >> >> will introduce themselves soon. To read more about it, take a look at >> our >> >> Ravindra's blog post (he's the lead developer driving this work): [2]. >> >> Hopefully people will find this interesting/useful. >> >> >> >> Let us know what you all think! >> >> >> >> thanks, >> >> Jacques >> >> >> >> >> >> [1] https://github.com/dremio/gandiva >> >> [2] https://www.dremio.com/announcing-gandiva-initiative- >> for-apache-arrow/ >> >> >>

Re: Gandiva Initiative

2018-06-22 Thread Philipp Moritz
o read more about it, take a look at > our > >> Ravindra's blog post (he's the lead developer driving this work): [2]. > >> Hopefully people will find this interesting/useful. > >> > >> Let us know what you all think! > >> > >> thanks, > >> Jacques > >> > >> > >> [1] https://github.com/dremio/gandiva > >> [2] https://www.dremio.com/announcing-gandiva-initiative- > for-apache-arrow/ > >> >

Re: Gandiva Initiative

2018-06-21 Thread Wes McKinney
about it, take a look at our >> Ravindra's blog post (he's the lead developer driving this work): [2]. >> Hopefully people will find this interesting/useful. >> >> Let us know what you all think! >> >> thanks, >> Jacques >> >> >> [1] https://github.com/dremio/gandiva >> [2] https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/ >>

Gandiva Initiative

2018-06-21 Thread Jacques Nadeau
[2] https://www.dremio.com/announcing-gandiva-initiative-for-apache-arrow/