Re: GPU acceleration

2011-03-13 Thread k...@kenobrien.org
I see. I will conduct my own experiments with more recent GPU libraries.
Thanks for everyone's input.
On Mar 14, 2011 2:30 AM, "Lance Norskog"  wrote:
> "There were experiments with moving both pieces of code to the GPU, and
> GPU did well in terms of speed, but they say getting data in and out
> of GPU made the approach unfeasible."
>
> That would be the problem with GPUs :) Co-processors always have this
> problem. GPUs were designed for 3d video games- the data flow into the
> GPU is low-volume (textures & triangles) and the data flow out is (I
> assume) pretty minimal.
>
> 2011/3/13 k...@kenobrien.org :
>> Vectorizable code would be the major target, yes.
>>
>> Do you know if the guys from Yandex were using CUDA or OpenCL approaches?
or
>> the old kind of opengl hacks.
>>
>>
>> On Sun, Mar 13, 2011 at 8:31 AM, Earwin Burrfoot 
wrote:
>>>
>>> On Sun, Mar 13, 2011 at 00:15, Ken O'Brien  wrote:
>>> > To clarify, I've not yet written any code. I aim to bring a large
>>> > speedup to
>>> > any functionality that is computationally expensive. I'm wondering
which
>>> > components are candidates for this.
>>> >
>>> > I'll be looking through the code but if anyone is aware of
>>> > parallelizable
>>> > code, I'll start with that.
>>> More like 'vectorizable' code, huh?
>>>
>>> Guys from Yandex use modified group varint encoding plus handcrafted
>>> SSE magic to decode/intersect posting lists and claim tremendous
>>> speedups over original group varint.
>>> They also use SSE to run the decision trees used in ranking.
>>>
>>> There were experiments with moving both pieces of code to the GPU, and
>>> GPU did well in terms of speed, but they say getting data in and out
>>> of GPU made the approach unfeasible.
>>>
>>> > I'll basically replicate existing functionality to run on the gpu.
>>> >
>>> > On 12/03/11 21:08, Simon Willnauer wrote:
>>> >>
>>> >> On Sat, Mar 12, 2011 at 9:21 PM, Ken O'Brien
 wrote:
>>> >>>
>>> >>> Hi,
>>> >>>
>>> >>> Is anyone looking at GPU acceleration for Solr? If not, I'd like to
>>> >>> contribute code which adds this functionality.
>>> >>>
>>> >>> As I'm not familiar with the codebase, does anyone know which areas
of
>>> >>> functionality could benefit from high degrees of parallelism.
>>> >>
>>> >> Very interesting can you elaborate a little more what kind of
>>> >> functionality you exposed / try to expose to the GPU?
>>> >>
>>> >> simon
>>> >>>
>>> >>> Regards,
>>> >>>
>>> >>> Ken
>>> >>>
>>> >>>
>>> >>>
>>> >>>
-
>>> >>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>>> >>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>> >>>
>>> >>>
>>> >
>>> > -
>>> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>>> > For additional commands, e-mail: dev-h...@lucene.apache.org
>>> >
>>> >
>>>
>>>
>>>
>>> --
>>> Kirill Zakharenko/Кирилл Захаренко
>>> E-Mail/Jabber: ear...@gmail.com
>>> Phone: +7 (495) 683-567-4
>>> ICQ: 104465785
>>>
>>> -
>>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>>
>>
>>
>
>
>
> --
> Lance Norskog
> goks...@gmail.com
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>


Re: GPU acceleration

2011-03-13 Thread k...@kenobrien.org
Vectorizable code would be the major target, yes.

Do you know if the guys from Yandex were using CUDA or OpenCL approaches? or
the old kind of opengl hacks.


On Sun, Mar 13, 2011 at 8:31 AM, Earwin Burrfoot  wrote:

> On Sun, Mar 13, 2011 at 00:15, Ken O'Brien  wrote:
> > To clarify, I've not yet written any code. I aim to bring a large speedup
> to
> > any functionality that is computationally expensive. I'm wondering which
> > components are candidates for this.
> >
> > I'll be looking through the code but if anyone is aware of parallelizable
> > code, I'll start with that.
> More like 'vectorizable' code, huh?
>
> Guys from Yandex use modified group varint encoding plus handcrafted
> SSE magic to decode/intersect posting lists and claim tremendous
> speedups over original group varint.
> They also use SSE to run the decision trees used in ranking.
>
> There were experiments with moving both pieces of code to the GPU, and
> GPU did well in terms of speed, but they say getting data in and out
> of GPU made the approach unfeasible.
>
> > I'll basically replicate existing functionality to run on the gpu.
> >
> > On 12/03/11 21:08, Simon Willnauer wrote:
> >>
> >> On Sat, Mar 12, 2011 at 9:21 PM, Ken O'Brien  wrote:
> >>>
> >>> Hi,
> >>>
> >>> Is anyone looking at GPU acceleration for Solr? If not, I'd like to
> >>> contribute code which adds this functionality.
> >>>
> >>> As I'm not familiar with the codebase, does anyone know which areas of
> >>> functionality could benefit from high degrees of parallelism.
> >>
> >> Very interesting can you elaborate a little more what kind of
> >> functionality you exposed / try to expose to the GPU?
> >>
> >> simon
> >>>
> >>> Regards,
> >>>
> >>> Ken
> >>>
> >>>
> >>>
> >>> -
> >>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> >>> For additional commands, e-mail: dev-h...@lucene.apache.org
> >>>
> >>>
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > For additional commands, e-mail: dev-h...@lucene.apache.org
> >
> >
>
>
>
> --
> Kirill Zakharenko/Кирилл Захаренко
> E-Mail/Jabber: ear...@gmail.com
> Phone: +7 (495) 683-567-4
> ICQ: 104465785
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>
>