Re: GSOC Mahout.GA, next steps ?

2008-05-28 Thread Grant Ingersoll
This sounds good. I don't know a lot about GAs, so if others have insight, that would be great. It would also be handy if you could put up a section on the Wiki about GAs and maybe post some links to basic papers there, so people that aren't familiar can go do some background reading. I

Re: GSOC Mahout.GA, next steps ?

2008-05-28 Thread Ted Dunning
Conceptually, at least, it would be good to have the option for fitness functions to be expressed as map-reduce programs. Unfortunately, having mappers spawn MR programs runs the real risk of dead-lock, especially on less than grandiose clusters. To me, that indicates that if the fitness function

Re: GSOC Mahout.GA, next steps ?

2008-05-28 Thread deneche abdelhakim
> Ted Dunning <[EMAIL PROTECTED]> wrote: > > Conceptually, at least, it would be good to have the option for fitness > functions to be expressed as map-reduce programs. Unfortunately, having > mappers spawn MR programs runs the real risk of dead-lock, especially on > less than grandiose clusters.

Re: GSOC Mahout.GA, next steps ?

2008-05-28 Thread Ted Dunning
How about writing the population to the file and using it as input to map-reduce directly? Evaluations that fit into a map can obviously handle that. Evaluations that need to be parallelized, can have the map emit multiple copies with sequential keys. This will put a copy of each input into mult

Re: GSOC Mahout.GA, next steps ?

2008-05-29 Thread deneche abdelhakim
--- En date de : Mer 28.5.08, Ted Dunning <[EMAIL PROTECTED]> a écrit : > How about writing the population to the file and using it as > input to map-reduce directly? Evaluations that fit into a map can > obviously handle that. This is exacly what I did in [Mahout-56] > Evaluations that need t

Re: GSOC Mahout.GA, next steps ?

2008-06-09 Thread deneche abdelhakim
I found a cool introduction to evolutionary algorithms, I added it to the wiki if someone is interested... --- En date de : Mer 28.5.08, Grant Ingersoll <[EMAIL PROTECTED]> a écrit : > De: Grant Ingersoll <[EMAIL PROTECTED]> > Objet: Re: GSOC Mahout.GA, next steps

Re: GSOC Mahout.GA, next steps ?

2008-06-09 Thread Grant Ingersoll
cool introduction to evolutionary algorithms, I added it to the wiki if someone is interested... --- En date de : Mer 28.5.08, Grant Ingersoll <[EMAIL PROTECTED]> a écrit : De: Grant Ingersoll <[EMAIL PROTECTED]> Objet: Re: GSOC Mahout.GA, next steps ? À: mahout-dev@lucene.apa