Re: Nutch with YARN (aka Hadoop 2.0)

2013-12-09 Thread Tejas Patil
Hi Julien, In Hadoop 2.0, major components have been re-written to support the new design. Hence, its likely to observe performance differences. Thanks, Tejas On Mon, Dec 9, 2013 at 12:54 AM, Julien Nioche < lists.digitalpeb...@gmail.com> wrote: > I don't think Nutch has been fully ported to th

Re: Nutch with YARN (aka Hadoop 2.0)

2013-12-09 Thread Julien Nioche
I don't think Nutch has been fully ported to the new mapreduce API which is a prerequisite for running it on Hadoop 2. I can't think of a reason why that the performance would be any different with Yarn. Julien On 9 December 2013 06:42, Tejas Patil wrote: > Has anyone tried out running Nutch o

Nutch with YARN (aka Hadoop 2.0)

2013-12-08 Thread Tejas Patil
Has anyone tried out running Nutch over YARN ? If so, were there were any performance gains with the same ? Thanks, Tejas