On Mon, Dec 9, 2013 at 4:50 PM, S.L <simpleliving...@gmail.com> wrote:
> >>>It is. Nutch has not migrated fully to support the new MapReduce API > from > which YARN was sprung. > > Yes Nutch 1.7 is using old API, does this mean that Nutch 1.7 is > inompatible with Hadoop 2.2 ? I am thinking it is compatible in its > current state and that's why they are calling Hadoop 2.2 as backward > compatible. Isn't that the case? > > Well, I have not ran it with latest 2.X hadoop version, but you are right about backward compatibility. They would just not make the old code break unless some strong reason. Having said that, if Nutch keeps using the old deprecated hadoop API, you won't get any benefits of the changes done in newer map reduce versions. PS: Here is the relevant nutch jira for up-gradation to new Hadoop API https://issues.apache.org/jira/browse/NUTCH-1219 Thanks, Tejas > > On Mon, Dec 9, 2013 at 6:22 PM, Tejas Patil <tejas.patil...@gmail.com > >wrote: > > > >> I am not able to locate the logs either to confirm that. Can you > please > > let me know how to retrieve logs from Nutch on Hadoop? > > You should have seen the jobs over Hadoop UI and for each mapper and > > reducer you can view the logs over the browser by clicking on the job. > > > > >> YARN supposed to be backward compatible? > > It is. Nutch has not migrated fully to support the new MapReduce API from > > which YARN was sprung. > > > > > > On Mon, Dec 9, 2013 at 3:11 PM, S.L <simpleliving...@gmail.com> wrote: > > > > > Isnt ,YARN supposed to be backward compatible? > > > > > > Sent from my HTC Inspire™ 4G on AT&T > > > > > > ----- Reply message ----- > > > From: "Julien Nioche" <lists.digitalpeb...@gmail.com> > > > To: "user@nutch.apache.org" <user@nutch.apache.org> > > > Cc: "d...@nutch.apache.org" <d...@nutch.apache.org> > > > Subject: Nutch with YARN (aka Hadoop 2.0) > > > Date: Mon, Dec 9, 2013 3:54 am > > > > > > > > > I don't think Nutch has been fully ported to the new mapreduce API > which > > is > > > a prerequisite for running it on Hadoop 2. > > > I can't think of a reason why that the performance would be any > different > > > with Yarn. > > > > > > Julien > > > > > > > > > On 9 December 2013 06:42, Tejas Patil <tejas.patil...@gmail.com> > wrote: > > > > > > > Has anyone tried out running Nutch over YARN ? If so, were there were > > any > > > > performance gains with the same ? > > > > > > > > Thanks, > > > > Tejas > > > > > > > > > > > > > > > > -- > > > > > > Open Source Solutions for Text Engineering > > > > > > http://digitalpebble.blogspot.com/ > > > http://www.digitalpebble.com > > > http://twitter.com/digitalpebble > > > > > >
