Re: Reduce phase in Fetcher taking excessive time to finish.

2014-10-17 Thread Julien Nioche
Hi Meraj, What do the logs for the map tasks tell you about the URLs being fetched? J. On 17 October 2014 19:08, Meraj A. Khan wrote: > Julien, > > Thanks for your suggestion , I looked at the jstack thread dumps , and I > could see that the fetcher threads are in a waiting state and actually

Re: Integrating Nutch search functionality into a Java application

2014-10-17 Thread Lewis John Mcgibbney
Hi ozzy19 On Fri, Oct 17, 2014 at 11:09 AM, wrote: > > > Running the code on this url: > http://wiki.apache.org/nutch/JavaDemoApplication I get the following > message: > Found 0 hits. > > how so? why do not you search pages that contain the keyword? > > This page is very old and was last modifi

Re: Reduce phase in Fetcher taking excessive time to finish.

2014-10-17 Thread Meraj A. Khan
Julien, Thanks for your suggestion , I looked at the jstack thread dumps , and I could see that the fetcher threads are in a waiting state and actually the map phase is not yet complete looking at the JobClient console. 14/10/15 12:09:48 INFO mapreduce.Job: map 95% reduce 31% 14/10/16 07:11:20 I