If Nutch exits with an error then the segment is bad, a failing thread is not an error that leads to a failed segments. This means the segment is properly fetched but just that some records failed. Those records will be eligible for refetch.
Assuming you use the crawl command, the updatedb command will be successful so there should be no issue here. What's the problem? -----Original message----- > From:kamaci <furkankam...@gmail.com> > Sent: Wed 20-Mar-2013 23:48 > To: user@nutch.apache.org > Subject: How to Continue to Crawl with Nutch Even An Error Occurs? > > When I crawl with Nutch and error occurs (i.e. when one of threads doesn't > come within a time) it stops crawling and exits. > > Is there any configuration to continue crawling even a such kind of error > occurs at Nutch? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/How-to-Continue-to-Crawl-with-Nutch-Even-An-Error-Occurs-tp4049567.html > Sent from the Nutch - User mailing list archive at Nabble.com. >
