I've tried margining without slicing failed segments and found out that it just goes on forever. If I shut it down, remove the temp directory, seglice the failed one and remove the old one after that, and mergesegs, it will finish in several minutes.
-----Original Message----- From: Andrzej Bialecki [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 10, 2005 3:41 PM To: [email protected] Subject: Re: Collapsing segments EM wrote: > If fetch failure happens I always create the fetcher.done file and slice the > segment into a new one. Can I skip my usual procedure and just merge > everything? Yes. The fetcher.done file was meant as a guard for other tools to prevent processing of unfinished segments; however, in practice unfinished segments occur not infrequently, so the mergesegs tool ignores this file. ------------------------------------------------------- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
