Re: crawl dates with fetch interval 0

2009-12-02 Thread Andrzej Bialecki
reinhard schwab wrote: this crawl date will be fetched and fetched again with 0 days retry interval. i will open an issue in jira and attach a patch. Thanks for catching this bug - please do so. -- Best regards, Andrzej Bialecki <>< ___. ___ ___ ___ _ _ _

Re: crawl dates with fetch interval 0

2009-12-02 Thread reinhard schwab
i have tested this now with the current trunk of nutch. Revision: 886112 the dump of the crawl db shows http://www.wachauclimbing.net/home/impressum-disclaimer/comment-page-1/ Version: 7 Status: 2 (db_fetched) Fetch time: Wed Dec 02 12:48:22 CET 2009 Modified time: Thu Jan 01 01:00:00 CET 1970 Re

crawl dates with fetch interval 0

2009-12-01 Thread reinhard schwab
i'm observing crawl dates, which have fetch interval with value 0. when i dump the segment, i see Recno:: 33 URL:: http://www.wachauclimbing.net/home/impressum-disclaimer/comment-page-1/ CrawlDatum:: Version: 7 Status: 65 (signature) Fetch time: Tue Dec 01 23:41:15 CET 2009 Modified time: Thu Jan