I am using Nutch to index some directories on my hard disk. It used to work but now Nutch rejects all files.
File logs/hadoop.log has this DEBUG crawl.Generator - -shouldFetch rejected [file name here] fetchTime=1253697537652, curTime=1251105859942 for every file in directories I want to index. How can I start to debug the problem?
