Hi! I have question about fetching - one of crawling process's stage. When I use commands to injecting url and fetching content, Nutch gets different number of records to fetch e.g. during first fetching it usually gets one record (main page), then about 50 records and then 100 records and so on.
On what depends number of records getting to fetch and can I change it? -- View this message in context: http://lucene.472066.n3.nabble.com/Crawling-process-Fetching-tp2873786p2873786.html Sent from the Nutch - User mailing list archive at Nabble.com.
