As far as I understood redirected urls are scored 0 and that is why fetcher does not pick them up in the earlier depths. They may be crawled starting depth 4 depending on the size of the seed list.
-----Original Message----- From: abhayd <[email protected]> To: nutch-user <[email protected]> Sent: Wed, Aug 17, 2011 4:41 pm Subject: Re: nutch redirect treatment thanks for response. But my issue is after redirect new url is not being crawled. Not a scoring issue. -- View this message in context: http://lucene.472066.n3.nabble.com/nutch-redirect-treatment-tp3261546p3263311.html Sent from the Nutch - User mailing list archive at Nabble.com.
