Hi,

Is there a way to add headers, whenever the url to be fetched matches a 
condition.

Ex: http://www.abc123.com,<http://www.abc123.com> if url contains (abc) then 
something like, addheader("username", "nutch")

?I think we can add headers for all requests in config. But is this condition 
check and adding custom header while crawling urls possible?


Thanks in advance,

-Ashok.

This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.

Reply via email to