Hi All My concern is that I am crawling www.abc.xyz.com But in this I don't want to crawl pattern like www.abc.xyz.com/microsite/*/contact-us.html and www.abc.xyz.com/microsite/*/about-us.html What regex should I use as * after microsite is not working?
Thanks in advance -- View this message in context: http://lucene.472066.n3.nabble.com/Stop-particular-url-pattern-from-crawling-tp2860198p2860198.html Sent from the Nutch - User mailing list archive at Nabble.com.
