>From the top of my head: maybe putting some rel="nofollow" on the links?
Matteo On Sat, Jun 30, 2012 at 5:26 PM, Kevin Hinkson <[email protected]> wrote: > Hi, > Does anyone else see exceptions occurring when robots crawl the navigation > links produced by ERXFlickrNavigation? These are session based links and I > was looking for a simple way to avoid bots crawling these temporary links > over and over? (I do however want the content on each page to be crawled.) > > Any suggestions? > > — K.R.H. > > > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Webobjects-dev mailing list ([email protected]) > Help/Unsubscribe/Update your Subscription: > > https://lists.apple.com/mailman/options/webobjects-dev/wolists%40matteocentro.it > > This email sent to [email protected] > >
_______________________________________________ Do not post admin requests to the list. They will be ignored. Webobjects-dev mailing list ([email protected]) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/webobjects-dev/archive%40mail-archive.com This email sent to [email protected]
