I've been getting some very strange errors with 3.2.0b3 (on Solaris 8, no
zlib) when I include the following meta info on my start_url pages:
<meta name="robots" content="noindex, follow>
If I understand the documentation correctly, this meta statement should
keep my start_url pages from being indexed, but should still allow htdig
to follow all the links. Everything worked fine before I added this meta
statement, but since then, I have been having a very tough time getting my
databases re-indexed. Rundig seems to core dump very often, which is
preventing me from getting the site indexed. I also receive
"Segmentation fault", "Bus Error - core dump", and "input in flex scanner
failed" errors. Everything worked just fine before I added the meta
statement. Any ideas?
Eric
--
Eric Luhrs | [EMAIL PROTECTED] | http://ws.bham.ac.uk
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
