Jeff:
What I am using is a robots.txt file that I put in the dspace webapps
directory in tomcat. I think it's working (at least we haven't
crashed lately). If you're interested in seeing my robots.txt file,
I can send it to you.
At 01:09 PM 1/14/2009, Jeffrey Trimble wrote:
Is there something simple I can place in the jsp that will prohibit
the crawlers from
using my server resources?
TIA,
Jeff
Jeffrey Trimble
Systems Librarian
Maag Library
Youngstown State University
330-941-2483 (Office)
<mailto:jtrim...@cc.ysu.edu>jtrim...@cc.ysu.edu
http://www.maag.ysu.edu
<http://digital.maag.ysu.edu>http://digital.maag.ysu.edu
------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
***************************
George Kozak
Digital Library Information Technology
501 Olin Library
Cornell University
607-255-8924
***************************
g...@cornell.edu
------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
