On Wed, Apr 24, 2013 at 3:53 PM, Kirti Bodhmage <k.bodhm...@qmul.ac.uk> wrote: > It looks like some robot is using http://qmro.qmul.ac.uk/jspui/browse url > while it should be using this url with some parameter.
Hi Kirti, that must be some kind of error in your repository, because it shouldn't happen. If you call browse without any parameter, it should display "Browsing by Title", as you can see here (I also verified it on a 1.7.2 repository): http://demo.dspace.org/jspui/browse > Is there any way to stop robot to browse the website? Definitely don't add "Disallow: /browse" to robots.txt. It would practically prevent crawlers from indexing your whole site. A better way would be to try to fix the /browse URL somehow. Either find out why it's broken and fix it in DSpace or, if n case you're using Apache HTTPD in front of httpd, you can simply redirect /jspui/browse to /jspui/browse?type=title, thus avoiding the problem. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette ------------------------------------------------------------------------------ Try New Relic Now & We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, & servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr _______________________________________________ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
