Hi folks You may be interested in the work of IRUS-UK, a developing service which consolidates COUNTER-compliant statistics to enable repositories to benchmark their usage against other repositories in the UK.
IRUS-UK is filtering out robots and spiders employing the UserAgent-based COUNTER robots exclusion list (http://www.projectcounter.org/documents/COUNTER_robot_txt_list_Jan_2011.txt which is mentioned in https://jira.duraspace.org/browse/DS-790). For DSpace 1.8.x repositories, we're using patches developed by @mire. IRUS-UK follows on from the very successful PIRUS2 project, which demonstrated how article-level (COUNTER-compliant) usage statistics could be collected, JISC have provided funding to take forward the UK Institutional Repository aspects in the form of IRUS-UK. IRUS-UK is a wave 1 component of UK RepositoryNet+, the JISC funded repository and infrastructure service. IRUS is currently funded to establish a national aggregation service. It will ultimately contain details of all material downloaded from participating IRs, including downloads for full-text articles, theses, conference papers, technical reports, etc. IRUS will help to demonstrate the value and impact of institutional repositories and provide an evidence base for repositories to develop policies and initiatives to help support their objectives. IRUS-UK is being developed by a consortium involving Mimas at The University of Manchester, Cranfield University and Evidence Base at Birmingham City University. You can find our more by visiting our website which is available at http://www.irus.mimas.ac.uk. You are welcome to get in touch at i...@mimas.ac.uk if you would like further information. Cheers Paul _____________________________ Paul A S Needham Research & Innovation Manager Kings Norton Library Cranfield University Cranfield MK43 0AL -----Original Message----- From: helix84 [mailto:heli...@centrum.sk] Sent: 14 November 2012 15:21 To: Ben Sheaff Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] statistics spiders list Hi Ben, it might be helpful for you to read and watch this issue: https://jira.duraspace.org/browse/DS-790 Regards, ~~helix84 -----Original Message----- From: helix84 [mailto:heli...@centrum.sk] Sent: 07 November 2012 17:11 To: Ben Sheaff Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] statistics spiders list On Wed, Nov 7, 2012 at 5:58 PM, Ben Sheaff <bshe...@uvic.ca> wrote: > I am wonder if anyone has put together a good list of bots and spiders > for solr statistics. > > It seems that the default ones being provided by http://iplists.com > are not being updated. I don't believe you'll find a better one in the format DSpace takes by default. But it wouldn't hurt to listen to the advice given elsewhere on the web when this question is asked - detect user agent strings instead of particular IPs (which may change in time). Of course, you'd need to modify DSpace to do that. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette ------------------------------------------------------------------------------ LogMeIn Central: Instant, anywhere, Remote PC access and management. Stay in control, update software, and manage PCs from one command center Diagnose problems and improve visibility into emerging IT issues Automate, monitor and manage. Do more in less time with Central http://p.sf.net/sfu/logmein12331_d2d _______________________________________________ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech ------------------------------------------------------------------------------ Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov _______________________________________________ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech