Re: [Dspace-tech] spider ip recognition

2015-05-15 Thread Pottinger, Hardy J.
rface. --Hardy From: Anthony Petryk [anthony.pet...@uottawa.ca] Sent: Thursday, May 14, 2015 12:06 PM To: Monika C. Mevenkamp; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] spider ip recognition Hi again, Unfortunately, the documentation for the stats

Re: [Dspace-tech] spider ip recognition

2015-05-15 Thread Anthony Petryk
issue). Best, Anthony From: Pottinger, Hardy J. [mailto:pottinge...@missouri.edu] Sent: Friday, May 15, 2015 10:19 AM To: Anthony Petryk; Monika C. Mevenkamp; dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] spider ip recognition Hi, you've run into a known issue, and one I very re

Re: [Dspace-tech] spider ip recognition

2015-05-14 Thread Anthony Petryk
. Anthony From: Monika C. Mevenkamp [mailto:moni...@princeton.edu] Sent: Thursday, May 14, 2015 11:17 AM To: Anthony Petryk Cc: Monika C. Mevenkamp; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] spider ip recognition Anthony Since dspace 4 you can filter by userAgent

Re: [Dspace-tech] spider ip recognition

2015-05-14 Thread Monika C. Mevenkamp
Friday, May 08, 2015 9:59 AM To: Anthony Petryk Cc: dspace-tech@lists.sourceforge.net<mailto:dspace-tech@lists.sourceforge.net> Subject: Re: [Dspace-tech] spider ip recognition Anthony I wrote a small ruby script to put solr queries together when I was poking around my stats see https://githu

Re: [Dspace-tech] spider ip recognition

2015-05-12 Thread Anthony Petryk
ct: Re: [Dspace-tech] spider ip recognition Anthony I wrote a small ruby script to put solr queries together when I was poking around my stats see https://github.com/akinom/dscriptor/blob/master/solr/solr_query.rb an example parameter file is https://github.com/akinom/dscriptor/blob/master/solr

Re: [Dspace-tech] spider ip recognition

2015-05-08 Thread Anthony Petryk
Thanks very much Monika! I'll try it out. Cheers, Anthony From: Monika C. Mevenkamp [mailto:moni...@princeton.edu] Sent: Friday, May 08, 2015 9:59 AM To: Anthony Petryk Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] spider ip recognition Anthony I wrote a small ruby s

Re: [Dspace-tech] spider ip recognition

2015-05-08 Thread Monika C. Mevenkamp
Anthony I wrote a small ruby script to put solr queries together when I was poking around my stats see https://github.com/akinom/dscriptor/blob/master/solr/solr_query.rb an example parameter file is https://github.com/akinom/dscriptor/blob/master/solr/solr_query.yml run it asruby solr/solr

Re: [Dspace-tech] spider ip recognition

2015-05-07 Thread Anthony Petryk
logies émergentes uOttawa Library | Bibliothèque uOttawa 613-562-5800 x4650 apet...@uottawa.ca -Original Message- From: Mark H. Wood [mailto:mw...@iupui.edu] Sent: Friday, April 24, 2015 9:42 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] spider ip recognition On Thu, Ap

Re: [Dspace-tech] spider ip recognition

2015-04-24 Thread Mark H. Wood
On Thu, Apr 23, 2015 at 05:39:01PM +, Monika C. Mevenkamp wrote: > I found a couple of really suspicious numbers in my solr stats, aka lots of > entries were marked as isBot=false although the probably should has been > isBot=true. > > In the config file I use > > spiderips.urls = http://i

[Dspace-tech] spider ip recognition

2015-04-23 Thread Monika C. Mevenkamp
I found a couple of really suspicious numbers in my solr stats, aka lots of entries were marked as isBot=false although the probably should has been isBot=true. In the config file I use spiderips.urls = http://iplists.com/google.txt, \ http://iplists.com/inktomi.txt, \