Hi all,
Our solr stats appear to have stopped logging. What’s the best way of saving
the existing solr entries to see if they can be saved while reseting the solr
statistics to start collecting again?
Thanks,
Tim
--
Gary,
If it is helpful, I have several SOLR stats queries in the following code:
https://github.com/Georgetown-University-Libraries/batch-tools/blob/master/web/stats/solrFacets.php
I ran into some challenges knowing when to encode and when not to encode
special characters.
Terry
On Wed, Jul
Thanks Monika,
I can see what this particular query is doing, however I'm wondering if you
know of any resources for someone like me who is just starting out with solr
queries - especially with reference to DSpace. I know the wiki has some
examples but I thought there'd be some comprehensive
Thanks a lot Terry, I'll check it out.
Gary Browne | Technical Manager Developments
University of Sydney Library
THE UNIVERSITY OF SYDNEY
Level 1, Fisher Library F03 | The University of Sydney | NSW | 2006
T +61 2 9351 5946 | M +61 405 647 868
E
%3A%5BNOW-6MONTH%2FMONTH+TO+NOW%5D+AND+bundleName%3AORIGINAL
I've no idea what field bundleName stores ;-)
Alastair
From: Gary Browne [mailto:gary.bro...@sydney.edu.au]
Sent: 02 July 2015 07:11
To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net
Subject: [Dspace-tech] Solr
Hi all,
I'm trying to figure out how to limit solr queries by date. I found this
snippet online:
http://mydspace.org/solr/statistics/select?bundleName:ORIGINALfacet.date.start=NOW/MONTH/DAY-6MONTHSfacet.date.end=NOWfacet.date.gap=1MONTH+AND+type:0+bundleName:ORIGINAL
it fails in my browser
Browne [mailto:gary.bro...@sydney.edu.au]
Sent: 02 July 2015 07:11
To: dspace-tech@lists.sourceforge.net
Subject: [Dspace-tech] Solr stats queries - limiting by date
Hi all,
I'm trying to figure out how to limit solr queries by date. I found this
snippet online:
http://mydspace.org/solr/statistics
use the fq parameter to restrict to a time range
eg fq=time:[2015-01-01T00%3A00%3A00.000Z+TO+NOW]
the query below looks at ORIGINAL bitstreams in a give collection downloaded
at least once
excluding bot queries as well as query from the given ips and downloads from
users that were logged in
: Re: [Dspace-tech] Solr stats queries - limiting by date
use the fq parameter to restrict to a time range
eg fq=time:[2015-01-01T00%3A00%3A00.000Z+TO+NOW]
the query below looks at ORIGINAL bitstreams in a give collection downloaded
at least once
excluding bot queries as well as query from
[mailto:gary.bro...@sydney.edu.au]
Sent: 02 July 2015 07:11
To: dspace-tech@lists.sourceforge.net
Subject: [Dspace-tech] Solr stats queries - limiting by date
Hi all,
I'm trying to figure out how to limit solr queries by date. I found this
snippet online:
http://mydspace.org/solr/statistics/select
Hi,
I'm having the same issue as Michael. Has anyone had success resolving the
issue?
Thanks,
Anna
On Mon, Sep 23, 2013 at 9:50 AM, helix84 heli...@centrum.sk wrote:
While waiting for someone else to respond, you may want to check out
ElasticSearch stats [1], which use a similar procedure,
Hi Peter,
Thank you for your ideas to this problem.
I don't think the auto-commit can be the problem. There is some data
just not enough. I looked at one of those problem-periods and looked at
three stats occurrences which are one after the other in Solr
(e.g. 2014-04-04T08:53:38.027Z,
Hello All,
(We are running on DSpace 1.8.2)
I was looking at our stats data for the last year and a half and I
noticed periodical drops in views/downloads which are inconsistent with
the overall usage pattern. (I did not filter out bots for that
exercise.) Numbers dropped for 1 to 5 days to
Hi Anja,
One idea I have is that with solr, for performance reasons, we have an
auto-commit process where UsageEvents don't write/commit/persist into SOLR
until the commit gets triggered, so they live only in memory until
triggered to write.
...so... If these periods had a higher than normal, or
Hi,
I’m in the process of moving from v1.6 to v3.1 – I have a v3.1 DEV system up
and running that contains an up to date/upgraded copy of my v1.6 PROD
database/assetstore and I am now starting to look at SOLR statistics on my v3.1
DEV system.
SOLR stats appear to be working on the DEV system
Hi Michael,
no solution, just some notes.
I see nothing obviously wrong in what you're doing. The high-level
procedure is correct.
The NullPointerException happens on this line [1], which indicates
that metadataStorageInfo.keySet() is null. But I don't see where
metadataStorageInfo is actually
Hi helix84,
I see nothing obviously wrong in what you're doing. The high-level procedure
is correct.
OK, thanks - always good to know that I'm on the right track at least and not
doing anything obviously stupid :-)
The NullPointerException happens on this line [1], which indicates that
While waiting for someone else to respond, you may want to check out
ElasticSearch stats [1], which use a similar procedure, but the second
step differs (stats-log-converter, stats-log-importer-elasticsearch).
I've been using them successfully.
Make sure to read my comments down on that page,
I would like to create a solr query that would tell me how many
bitstreams were downloaded from my repository in a particular month.
I would want the query NOT to include the spider downloads.
So say, how many bitstreams were downloaded from my repository in
August, not including things
Jose,
The following code illustrates the options that Georgetown has provided for
filtering our statistics. The code builds up a query string that might
help with your issue.
The following file demonstrates how I constructed date range queries and
queries for original bitstream downloads.
From looking at your code and not really knowing what the URL is
suppose to look like, I created this URL which gave me an error:
Jose,
Try the following
https://localhost/solr/statistics/select?indent=onfl=*,scorerows=10q=type:0+AND+bundleName:ORIGINAL+AND+time:[NOW-6MONTHS+TO+NOW]
If you do not need faceted results, the query is a bit easier to construct.
Terry
On Thu, Aug 29, 2013 at 3:43 PM, Jose Blanco
On 14 November 2012 13:56, helix84 heli...@centrum.sk wrote:
Hi Sean,
the only place I can think of where it may come from is the GeoIP
database ([dspace]/config/GeoLiteCity.dat). Try looking here if you
can find it:
http://www.maxmind.com/download/geoip/database/
Regards,
~~helix84
On Thu, Nov 15, 2012 at 9:01 AM, Sean Carte sean.ca...@gmail.com wrote:
Thanks, helix84, but I *hope* private IP addresses aren't listed in
there. I had a look at one of the files: GeoIPCountryCSV and that
doesn't contain private ranges as far as I can tell.
Obviously, that's a wrong thing to
On 15 November 2012 10:36, helix84 heli...@centrum.sk wrote:
Could my GeoLiteCity.dat have become corrupted somehow? Will it work
if I swap it out with a more recent one from another installation?
Sure, you can do that. Or just get the latest version from here and unzip it:
I've been trying to figure out how to use solr stats (again) and have
come across some curious results such as:
doc
str name=continentAS/str
str name=countryJapan/str
str name=countryCodeJP/str
str name=dns10.4.36.105/str
int name=id4230/int
str name=ip10.4.36.105/str
Hi Sean,
the only place I can think of where it may come from is the GeoIP
database ([dspace]/config/GeoLiteCity.dat). Try looking here if you
can find it:
http://www.maxmind.com/download/geoip/database/
Regards,
~~helix84
Compulsory reading: DSpace Mailing List Etiquette
Hi All
I am currently setting up SOLR statistics on dspace 1.8.2, while editing
solr-statistics.cfg file I checked if GeoLiteCity.dat file is existing
in config directory but it wasn't there, I used find cmd to check if is
located in any directory but the search results retrieved no value, is
GeoLiteCity.dat should be downloaded automatically by maven during the
build process. If it's not, you can get it manually:
cd [dspace]/config/
wget http://geolite.maxmind.com/download/geoip/database/GeoLiteCity.dat.gz
gzip -d GeoLiteCity.dat.gz
Then restart Tomcat.
Regards,
~~helix84
Thanks Helix.
-Original Message-
From: helix84 [mailto:heli...@centrum.sk]
Sent: 31 July 2012 03:51 PM
To: Lewatle Phaladi
Cc: DSpace-tech@lists.sourceforge.net; durasp...@lists.lib.sun.ac.za
Subject: Re: [Dspace-tech] SOLR Stats(GeoLiteCity.dat)
GeoLiteCity.dat should be downloaded
Hi All
I am not sure if my questions are too difficult for you guys as I never
got reply on several issues posted, please if that is a case email me
and I will be glad to explain where possible. Back to current issue, I
want to add date field so when I click on view statistics date can also
be
Hello!
Sent out the below message on Friday and haven't yet gotten a response...but
I have found out some more information:
Apparently with SOLR/Solrj 1.4 the default Response parser switched from XML
to binary, meaning SOLR 1.4 will have trouble talking to SOLR 3.x and below.
Might this be what
Hello,
Upgrading from 1.5.2 to 1.7.2 and the SOLR statistics are not working. I was
able to convert the old DSpace logs, but when I try to run
stats-log-importer, stats-util or access statistics from within the browser
interface they all return with the following error message: ERROR:
On 7 September 2011 15:44, Sean Carte sean.ca...@gmail.com wrote:
I'm not 100% sure, but from what I recall, DSpace tries to determine the
geo data on the moment the usage event occurs. If it can't retrieve the geo
date (country, city, longitude, lattitude, ...), it will still store the
usage
DSpace statistics gives the number of times an article has been
viewed; is it possible to get more information about those views such
as the IP address of the viewer?
Sean
--
Sean Carte
esAL Library Systems Manager
+27 72 898 8775
+27 31 373 2490
fax: 0866741254
http://esal.dut.ac.za/
Hi Sean,
that's definitely possible, the logging backend of the SOLR statistics logs
more than what is shown in the interface.
You can find a reference on everything that's logged, and some hints on how
to query SOLR directly here:
https://wiki.duraspace.org/display/DSDOCDEV/DSpace+Statistics
On 7 September 2011 13:39, Bram Luyten b...@mire.be wrote:
that's definitely possible, the logging backend of the SOLR statistics logs
more than what is shown in the interface.
You can find a reference on everything that's logged, and some hints on how
to query SOLR directly here:
On 7 September 2011 15:31, Bram Luyten b...@mire.be wrote:
with looking at the statistics for several items do you mean looking at
what the DSpace web user interface presents, or the results that the SOLR
throws back it you when you query it directly?
I meant the former: looking at what the
Hi...
I have written to the group in the past about 2 particular problems: my Solr
Statistics not working right and using the XMLUI interface not working
properly...in particular the Home page would not display.
I just wanted to report that these problems now appear to be fixed. We just
Hi people
I'm trying to get Dspace-Solr statistics to work in 1.70. It's seems
to be OK but it's not updated in real time, I mean that if anybody
visits an item or a collection, the number of accesses remain in the
old count. I've tried dspace index-update command, but it's seems to
update only
Hi Germán,
The stats do update, however, for performance reasons, we've changed the
default to not update in real-time, but to wait for an autoCommit interval.
Here are the current defaults. If you want your stats to update sooner, you
can lower the value for autocommit.
!-- Perform a commit/
Thank you very much Peter.
I'll look for this
Germán.
On Tue, Jan 4, 2011 at 1:11 PM, Peter Dietz dietz...@osu.edu wrote:
Hi Germán,
The stats do update, however, for performance reasons, we've changed the
default to not update in real-time, but to wait for an autoCommit interval.
Here are
Hi all,
I've seen that solr statistics has Fine-grained stats in dspace, it shows
community, collection, item and bitstream views.
Now I'm wondering if community views represent the sum of all
item/collection views (without counting items twice or more) placed on that
community, or they only
Dear César,
the back end logs all page views and downloads. You are correct in your
observation that total visits per month like shown for a community page
here: http://demo.dspace.org/xmlui/handle/10673/1089/statistics represents
only the pageviews of that specific community page.
It's possible
Hi All
I have setup the solr stats on my test instance and when I click on View
Statistics under Top cities views the system is showing Views as results
no data, is there anything wrong with my configuration setup.
#---#
45 matches
Mail list logo
