OK, From looking at this it looks like to get bitstream stats you have to
go to the item? Is that right? Also, I'm not getting any counts even
after I go see the item and download a bitstream. I thought the solr stats
were instantaneous. I see from the log file this from when I reloaded the
app with the configuration changes:
2013-08-14 12:56:24,868 INFO org.dspace.statistics.SolrLogger @
solr-statistics.spidersfile:null
2013-08-14 12:56:24,868 INFO org.dspace.statistics.SolrLogger @
solr-statistics.server:http://dev.deepblue.lib.umich.edu/solr/statistics
2013-08-14 12:56:24,868 INFO org.dspace.statistics.SolrLogger @
usage-statistics.dbfile:/l1/dspace/repository/dev/config/GeoLiteCity.dat
2013-08-14 12:56:24,886 INFO org.dspace.statistics.SolrLogger @
useProxies=true
2013-08-14 12:56:24,894 INFO org.dspace.statistics.util.SpiderDetector @
Loaded Spider IP file:
/l1/dspace/repository/dev/config/spiders/iplists.com-altavista.txt
2013-08-14 12:56:24,896 INFO org.dspace.statistics.util.SpiderDetector @
Loaded Spider IP file:
/l1/dspace/repository/dev/config/spiders/iplists.com-excite.txt
2013-08-14 12:56:24,900 INFO org.dspace.statistics.util.SpiderDetector @
Loaded Spider IP file:
/l1/dspace/repository/dev/config/spiders/iplists.com-google.txt
2013-08-14 12:56:24,901 INFO org.dspace.statistics.util.SpiderDetector @
Loaded Spider IP file:
/l1/dspace/repository/dev/config/spiders/iplists.com-infoseek.txt
2013-08-14 12:56:24,906 INFO org.dspace.statistics.util.SpiderDetector @
Loaded Spider IP file:
/l1/dspace/repository/dev/config/spiders/iplists.com-inktomi.txt
2013-08-14 12:56:24,913 INFO org.dspace.statistics.util.SpiderDetector @
Loaded Spider IP file:
/l1/dspace/repository/dev/config/spiders/iplists.com-lycos.txt
2013-08-14 12:56:24,930 INFO org.dspace.statistics.util.SpiderDetector @
Loaded Spider IP file:
/l1/dspace/repository/dev/config/spiders/iplists.com-misc.txt
2013-08-14 12:56:24,932 INFO org.dspace.statistics.util.SpiderDetector @
Loaded Spider IP file:
/l1/dspace/repository/dev/config/spiders/iplists.com-non_engines.txt
But I never see anything in the log file about a solr stats being recorded
when I go open an item or bitstream. I wish I could query the solr
instance to see what's going on, kind of like you can with SQL. Any
advice?
Thanks!
Jose
On Tue, Aug 13, 2013 at 3:54 PM, Jose Blanco <[email protected]> wrote:
> I added this :
>
> <field name="bundleName" type="string" indexed="true" stored="true"
> required="false" multiValued="true" />
>
> to *dspace/solr/statistics/conf/schema.xml
>
> *
> reload the tomcat webapp but still don't see the bistream downloaded stats.
>
> -Jose*
> *
>
>
>
> On Tue, Aug 13, 2013 at 3:06 PM, Jose Blanco <[email protected]> wrote:
>
>> Ok, I'm seeing them now. Looking for number of bitstream downloaded in
>> each collection per item, so say item A has which contains bitstreams x and
>> y, has had x download 20 times and y download 34 times. Will keep pocking
>> around,
>>
>>
>> On Tue, Aug 13, 2013 at 2:31 PM, Jose Blanco <[email protected]> wrote:
>>
>>> I may have messed up the construction of the URL to get to the stats
>>> page when I merged my code. Can you tell me what the URL would look like if
>>> you want to access the web page with stats for a particular collection.
>>>
>>>
>>> On Tue, Aug 13, 2013 at 11:31 AM, Peter Dietz <[email protected]>wrote:
>>>
>>>> Hi Jose,
>>>>
>>>> DSpace 3.0 has SOLR Statistics enabled by default, so you shouldn't
>>>> have to alter anything to make it work. SOLR statistics gets its data by
>>>> every hit to an object firing off a UsageEvent, specifically, a
>>>> SolrLoggerUsageEventListener<https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/webapp/WEB-INF/spring/applicationContext.xml#L47>.
>>>> So, SOLR will add a document to its SOLR statistics index after a hit. You
>>>> can also do an initial load of all your data from the past.
>>>>
>>>> To import your usage data from the past, you can run the:
>>>> stats-log-converter and stats-log-importer tools.
>>>>
>>>> https://wiki.duraspace.org/display/DSDOC18/Managing+Usage+Statistics#ManagingUsageStatistics-DSpaceLogConverter
>>>>
>>>> By default, only the admin can view statistics. So, log in as the
>>>> admin, and then either view your DSpace Home page, or browse to a
>>>> Collection, a link to view statistics should show up.
>>>>
>>>>
>>>> If you are having specific errors, where the process breaks down at
>>>> some point, then mention the error you get.
>>>>
>>>> As I said, it should already be enabled, but you can double check these
>>>> things. All of the entry points that are needed for SOLR to work are:
>>>>
>>>> dspace-xmlui/src/main/webapp/WEB-INF/spring/applicationContext.xml<https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/webapp/WEB-INF/spring/applicationContext.xml>
>>>> (Needed for DSpace to forward UsageEvents to SOLR to log it)
>>>>
>>>> <!-- Inject the Default LoggerUsageEventListener into the EventService
>>>> -->
>>>>
>>>> <bean class="org.dspace.statistics.SolrLoggerUsageEventListener">
>>>>
>>>>
>>>>
>>>>
>>>> <property name="eventService" >
>>>>
>>>>
>>>>
>>>>
>>>> <ref bean="dspace.eventService"/>
>>>>
>>>>
>>>>
>>>>
>>>> </property>
>>>> </bean>
>>>>
>>>>
>>>> dspace/config/xmlui.xconf<https://github.com/DSpace/DSpace/blob/master/dspace/config/xmlui.xconf>
>>>> (Needed for the links to SOLR Stats to show up, and for SOLR Statistics
>>>> pages to work)
>>>>
>>>>
>>>>
>>>> <!-- ========================
>>>> Usage Statistics Engines
>>>> ======================== -->
>>>>
>>>> <!-- By default, DSpace uses a Statistics engine based on SOLR -->
>>>> <aspect name="Statistics" path="resource://aspects/Statistics/" />
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Then, you can tweak some further settings in:
>>>>
>>>> https://github.com/DSpace/DSpace/blob/master/dspace/config/modules/usage-statistics.cfg
>>>>
>>>> https://github.com/DSpace/DSpace/blob/master/dspace/config/modules/solr-statistics.cfg
>>>>
>>>>
>>>>
>>>> Peter Dietz
>>>>
>>>>
>>>> On Tue, Aug 13, 2013 at 10:40 AM, Jose Blanco <[email protected]>wrote:
>>>>
>>>>> I don't see details about the stats system. I'm looking for how to
>>>>> get solr stats config and going, and how to access it for version 3.0.
>>>>> I'm
>>>>> not interested in recovering old stats, just getting it going using the
>>>>> latest stats system.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Tue, Aug 13, 2013 at 10:33 AM, Hilton Gibson <
>>>>> [email protected]> wrote:
>>>>>
>>>>>> Perhaps reading this page will give you an overview of how it
>>>>>> changed: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Indexes
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 13 August 2013 16:29, Jose Blanco <[email protected]> wrote:
>>>>>>
>>>>>>> Andrea, I'm a bit confused by the stats stuff. At one time it was
>>>>>>> all based on log file entries and now it's based on entries to solr, so
>>>>>>> when I look at documentation I see things for both and don't quite
>>>>>>> understand what to do. Are there clear instructions on how stats works
>>>>>>> with solr in 3.0?
>>>>>>>
>>>>>>>
>>>>>>> It seems like stat-general gets its stats from the log files? Is
>>>>>>> that right?
>>>>>>>
>>>>>>> -Jose
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Aug 12, 2013 at 5:30 PM, Andrea Schweer <
>>>>>>> [email protected]> wrote:
>>>>>>>
>>>>>>>> Hi Jose,
>>>>>>>>
>>>>>>>>
>>>>>>>> On 13/08/13 03:23, Jose Blanco wrote:
>>>>>>>>
>>>>>>>> Just now, but when I go to the statistic page:
>>>>>>>>
>>>>>>>> I get:
>>>>>>>> No reports currently available
>>>>>>>>
>>>>>>>> There are currently no reports available for this service. Please
>>>>>>>> check back later.
>>>>>>>>
>>>>>>>>
>>>>>>>> That message comes from the content statistics -- ie the reports
>>>>>>>> that you get when you go to
>>>>>>>> http://demo.dspace.org/xmlui/statistics(you will need to be logged in
>>>>>>>> as the admin user)
>>>>>>>> To get data into these, you'll need to run [dspace]/bin/dspace
>>>>>>>> stat-general (I can't find the documentation for this in the wiki
>>>>>>>> right now)
>>>>>>>>
>>>>>>>> The configuration files you mentioned are for the
>>>>>>>> usage/search/workflow statistics -- the URLs for those are
>>>>>>>> http://demo.dspace.org/xmlui/statistics-home and
>>>>>>>> http://demo.dspace.org/xmlui/search-statistics and
>>>>>>>> http://demo.dspace.org/xmlui/workflow-statistics
>>>>>>>>
>>>>>>>> cheers,
>>>>>>>> Andrea
>>>>>>>>
>>>>>>>> --
>>>>>>>> Dr Andrea Schweer
>>>>>>>> IRR Technical Specialist, ITS Information Systems
>>>>>>>> The University of Waikato, Hamilton, New Zealand
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ------------------------------------------------------------------------------
>>>>>>> Get 100% visibility into Java/.NET code with AppDynamics Lite!
>>>>>>> It's a free troubleshooting tool designed for production.
>>>>>>> Get down to code-level detail for bottlenecks, with <2% overhead.
>>>>>>> Download for free and get started troubleshooting in minutes.
>>>>>>>
>>>>>>> http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk
>>>>>>> _______________________________________________
>>>>>>> DSpace-tech mailing list
>>>>>>> [email protected]
>>>>>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>>>>>> List Etiquette:
>>>>>>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Hilton Gibson*
>>>>>> Ubuntu Linux Systems Administrator
>>>>>> JS Gericke Library
>>>>>> Room 1025D
>>>>>> Stellenbosch University
>>>>>> Private Bag X5036
>>>>>> Stellenbosch
>>>>>> 7599
>>>>>> South Africa
>>>>>>
>>>>>> Tel: +27 21 808 4100 | Cell: +27 84 646 4758
>>>>>> http://library.sun.ac.za
>>>>>> http://za.linkedin.com/in/hiltongibson
>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> Get 100% visibility into Java/.NET code with AppDynamics Lite!
>>>>>> It's a free troubleshooting tool designed for production.
>>>>>> Get down to code-level detail for bottlenecks, with <2% overhead.
>>>>>> Download for free and get started troubleshooting in minutes.
>>>>>>
>>>>>> http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk
>>>>>> _______________________________________________
>>>>>> DSpace-tech mailing list
>>>>>> [email protected]
>>>>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>>>>> List Etiquette:
>>>>>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> Get 100% visibility into Java/.NET code with AppDynamics Lite!
>>>>> It's a free troubleshooting tool designed for production.
>>>>> Get down to code-level detail for bottlenecks, with <2% overhead.
>>>>> Download for free and get started troubleshooting in minutes.
>>>>>
>>>>> http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk
>>>>> _______________________________________________
>>>>> DSpace-tech mailing list
>>>>> [email protected]
>>>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>>>> List Etiquette:
>>>>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>>>>
>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Get 100% visibility into Java/.NET code with AppDynamics Lite!
>>>> It's a free troubleshooting tool designed for production.
>>>> Get down to code-level detail for bottlenecks, with <2% overhead.
>>>> Download for free and get started troubleshooting in minutes.
>>>>
>>>> http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk
>>>> _______________________________________________
>>>> DSpace-tech mailing list
>>>> [email protected]
>>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>>> List Etiquette:
>>>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>>>
>>>
>>>
>>
>
------------------------------------------------------------------------------
Get 100% visibility into Java/.NET code with AppDynamics Lite!
It's a free troubleshooting tool designed for production.
Get down to code-level detail for bottlenecks, with <2% overhead.
Download for free and get started troubleshooting in minutes.
http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk
_______________________________________________
DSpace-tech mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
