Performance issues in update enabling the StatisticsLoggingConsumer
-------------------------------------------------------------------
Key: DS-892
URL: https://jira.duraspace.org/browse/DS-892
Project: DSpace
Issue Type: Bug
Components: Solr
Affects Versions: 1.7.1, 1.7.0, 1.6.2, 1.6.1, 1.6.0
Reporter: Andrea Bollini
Priority: Critical
We have found that enabling the StatisticsLoggingConsumer to keep statistics
data up-to-date after item changes (metadata edit or collection moving/mapping)
the item update operations become slowly and the system unusable.
NOTE: the StatisticsLoggingConsumer is NOT enabled out-of-box in the dspace.cfg
this imply that your statistics data could be incongruous (item access assigned
to incorrect communities/collections)
We noticed problems when there are large amount of statistics data (> 20M
records), for small repository (< 1M statistics record) the overhead is
acceptable.
Finally, after the introduction of the autocommit patch, the
StatisticsLoggingConsumer is not more able to assure the data consistence
because the statistics data collected between two auto-commit are not processed
by the class.
Our current idea is to discard the consumer approach in favour to implement a
batch tools to periodically analyze the statistics data and fix it as
appropriate.
This issue is a placeholder for such feature and discussion around it.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.duraspace.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
------------------------------------------------------------------------------
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network
management toolset available today. Delivers lowest initial
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd
_______________________________________________
Dspace-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-devel
