[ 
https://jira.duraspace.org/browse/DS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=22807#comment-22807
 ] 

Peter Dietz commented on DS-599:
--------------------------------

Hi Kevin,

I've been getting lots of java out of memory error's trying to run this. I have 
7301589 bitstream hits in SOLR.

In my SolrLogger, line 1147 is:
String csvOutput = get.getResponseBodyAsString();

DSpace.log says this:
2011-10-12 18:00:41,320 WARN  org.apache.commons.httpclient.HttpMethodBase @ 
Going to buffer response body of large or unknown size. Using 
getResponseBodyAsStream instead is recommended.

I'm going to try using Stream instead of String.

This is the stack-trace, for when I get out of memory error.
peterdietz@peterdietz ~$ sudo /dspace/bin/dspace stats-util -b
Exception: Java heap space
java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Arrays.java:2786)
        at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
        at 
org.apache.commons.httpclient.HttpMethodBase.getResponseBody(HttpMethodBase.java:691)
        at 
org.apache.commons.httpclient.HttpMethodBase.getResponseBodyAsString(HttpMethodBase.java:803)
        at 
org.dspace.statistics.SolrLogger.reindexBitstreamHits(SolrLogger.java:1147)
        at 
org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:105)

                
> SOLR statistics file download displays all files and not only those in the 
> Bundle Original
> ------------------------------------------------------------------------------------------
>
>                 Key: DS-599
>                 URL: https://jira.duraspace.org/browse/DS-599
>             Project: DSpace
>          Issue Type: Bug
>          Components: Solr
>    Affects Versions: 1.6.0, 1.6.1, 1.6.2
>            Reporter: Claudia Jürgen
>            Assignee: Kevin Van de Velde
>            Priority: Major
>             Fix For: 1.8.0
>
>         Attachments: DS-559--AddBundleNameToSOLR.patch, 
> DS-559--AddBundleNameToSOLR_V0_2.patch, 
> DS-559--AddBundleNameToSOLR_V0_3.patch, 
> DS-559--AddBundleNameToSOLR_V0_4_patch.patch, 
> DS-559--AddBundleNameToSOLR_V0_5_patch.patch, Original_bundle_bugfix.patch
>
>
> The file download statistic for an item displays all the bitstreams 
> regardless of the bundle they belong to.
> So licenses, extracted texts got displayed and counted.  This is a bit 
> confusing for the normal user as their existence is usually hidden from him.
> Furthermore I wonder whether views from the edit item stage should be counted 
> as "regular" views at all.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://jira.duraspace.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Dspace-devel mailing list
Dspace-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-devel

Reply via email to