[
https://issues.apache.org/jira/browse/SOLR-857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647679#action_12647679
]
Ruben Jimenez commented on SOLR-857:
------------------------------------
changing the ramBufferSizeMB in solrconfig didn't seem to help. I tried
varying that as well as the mergefactor, but neither seemed to help.
I've tried testing then entire set as well as in batches of 10 files at a time.
In both cases the failure occurred at the same time unless I completely
restarted at some point before the 25th file.
I'll send something out to the mailing list as well.
> Memory Leak during the indexing of large xml files
> --------------------------------------------------
>
> Key: SOLR-857
> URL: https://issues.apache.org/jira/browse/SOLR-857
> Project: Solr
> Issue Type: Bug
> Affects Versions: 1.3
> Environment: Verified on Ubuntu 8.0.4 (1.7GB RAM, 2.4GHz dual core)
> and Windows XP (2GB RAM, 2GHz pentium) both with a Java5 SDK
> Reporter: Ruben Jimenez
> Attachments: OQ_SOLR_00001.xml.zip, schema.xml
>
>
> While indexing a set of SOLR xml files that contain 5000 document adds within
> them and are about 30MB each, SOLR 1.3 seems to continually use more and more
> memory until the heap is exhausted, while the same files are indexed without
> issue with SOLR 1.2.
> Steps used to reproduce.
> 1 - Download SOLR 1.3
> 2 - Modify example schema.xml to match fields required
> 3 - start example server with following command java -Xms512m -Xmx1024m
> -XX:MaxPermSize=128m -jar start.jar
> 4 - Index files as follow java -Xmx128m -jar
> .../examples/exampledocs/post.jar *.xml
> Directory with xml files contains about 100 xml files each of about 30MB
> each. While indexing after about the 25th file SOLR 1.3 runs out of memory,
> while SOLR 1.2 is able to index the entire set of files without any problems.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
