[
https://issues.apache.org/jira/browse/LUCENE-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853021#action_12853021
]
Earwin Burrfoot commented on LUCENE-2361:
-----------------------------------------
Basically, my bet is you're using a truckload of unique field names. Lucene
interns them for speed, as it does quite a lot of field name comparisons, and
the whole thing explodes.
Unless you fill up your PermGen in some other manner, and Lucene just happens
to hit the consequences.
The strange thing is - last time I tested String.intern(), it failed to cause
OOMs being bombarded by random strings, like it did in java 1.4.something.
> OutOfMemoryException while Indexing
> -----------------------------------
>
> Key: LUCENE-2361
> URL: https://issues.apache.org/jira/browse/LUCENE-2361
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.1
> Environment: Windows
> Reporter: Shivender Devarakonda
>
> Hi,
> We use lucene 2.9.1 version.
> We see the following OutOfMemory error in our environment, I think This is
> happening at a significant high load. Have you observed this anytime? Please
> let me know your thoughts on this.
> org.apache.lucene.index.MergePolicy$MergeException:
> java.lang.OutOfMemoryError: PermGen space
> at
> org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:351)
> at
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:315)
> Caused by: java.lang.OutOfMemoryError: PermGen space
> at java.lang.String.$$YJP$$intern(Native Method)
> at java.lang.String.intern(Unknown Source)
> at
> org.apache.lucene.util.SimpleStringInterner.intern(SimpleStringInterner.java:74)
> at org.apache.lucene.util.StringHelper.intern(StringHelper.java:36)
> at org.apache.lucene.index.FieldInfos.read(FieldInfos.java:356)
> at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:71)
> at
> org.apache.lucene.index.SegmentReader$CoreReaders.<init>(SegmentReader.java:116)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:638)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:608)
> at
> org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:686)
> at
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4979)
> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4614)
> at
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:235)
> at
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:291)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
