I dug some into this heap dump... Somehow we have a DWPT using WAY too much RAM (301 MB). A 2nd DWPT has 105 MB tied up. I'm getting these numbers from the bytesUsed AtomicLong in the DWPT class from the dump.
This is baffling because, although this test indexes a large amount of content for a reasonably long time (5 minutes w/ -nightly), IW's RAM buffer is set to 16 MB, so these two DWPTs should have flushed long ago. However, I can't tell from the dump (it doesn't have enough info) whether these DWPTs are created by TestNRTThreads, or one of the many other tests that run inside the same JVM. Ie, it's possible (but I think unlikely) some other test made these massive DWPTs and then somehow failed to clean them up (ie, left references to them). So my best theory at this point is something is wrong w/ the FlushPolicy -- it's not flushing after crossing the 16 MB threshold. Mike http://blog.mikemccandless.com On Wed, May 11, 2011 at 10:59 PM, Apache Jenkins Server <hud...@hudson.apache.org> wrote: > Build: https://builds.apache.org/hudson/job/Lucene-trunk/1559/ > > 1 tests failed. > FAILED: org.apache.lucene.index.TestNRTThreads.testNRTThreads > > Error Message: > this writer hit an OutOfMemoryError; cannot commit > > Stack Trace: > java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot > commit > at > org.apache.lucene.index.IndexWriter.prepareCommit(IndexWriter.java:2456) > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2538) > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2520) > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2504) > at > org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads.java:223) > at > org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1282) > at > org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1211) > > > > > Build Log (for compile errors): > [...truncated 11983 lines...] > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
