I found the issue - created LUCENE-3090 for it... I am on it. On Thu, May 12, 2011 at 3:08 PM, Michael McCandless <luc...@mikemccandless.com> wrote: > I dug some into this heap dump... > > Somehow we have a DWPT using WAY too much RAM (301 MB). A 2nd DWPT > has 105 MB tied up. I'm getting these numbers from the bytesUsed > AtomicLong in the DWPT class from the dump. > > This is baffling because, although this test indexes a large amount of > content for a reasonably long time (5 minutes w/ -nightly), IW's RAM > buffer is set to 16 MB, so these two DWPTs should have flushed long > ago. > > However, I can't tell from the dump (it doesn't have enough info) > whether these DWPTs are created by TestNRTThreads, or one of the many > other tests that run inside the same JVM. Ie, it's possible (but I > think unlikely) some other test made these massive DWPTs and then > somehow failed to clean them up (ie, left references to them). > > So my best theory at this point is something is wrong w/ the > FlushPolicy -- it's not flushing after crossing the 16 MB threshold. > > Mike > > http://blog.mikemccandless.com > > On Wed, May 11, 2011 at 10:59 PM, Apache Jenkins Server > <hud...@hudson.apache.org> wrote: >> Build: https://builds.apache.org/hudson/job/Lucene-trunk/1559/ >> >> 1 tests failed. >> FAILED: org.apache.lucene.index.TestNRTThreads.testNRTThreads >> >> Error Message: >> this writer hit an OutOfMemoryError; cannot commit >> >> Stack Trace: >> java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot >> commit >> at >> org.apache.lucene.index.IndexWriter.prepareCommit(IndexWriter.java:2456) >> at >> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2538) >> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2520) >> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2504) >> at >> org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads.java:223) >> at >> org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1282) >> at >> org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1211) >> >> >> >> >> Build Log (for compile errors): >> [...truncated 11983 lines...] >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> For additional commands, e-mail: dev-h...@lucene.apache.org >> >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > >
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
