[ https://issues.apache.org/jira/browse/SOLR-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659581#comment-13659581 ]
Steven Bower commented on SOLR-4831: ------------------------------------ Looking at the timestamps on the tlog files they seem to have all been created around the same time (04:55).. starting around this time I start seeing the exception below (there were 1628).. in fact its getting tons of these (200k+) but most of the time inside regular commits... {noformat} 2013-15-05 04:55:06.634 ERROR UpdateLog [recoveryExecutor-6-thread-7922] - java.lang.ArrayIndexOutOfBoundsException: 2603 at org.apache.lucene.codecs.lucene40.BitVector.get(BitVector.java:146) at org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.nextDoc(Lucene41PostingsReader.java:492) at org.apache.lucene.index.BufferedDeletesStream.applyTermDeletes(BufferedDeletesStream.java:407) at org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:273) at org.apache.lucene.index.IndexWriter.applyAllDeletes(IndexWriter.java:2973) at org.apache.lucene.index.IndexWriter.maybeApplyDeletes(IndexWriter.java:2964) at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2704) at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2839) at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2819) at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:536) at org.apache.solr.update.UpdateLog$LogReplayer.doReplay(UpdateLog.java:1339) at org.apache.solr.update.UpdateLog$LogReplayer.run(UpdateLog.java:1163) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619) {noformat} > Transaction logs are leaking > ---------------------------- > > Key: SOLR-4831 > URL: https://issues.apache.org/jira/browse/SOLR-4831 > Project: Solr > Issue Type: Bug > Reporter: Steven Bower > > We have a system in which a client is sending 1 record at a time (via REST) > followed by a commit. This has produced ~65k tlog files and the JVM has run > out of file descriptors... I grabbed a heap dump from the JVM and I can see > ~52k "unreachable" FileDescriptors... This leads me to believe that the > TransactionLog is not properly closing all of it's files before getting rid > of the object... > I've verified with lsof that indeed there are ~60k tlog files that are open > currently.. > This is Solr 4.3.0 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org