It looks like you are using BalancedSegmentMergePolicy right? And somehow it gets stuck in a state where it keeps merging the same single segment into a new segment, which is odd. Likely this is a bug in BSMP.
Do you see this same looping with eg LogByteSizeMergePolicy? Note that newer versions of Lucene have a new MP, TieredMergePolicy, which generally does a better job picking merges since it's able to merge out-of-order segments... see this post for more details: http://blog.mikemccandless.com/2011/02/visualizing-lucenes-segment-merges.html Mike McCandless http://blog.mikemccandless.com On Wed, Oct 26, 2011 at 1:05 PM, alfredhong <ah...@proofpoint.com> wrote: > This is with lucene 3.0.3 running JDK 6u20 64-bit. > > I'm running into an issue where merges are looping seemingly randomly with > the use of ConcurrentMergeSchduler. By "seemingly randomly", I mean that > with repeated process restarts against very much the same data set this > behavior will occur, but it doesn't seem to be triggered by a specific > document, i.e. this is not caused by specific data. > > The following is the DEBUG logging on IndexMerger. Has anyone seen this > before or know what the issue is and the resolution for this? Note that > using "merge: total" as a milestone marker, you'll see that the Merge Thread > #0 is looping repeatedly. > > > 2011-10-25T23:27:36.791+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: setInfoStream: > dir=org.apache.lucene.store.NIOFSDirectory@/home/merger/25331545000616551-12 > lockFactory=org.apache.lucene.store.NativeFSLockFactory@142c29ff > mergePolicy=org.apache.lucene.index.BalancedSegmentMergePolicy@5421b305 > mergeScheduler=org.apache.lucene.index.ConcurrentMergeScheduler@70703869 > ramBufferSizeMB=100.0 maxBufferedDocs=-1 maxBuffereDeleteTerms=-1 > maxFieldLength=2147483647 index= > 2011-10-25T23:27:36.795+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: flush at addIndexesNoOptimize > 2011-10-25T23:27:36.795+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: flush: now pause all indexing threads > 2011-10-25T23:27:36.796+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: flush: segment=null docStoreSegment=null > docStoreOffset=0 flushDocs=false flushDeletes=true flushDocStores=false > numDocs=0 numBufDelTerms=0 > 2011-10-25T23:27:36.796+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: index before flush > 2011-10-25T23:27:36.796+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: now start transaction > 2011-10-25T23:27:36.803+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: add merge to pendingMerges: _0:Cx30877->_0 _0:Cx12519->_0 > [total 1 pending] > 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: add merge to pendingMerges: _0:Cx28305->_0 _0:Cx19527->_0 > [total 2 pending] > 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: add merge to pendingMerges: _0:Cx4605->_0 _0:Cx37050->_0 > [total 3 pending] > 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: add merge to pendingMerges: _0:Cx30862->_0 _0:Cx16948->_0 > [total 4 pending] > 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: add merge to pendingMerges: _0:Cx22130->_0 _0:Cx47560->_0 > [total 5 pending] > 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: add merge to pendingMerges: _0:Cx11198->_0 _0:Cx53059->_0 > [total 6 pending] > 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: CMS: now merge > 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: CMS: index: _0:Cx11198->_0** _0:Cx53059->_0** > _0:Cx22130->_0** _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** > _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** > _0:Cx37050->_0** _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** > _0:Cx30877->_0** _0:Cx12519->_0** > 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: CMS: consider merge _0:Cx30877->_0 _0:Cx12519->_0 into > _0 [mergeDocStores] > 2011-10-25T23:27:36.805+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: CMS: launch new thread [Lucene Merge Thread #0] > 2011-10-25T23:27:36.805+0000 DEBUG pool-9-thread-1 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > pool-9-thread-1]: CMS: too many merge threads running; stalling... > 2011-10-25T23:27:36.805+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: start > 2011-10-25T23:27:36.806+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:27:36.806+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > Lucene Merge Thread #0]: merging _0:Cx30877->_0 _0:Cx12519->_0 into _0 > [mergeDocStores] > 2011-10-25T23:27:36.807+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; > Lucene Merge Thread #0]: merge: *total 43396 docs* > 2011-10-25T23:27:37.476+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; > Lucene Merge Thread #0]: commitMerge: _0:Cx30877->_0 _0:Cx12519->_0 into _0 > [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0** > _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0** > _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** _0:Cx37050->_0** > _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:Cx30877->_0** > _0:Cx12519->_0** > 2011-10-25T23:27:37.476+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; > Lucene Merge Thread #0]: commitMergeDeletes _0:Cx30877->_0 _0:Cx12519->_0 > into _0 [mergeDocStores] > 2011-10-25T23:27:37.476+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:37 UTC 2011; > Lucene Merge Thread #0]: now checkpoint "segments_1" [15 segments ; isCommit > = false] > 2011-10-25T23:27:37.477+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge _0:Cx4605->_0 > _0:Cx37050->_0 into _2 [mergeDocStores] > 2011-10-25T23:27:37.477+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:27:37.477+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; > Lucene Merge Thread #0]: merging _0:Cx4605->_0 _0:Cx37050->_0 into _2 > [mergeDocStores] > 2011-10-25T23:27:37.478+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; > Lucene Merge Thread #0]: *merge: total 41655 docs* > 2011-10-25T23:27:38.071+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: commitMerge: _0:Cx4605->_0 _0:Cx37050->_0 into _2 > [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0** > _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0** > _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** _0:Cx37050->_0** > _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396 > 2011-10-25T23:27:38.072+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: commitMergeDeletes _0:Cx4605->_0 _0:Cx37050->_0 > into _2 [mergeDocStores] > 2011-10-25T23:27:38.072+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: now checkpoint "segments_1" [14 segments ; isCommit > = false] > 2011-10-25T23:27:38.072+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge > _0:Cx30862->_0 _0:Cx16948->_0 into _3 [mergeDocStores] > 2011-10-25T23:27:38.073+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:27:38.073+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: merging _0:Cx30862->_0 _0:Cx16948->_0 into _3 > [mergeDocStores] > 2011-10-25T23:27:38.073+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: *merge: total 47810 docs* > 2011-10-25T23:27:38.709+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: commitMerge: _0:Cx30862->_0 _0:Cx16948->_0 into _3 > [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0** > _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0** > _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** > _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396 > 2011-10-25T23:27:38.709+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: commitMergeDeletes _0:Cx30862->_0 _0:Cx16948->_0 > into _3 [mergeDocStores] > 2011-10-25T23:27:38.709+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: now checkpoint "segments_1" [13 segments ; isCommit > = false] > 2011-10-25T23:27:38.710+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge > _0:Cx22130->_0 _0:Cx47560->_0 into _4 [mergeDocStores] > 2011-10-25T23:27:38.710+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:27:38.710+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: merging _0:Cx22130->_0 _0:Cx47560->_0 into _4 > [mergeDocStores] > 2011-10-25T23:27:38.711+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; > Lucene Merge Thread #0]: *merge: total 69690 docs* > 2011-10-25T23:27:39.750+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; > Lucene Merge Thread #0]: commitMerge: _0:Cx22130->_0 _0:Cx47560->_0 into _4 > [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0** > _0:Cx47560->_0** _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** > _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** > _2:Cx75008->_0** _0:C43396 > 2011-10-25T23:27:39.750+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; > Lucene Merge Thread #0]: commitMergeDeletes _0:Cx22130->_0 _0:Cx47560->_0 > into _4 [mergeDocStores] > 2011-10-25T23:27:39.750+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:39 UTC 2011; > Lucene Merge Thread #0]: now checkpoint "segments_1" [12 segments ; isCommit > = false] > 2011-10-25T23:27:39.751+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge > _0:Cx11198->_0 _0:Cx53059->_0 into _5 [mergeDocStores] > 2011-10-25T23:27:39.751+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:27:39.751+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; > Lucene Merge Thread #0]: merging _0:Cx11198->_0 _0:Cx53059->_0 into _5 > [mergeDocStores] > 2011-10-25T23:27:39.752+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; > Lucene Merge Thread #0]: *merge: total 64257 docs* > 2011-10-25T23:27:40.770+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; > Lucene Merge Thread #0]: commitMerge: _0:Cx11198->_0 _0:Cx53059->_0 into _5 > [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _4:C69690 _3:C47810 > _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 > _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396 > 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; > Lucene Merge Thread #0]: commitMergeDeletes _0:Cx11198->_0 _0:Cx53059->_0 > into _5 [mergeDocStores] > 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:40 UTC 2011; > Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit > = false] > 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; > Lucene Merge Thread #0]: add merge to pendingMerges: _0:C43396 [total 1 > pending] > 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge _0:C43396 > into _6 [mergeDocStores] > 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; > Lucene Merge Thread #0]: merging _0:C43396 into _6 [mergeDocStores] > 2011-10-25T23:27:40.772+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; > Lucene Merge Thread #0]: *merge: total 43396 docs* > 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: commitMerge: _0:C43396 into _6 [mergeDocStores] > index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** > _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** > _2:Cx75008->_0** _0:C43396 > 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: commitMergeDeletes _0:C43396 into _6 > [mergeDocStores] > 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit > = false] > 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: delete "_0.tis" > 2011-10-25T23:27:41.386+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: delete "_0.prx" > 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: delete "_0.nrm" > 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: delete "_0.fnm" > 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: delete "_0.tii" > 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: delete "_0.frq" > 2011-10-25T23:27:41.389+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: delete "_0.fdx" > 2011-10-25T23:27:41.389+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: delete "_0.fdt" > 2011-10-25T23:27:41.394+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: add merge to pendingMerges: _6:C43396 [total 1 > pending] > 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge _6:C43396 > into _7 [mergeDocStores] > 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: merging _6:C43396 into _7 [mergeDocStores] > 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; > Lucene Merge Thread #0]: *merge: total 43396 docs* > 2011-10-25T23:27:42.012+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: commitMerge: _6:C43396 into _7 [mergeDocStores] > index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** > _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** > _2:Cx75008->_0** _6:C43396 > 2011-10-25T23:27:42.030+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: commitMergeDeletes _6:C43396 into _7 > [mergeDocStores] > 2011-10-25T23:27:42.030+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit > = false] > 2011-10-25T23:27:42.030+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: delete "_6.frq" > 2011-10-25T23:27:42.032+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: delete "_6.fdx" > 2011-10-25T23:27:42.032+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: delete "_6.tis" > 2011-10-25T23:27:42.035+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: delete "_6.tii" > 2011-10-25T23:27:42.035+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: delete "_6.prx" > 2011-10-25T23:27:42.036+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: delete "_6.fnm" > 2011-10-25T23:27:42.036+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: delete "_6.fdt" > 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: delete "_6.nrm" > 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: add merge to pendingMerges: _7:C43396 [total 1 > pending] > 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge _7:C43396 > into _8 [mergeDocStores] > 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:27:42.044+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: merging _7:C43396 into _8 [mergeDocStores] > 2011-10-25T23:27:42.044+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; > Lucene Merge Thread #0]: *merge: total 43396 docs* > 2011-10-25T23:27:43.958+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: commitMerge: _7:C43396 into _8 [mergeDocStores] > index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** > _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** > _2:Cx75008->_0** _7:C43396 > 2011-10-25T23:27:43.958+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: commitMergeDeletes _7:C43396 into _8 > [mergeDocStores] > 2011-10-25T23:27:43.959+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit > = false] > 2011-10-25T23:27:43.959+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: delete "_7.fnm" > 2011-10-25T23:27:43.959+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: delete "_7.tis" > 2011-10-25T23:27:43.963+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: delete "_7.nrm" > 2011-10-25T23:27:43.963+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: delete "_7.frq" > 2011-10-25T23:27:43.965+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: delete "_7.tii" > 2011-10-25T23:27:43.965+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: delete "_7.fdx" > 2011-10-25T23:27:43.965+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: delete "_7.fdt" > 2011-10-25T23:27:43.975+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: delete "_7.prx" > 2011-10-25T23:27:43.976+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: add merge to pendingMerges: _8:C43396 [total 1 > pending] > 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge _8:C43396 > into _9 [mergeDocStores] > 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: merging _8:C43396 into _9 [mergeDocStores] > 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; > Lucene Merge Thread #0]: *merge: total 43396 docs* > 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: commitMerge: _24m:C43396 into _24n [mergeDocStores] > index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** > _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** > _2:Cx75008->_0** _24m:C43396 > 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: commitMergeDeletes _24m:C43396 into _24n > [mergeDocStores] > 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit > = false] > 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: delete "_24m.tis" > 2011-10-25T23:59:53.358+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: delete "_24m.nrm" > 2011-10-25T23:59:53.358+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: delete "_24m.tii" > 2011-10-25T23:59:53.358+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: delete "_24m.fdt" > 2011-10-25T23:59:53.367+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: delete "_24m.fnm" > 2011-10-25T23:59:53.367+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: delete "_24m.frq" > 2011-10-25T23:59:53.369+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: delete "_24m.fdx" > 2011-10-25T23:59:53.369+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: delete "_24m.prx" > 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: add merge to pendingMerges: _24n:C43396 [total 1 > pending] > 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge _24n:C43396 > into _24o [mergeDocStores] > 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: merging _24n:C43396 into _24o [mergeDocStores] > 2011-10-25T23:59:53.371+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; > Lucene Merge Thread #0]: *merge: total 43396 docs* > 2011-10-25T23:59:59.071+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: delete "_24u.tis" > 2011-10-25T23:59:59.074+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: delete "_24u.prx" > 2011-10-25T23:59:59.075+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: delete "_24u.fdt" > 2011-10-25T23:59:59.083+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: delete "_24u.fnm" > 2011-10-25T23:59:59.083+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: delete "_24u.frq" > 2011-10-25T23:59:59.085+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: delete "_24u.fdx" > 2011-10-25T23:59:59.085+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: delete "_24u.tii" > 2011-10-25T23:59:59.085+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: delete "_24u.nrm" > 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: add merge to pendingMerges: _24v:C43396 [total 1 > pending] > 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: CMS: merge thread: do another merge _24v:C43396 > into _24w [mergeDocStores] > 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: now merge > 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: merging _24v:C43396 into _24w [mergeDocStores] > 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 > org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; > Lucene Merge Thread #0]: *merge: total 43396 docs* > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/IndexWriter-loops-trying-to-merge-using-ConcurrentMergeScheduler-tp3455163p3455163.html > Sent from the Lucene - Java Users mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org