It looks like you are using BalancedSegmentMergePolicy right? And
somehow it gets stuck in a state where it keeps merging the same
single segment into a new segment, which is odd. Likely this is a bug
in BSMP.
Do you see this same looping with eg LogByteSizeMergePolicy?
Note that newer versions of Lucene have a new MP, TieredMergePolicy,
which generally does a better job picking merges since it's able to
merge out-of-order segments... see this post for more details:
http://blog.mikemccandless.com/2011/02/visualizing-lucenes-segment-merges.html
Mike McCandless
http://blog.mikemccandless.com
On Wed, Oct 26, 2011 at 1:05 PM, alfredhong <ah...@proofpoint.com> wrote:
> This is with lucene 3.0.3 running JDK 6u20 64-bit.
>
> I'm running into an issue where merges are looping seemingly randomly with
> the use of ConcurrentMergeSchduler. By "seemingly randomly", I mean that
> with repeated process restarts against very much the same data set this
> behavior will occur, but it doesn't seem to be triggered by a specific
> document, i.e. this is not caused by specific data.
>
> The following is the DEBUG logging on IndexMerger. Has anyone seen this
> before or know what the issue is and the resolution for this? Note that
> using "merge: total" as a milestone marker, you'll see that the Merge Thread
> #0 is looping repeatedly.
>
>
> 2011-10-25T23:27:36.791+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: setInfoStream:
> dir=org.apache.lucene.store.NIOFSDirectory@/home/merger/25331545000616551-12
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@142c29ff
> mergePolicy=org.apache.lucene.index.BalancedSegmentMergePolicy@5421b305
> mergeScheduler=org.apache.lucene.index.ConcurrentMergeScheduler@70703869
> ramBufferSizeMB=100.0 maxBufferedDocs=-1 maxBuffereDeleteTerms=-1
> maxFieldLength=2147483647 index=
> 2011-10-25T23:27:36.795+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: flush at addIndexesNoOptimize
> 2011-10-25T23:27:36.795+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: flush: now pause all indexing threads
> 2011-10-25T23:27:36.796+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: flush: segment=null docStoreSegment=null
> docStoreOffset=0 flushDocs=false flushDeletes=true flushDocStores=false
> numDocs=0 numBufDelTerms=0
> 2011-10-25T23:27:36.796+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: index before flush
> 2011-10-25T23:27:36.796+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: now start transaction
> 2011-10-25T23:27:36.803+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: add merge to pendingMerges: _0:Cx30877->_0 _0:Cx12519->_0
> [total 1 pending]
> 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: add merge to pendingMerges: _0:Cx28305->_0 _0:Cx19527->_0
> [total 2 pending]
> 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: add merge to pendingMerges: _0:Cx4605->_0 _0:Cx37050->_0
> [total 3 pending]
> 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: add merge to pendingMerges: _0:Cx30862->_0 _0:Cx16948->_0
> [total 4 pending]
> 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: add merge to pendingMerges: _0:Cx22130->_0 _0:Cx47560->_0
> [total 5 pending]
> 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: add merge to pendingMerges: _0:Cx11198->_0 _0:Cx53059->_0
> [total 6 pending]
> 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: CMS: now merge
> 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: CMS: index: _0:Cx11198->_0** _0:Cx53059->_0**
> _0:Cx22130->_0** _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0**
> _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0**
> _0:Cx37050->_0** _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0**
> _0:Cx30877->_0** _0:Cx12519->_0**
> 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: CMS: consider merge _0:Cx30877->_0 _0:Cx12519->_0 into
> _0 [mergeDocStores]
> 2011-10-25T23:27:36.805+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: CMS: launch new thread [Lucene Merge Thread #0]
> 2011-10-25T23:27:36.805+0000 DEBUG pool-9-thread-1
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> pool-9-thread-1]: CMS: too many merge threads running; stalling...
> 2011-10-25T23:27:36.805+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: start
> 2011-10-25T23:27:36.806+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:27:36.806+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> Lucene Merge Thread #0]: merging _0:Cx30877->_0 _0:Cx12519->_0 into _0
> [mergeDocStores]
> 2011-10-25T23:27:36.807+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011;
> Lucene Merge Thread #0]: merge: *total 43396 docs*
> 2011-10-25T23:27:37.476+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011;
> Lucene Merge Thread #0]: commitMerge: _0:Cx30877->_0 _0:Cx12519->_0 into _0
> [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0**
> _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0**
> _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** _0:Cx37050->_0**
> _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:Cx30877->_0**
> _0:Cx12519->_0**
> 2011-10-25T23:27:37.476+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011;
> Lucene Merge Thread #0]: commitMergeDeletes _0:Cx30877->_0 _0:Cx12519->_0
> into _0 [mergeDocStores]
> 2011-10-25T23:27:37.476+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:37 UTC 2011;
> Lucene Merge Thread #0]: now checkpoint "segments_1" [15 segments ; isCommit
> = false]
> 2011-10-25T23:27:37.477+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge _0:Cx4605->_0
> _0:Cx37050->_0 into _2 [mergeDocStores]
> 2011-10-25T23:27:37.477+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:27:37.477+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011;
> Lucene Merge Thread #0]: merging _0:Cx4605->_0 _0:Cx37050->_0 into _2
> [mergeDocStores]
> 2011-10-25T23:27:37.478+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 41655 docs*
> 2011-10-25T23:27:38.071+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: commitMerge: _0:Cx4605->_0 _0:Cx37050->_0 into _2
> [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0**
> _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0**
> _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** _0:Cx37050->_0**
> _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396
> 2011-10-25T23:27:38.072+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: commitMergeDeletes _0:Cx4605->_0 _0:Cx37050->_0
> into _2 [mergeDocStores]
> 2011-10-25T23:27:38.072+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: now checkpoint "segments_1" [14 segments ; isCommit
> = false]
> 2011-10-25T23:27:38.072+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge
> _0:Cx30862->_0 _0:Cx16948->_0 into _3 [mergeDocStores]
> 2011-10-25T23:27:38.073+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:27:38.073+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: merging _0:Cx30862->_0 _0:Cx16948->_0 into _3
> [mergeDocStores]
> 2011-10-25T23:27:38.073+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 47810 docs*
> 2011-10-25T23:27:38.709+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: commitMerge: _0:Cx30862->_0 _0:Cx16948->_0 into _3
> [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0**
> _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0**
> _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0**
> _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396
> 2011-10-25T23:27:38.709+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: commitMergeDeletes _0:Cx30862->_0 _0:Cx16948->_0
> into _3 [mergeDocStores]
> 2011-10-25T23:27:38.709+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: now checkpoint "segments_1" [13 segments ; isCommit
> = false]
> 2011-10-25T23:27:38.710+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge
> _0:Cx22130->_0 _0:Cx47560->_0 into _4 [mergeDocStores]
> 2011-10-25T23:27:38.710+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:27:38.710+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: merging _0:Cx22130->_0 _0:Cx47560->_0 into _4
> [mergeDocStores]
> 2011-10-25T23:27:38.711+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 69690 docs*
> 2011-10-25T23:27:39.750+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011;
> Lucene Merge Thread #0]: commitMerge: _0:Cx22130->_0 _0:Cx47560->_0 into _4
> [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0**
> _0:Cx47560->_0** _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
> _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
> _2:Cx75008->_0** _0:C43396
> 2011-10-25T23:27:39.750+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011;
> Lucene Merge Thread #0]: commitMergeDeletes _0:Cx22130->_0 _0:Cx47560->_0
> into _4 [mergeDocStores]
> 2011-10-25T23:27:39.750+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:39 UTC 2011;
> Lucene Merge Thread #0]: now checkpoint "segments_1" [12 segments ; isCommit
> = false]
> 2011-10-25T23:27:39.751+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge
> _0:Cx11198->_0 _0:Cx53059->_0 into _5 [mergeDocStores]
> 2011-10-25T23:27:39.751+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:27:39.751+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011;
> Lucene Merge Thread #0]: merging _0:Cx11198->_0 _0:Cx53059->_0 into _5
> [mergeDocStores]
> 2011-10-25T23:27:39.752+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 64257 docs*
> 2011-10-25T23:27:40.770+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011;
> Lucene Merge Thread #0]: commitMerge: _0:Cx11198->_0 _0:Cx53059->_0 into _5
> [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _4:C69690 _3:C47810
> _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655
> _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396
> 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011;
> Lucene Merge Thread #0]: commitMergeDeletes _0:Cx11198->_0 _0:Cx53059->_0
> into _5 [mergeDocStores]
> 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:40 UTC 2011;
> Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
> = false]
> 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011;
> Lucene Merge Thread #0]: add merge to pendingMerges: _0:C43396 [total 1
> pending]
> 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge _0:C43396
> into _6 [mergeDocStores]
> 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011;
> Lucene Merge Thread #0]: merging _0:C43396 into _6 [mergeDocStores]
> 2011-10-25T23:27:40.772+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 43396 docs*
> 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: commitMerge: _0:C43396 into _6 [mergeDocStores]
> index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
> _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
> _2:Cx75008->_0** _0:C43396
> 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: commitMergeDeletes _0:C43396 into _6
> [mergeDocStores]
> 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
> = false]
> 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: delete "_0.tis"
> 2011-10-25T23:27:41.386+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: delete "_0.prx"
> 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: delete "_0.nrm"
> 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: delete "_0.fnm"
> 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: delete "_0.tii"
> 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: delete "_0.frq"
> 2011-10-25T23:27:41.389+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: delete "_0.fdx"
> 2011-10-25T23:27:41.389+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: delete "_0.fdt"
> 2011-10-25T23:27:41.394+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: add merge to pendingMerges: _6:C43396 [total 1
> pending]
> 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge _6:C43396
> into _7 [mergeDocStores]
> 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: merging _6:C43396 into _7 [mergeDocStores]
> 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 43396 docs*
> 2011-10-25T23:27:42.012+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: commitMerge: _6:C43396 into _7 [mergeDocStores]
> index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
> _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
> _2:Cx75008->_0** _6:C43396
> 2011-10-25T23:27:42.030+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: commitMergeDeletes _6:C43396 into _7
> [mergeDocStores]
> 2011-10-25T23:27:42.030+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
> = false]
> 2011-10-25T23:27:42.030+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: delete "_6.frq"
> 2011-10-25T23:27:42.032+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: delete "_6.fdx"
> 2011-10-25T23:27:42.032+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: delete "_6.tis"
> 2011-10-25T23:27:42.035+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: delete "_6.tii"
> 2011-10-25T23:27:42.035+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: delete "_6.prx"
> 2011-10-25T23:27:42.036+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: delete "_6.fnm"
> 2011-10-25T23:27:42.036+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: delete "_6.fdt"
> 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: delete "_6.nrm"
> 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: add merge to pendingMerges: _7:C43396 [total 1
> pending]
> 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge _7:C43396
> into _8 [mergeDocStores]
> 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:27:42.044+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: merging _7:C43396 into _8 [mergeDocStores]
> 2011-10-25T23:27:42.044+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 43396 docs*
> 2011-10-25T23:27:43.958+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: commitMerge: _7:C43396 into _8 [mergeDocStores]
> index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
> _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
> _2:Cx75008->_0** _7:C43396
> 2011-10-25T23:27:43.958+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: commitMergeDeletes _7:C43396 into _8
> [mergeDocStores]
> 2011-10-25T23:27:43.959+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
> = false]
> 2011-10-25T23:27:43.959+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: delete "_7.fnm"
> 2011-10-25T23:27:43.959+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: delete "_7.tis"
> 2011-10-25T23:27:43.963+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: delete "_7.nrm"
> 2011-10-25T23:27:43.963+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: delete "_7.frq"
> 2011-10-25T23:27:43.965+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: delete "_7.tii"
> 2011-10-25T23:27:43.965+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: delete "_7.fdx"
> 2011-10-25T23:27:43.965+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: delete "_7.fdt"
> 2011-10-25T23:27:43.975+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: delete "_7.prx"
> 2011-10-25T23:27:43.976+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: add merge to pendingMerges: _8:C43396 [total 1
> pending]
> 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge _8:C43396
> into _9 [mergeDocStores]
> 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: merging _8:C43396 into _9 [mergeDocStores]
> 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 43396 docs*
> 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: commitMerge: _24m:C43396 into _24n [mergeDocStores]
> index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
> _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
> _2:Cx75008->_0** _24m:C43396
> 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: commitMergeDeletes _24m:C43396 into _24n
> [mergeDocStores]
> 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
> = false]
> 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: delete "_24m.tis"
> 2011-10-25T23:59:53.358+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: delete "_24m.nrm"
> 2011-10-25T23:59:53.358+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: delete "_24m.tii"
> 2011-10-25T23:59:53.358+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: delete "_24m.fdt"
> 2011-10-25T23:59:53.367+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: delete "_24m.fnm"
> 2011-10-25T23:59:53.367+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: delete "_24m.frq"
> 2011-10-25T23:59:53.369+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: delete "_24m.fdx"
> 2011-10-25T23:59:53.369+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: delete "_24m.prx"
> 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: add merge to pendingMerges: _24n:C43396 [total 1
> pending]
> 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge _24n:C43396
> into _24o [mergeDocStores]
> 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: merging _24n:C43396 into _24o [mergeDocStores]
> 2011-10-25T23:59:53.371+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 43396 docs*
> 2011-10-25T23:59:59.071+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: delete "_24u.tis"
> 2011-10-25T23:59:59.074+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: delete "_24u.prx"
> 2011-10-25T23:59:59.075+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: delete "_24u.fdt"
> 2011-10-25T23:59:59.083+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: delete "_24u.fnm"
> 2011-10-25T23:59:59.083+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: delete "_24u.frq"
> 2011-10-25T23:59:59.085+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: delete "_24u.fdx"
> 2011-10-25T23:59:59.085+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: delete "_24u.tii"
> 2011-10-25T23:59:59.085+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: delete "_24u.nrm"
> 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: add merge to pendingMerges: _24v:C43396 [total 1
> pending]
> 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: CMS: merge thread: do another merge _24v:C43396
> into _24w [mergeDocStores]
> 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: now merge
> 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: merging _24v:C43396 into _24w [mergeDocStores]
> 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0
> org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011;
> Lucene Merge Thread #0]: *merge: total 43396 docs*
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/IndexWriter-loops-trying-to-merge-using-ConcurrentMergeScheduler-tp3455163p3455163.html
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
> For additional commands, e-mail: java-user-h...@lucene.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
