Hello,
We have a client that is using lucene 3.0.3.
They are working with NAS storage device which recently had permission
issues,
which might have generated some "out of disk space" exceptions during
indexing.
We are uncertain if they also suffered JDK crashes in the past few months,
as we
discovered dmp files and javacores on their system.
Consequently, they now have 3 corrupted indices.
All of them show a similar issue:
java.io.IOException: No sub-file with id _xv.fnm found
at
org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:137)
at
org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:125)
at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:68)
at
org.apache.lucene.index.SegmentReader$CoreReaders.<init>(SegmentReader.java:120)
at
org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605)
at
org.apache.lucene.index.SegmentReader.get(SegmentReader.java:583)
at
org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:470)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883)
Looking at the indices file listing, I see that this file (i.e. - _xv.fnm)
is really missing,
but I also see that a compound file with the same name exist on disk (i.e.
- _xv.cfs).
My question is -
is there a way to "save" the collection by re-creating the fnm
file from the cfs file (or in any other way...?)
Or does our client need to re-index the entire collection?
(Assuming the checkIndex -fix option is no good, because we cannot know
which documents are lost...)
I'm attaching the checkIndex output as reference
Thanks in advance!
Shlomit
Segments file=segments_x6 numSegments=29 version=FORMAT_DIAGNOSTICS [Lucene 2.9]
1 of 29: name=_b8 docCount=30727
compound=false
hasProx=true
numFiles=8
size (MB)=442.925
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [11 fields]
test: field norms.........OK [6 fields]
test: terms, freq, prox...OK [383168 terms; 29131147 terms/docs pairs;
268682250 tokens]
test: stored fields.......OK [92181 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
2 of 29: name=_ht docCount=11792
compound=false
hasProx=true
numFiles=8
size (MB)=158.439
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [159210 terms; 11338024 terms/docs pairs;
91542694 tokens]
test: stored fields.......OK [35376 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
3 of 29: name=_ky docCount=4716
compound=false
hasProx=true
numFiles=8
size (MB)=75.416
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [150944 terms; 4759448 terms/docs pairs;
43546597 tokens]
test: stored fields.......OK [14148 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
4 of 29: name=_ml docCount=3204
compound=true
hasProx=true
numFiles=1
size (MB)=41.564
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [158026 terms; 3113442 terms/docs pairs;
22692916 tokens]
test: stored fields.......OK [9612 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
5 of 29: name=_o0 docCount=2450
compound=true
hasProx=true
numFiles=1
size (MB)=21.541
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [53219 terms; 2254105 terms/docs pairs;
11105612 tokens]
test: stored fields.......OK [7350 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
6 of 29: name=_s7 docCount=3341
compound=true
hasProx=true
numFiles=1
size (MB)=29.376
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [69215 terms; 3065127 terms/docs pairs;
15137136 tokens]
test: stored fields.......OK [10023 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
7 of 29: name=_tf docCount=1509
compound=true
hasProx=true
numFiles=1
size (MB)=18.781
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [70994 terms; 1416102 terms/docs pairs;
10180774 tokens]
test: stored fields.......OK [4527 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
8 of 29: name=_ty docCount=1250
compound=true
hasProx=true
numFiles=1
size (MB)=25.537
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [75802 terms; 1260224 terms/docs pairs;
14900414 tokens]
test: stored fields.......OK [3750 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
9 of 29: name=_ua docCount=966
compound=true
hasProx=true
numFiles=1
size (MB)=16.318
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [70442 terms; 930813 terms/docs pairs; 9354526
tokens]
test: stored fields.......OK [2898 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
10 of 29: name=_um docCount=1019
compound=true
hasProx=true
numFiles=1
size (MB)=17.104
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [63092 terms; 1016149 terms/docs pairs;
9758080 tokens]
test: stored fields.......OK [3057 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
11 of 29: name=_v9 docCount=1042
compound=true
hasProx=true
numFiles=1
size (MB)=17.91
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [69245 terms; 1093201 terms/docs pairs;
10318139 tokens]
test: stored fields.......OK [3126 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
12 of 29: name=_v4 docCount=62
compound=true
hasProx=true
numFiles=1
size (MB)=0.43
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [4065 terms; 49116 terms/docs pairs; 208385
tokens]
test: stored fields.......OK [186 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
13 of 29: name=_v5 docCount=16
compound=true
hasProx=true
numFiles=1
size (MB)=0.076
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1425 terms; 8250 terms/docs pairs; 30427
tokens]
test: stored fields.......OK [48 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
14 of 29: name=_v6 docCount=11
compound=true
hasProx=true
numFiles=1
size (MB)=0.978
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [9794 terms; 37283 terms/docs pairs; 573014
tokens]
test: stored fields.......OK [33 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
15 of 29: name=_v7 docCount=66
compound=true
hasProx=true
numFiles=1
size (MB)=0.872
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [9720 terms; 70929 terms/docs pairs; 447661
tokens]
test: stored fields.......OK [198 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
16 of 29: name=_v8 docCount=69
compound=true
hasProx=true
numFiles=1
size (MB)=2.388
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [18403 terms; 71299 terms/docs pairs; 1565563
tokens]
test: stored fields.......OK [207 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
17 of 29: name=_vk docCount=624
compound=true
hasProx=true
numFiles=1
size (MB)=4.435
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [20055 terms; 555375 terms/docs pairs; 2091595
tokens]
test: stored fields.......OK [1872 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
18 of 29: name=_vv docCount=320
compound=true
hasProx=true
numFiles=1
size (MB)=4.389
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [27593 terms; 315677 terms/docs pairs; 2384607
tokens]
test: stored fields.......OK [960 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
19 of 29: name=_wg docCount=219
compound=true
hasProx=true
numFiles=1
size (MB)=1.662
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [11959 terms; 190211 terms/docs pairs; 789848
tokens]
test: stored fields.......OK [657 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
20 of 29: name=_xd docCount=346
compound=true
hasProx=true
numFiles=1
size (MB)=2.615
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [14716 terms; 314120 terms/docs pairs; 1239198
tokens]
test: stored fields.......OK [1038 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
21 of 29: name=_xo docCount=89
compound=true
hasProx=true
numFiles=1
size (MB)=0.643
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [5441 terms; 80208 terms/docs pairs; 290363
tokens]
test: stored fields.......OK [267 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
22 of 29: name=_xp docCount=1
compound=true
hasProx=true
numFiles=1
size (MB)=0.019
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1056 terms; 1056 terms/docs pairs; 4863
tokens]
test: stored fields.......OK [3 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
23 of 29: name=_xq docCount=11
compound=true
hasProx=true
numFiles=1
size (MB)=0.085
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1840 terms; 9752 terms/docs pairs; 33863
tokens]
test: stored fields.......OK [33 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
24 of 29: name=_xr docCount=9
compound=true
hasProx=true
numFiles=1
size (MB)=0.073
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1700 terms; 8153 terms/docs pairs; 28730
tokens]
test: stored fields.......OK [27 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
25 of 29: name=_xs docCount=7
compound=true
hasProx=true
numFiles=1
size (MB)=0.057
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1542 terms; 6263 terms/docs pairs; 21500
tokens]
test: stored fields.......OK [21 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
26 of 29: name=_xt docCount=7
compound=true
hasProx=true
numFiles=1
size (MB)=0.056
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1369 terms; 6189 terms/docs pairs; 21575
tokens]
test: stored fields.......OK [21 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
27 of 29: name=_xu docCount=19
compound=true
hasProx=true
numFiles=1
size (MB)=0.146
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [2298 terms; 17475 terms/docs pairs; 61062
tokens]
test: stored fields.......OK [57 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
28 of 29: name=_xv docCount=14
compound=true
hasProx=true
numFiles=1
size (MB)=0.106
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........FAILED
WARNING: fixIndex() would remove reference to this segment; full exception:
java.io.IOException: No sub-file with id _xv.fnm found
at
org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:137)
at
org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:125)
at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:68)
at
org.apache.lucene.index.SegmentReader$CoreReaders.<init>(SegmentReader.java:120)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:583)
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:470)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883)
29 of 29: name=_xw docCount=22
compound=true
hasProx=true
numFiles=1
size (MB)=0.16
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [2324 terms; 19289 terms/docs pairs; 67452
tokens]
test: stored fields.......OK [66 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
WARNING: 1 broken segments (containing 14 documents) detected
WARNING: would write new segments file, and 14 documents would be lost, if -fix
were specified
Segments file=segments_ww numSegments=21 version=FORMAT_DIAGNOSTICS [Lucene 2.9]
1 of 21: name=_d3 docCount=33569
compound=false
hasProx=true
numFiles=8
size (MB)=488.289
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [11 fields]
test: field norms.........OK [6 fields]
test: terms, freq, prox...OK [472453 terms; 31996989 terms/docs pairs;
288159061 tokens]
test: stored fields.......OK [100707 total field count; avg 3 fields per
doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
2 of 21: name=_of docCount=17551
compound=false
hasProx=true
numFiles=8
size (MB)=221.674
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........ERROR [read past EOF]
java.io.IOException: read past EOF
at
org.apache.lucene.store.BufferedIndexInput.readBytes(BufferedIndexInput.java:138)
at
org.apache.lucene.index.SegmentReader$Norm.bytes(SegmentReader.java:436)
at org.apache.lucene.index.SegmentReader.norms(SegmentReader.java:1093)
at
org.apache.lucene.index.CheckIndex.testFieldNorms(CheckIndex.java:574)
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:506)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883)
test: terms, freq, prox...OK [263594 terms; 16868978 terms/docs pairs;
126058016 tokens]
test: stored fields.......OK [52653 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
FAILED
WARNING: fixIndex() would remove reference to this segment; full exception:
java.lang.RuntimeException: Field Norm test failed
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:520)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883)
3 of 21: name=_vb docCount=9309
compound=false
hasProx=true
numFiles=8
size (MB)=106.322
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [164318 terms; 8850839 terms/docs pairs;
59061705 tokens]
test: stored fields.......OK [27927 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
4 of 21: name=_we docCount=2420
compound=true
hasProx=true
numFiles=1
size (MB)=43.43
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [94278 terms; 2483076 terms/docs pairs;
25656119 tokens]
test: stored fields.......OK [7260 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
5 of 21: name=_wc docCount=77
compound=true
hasProx=true
numFiles=1
size (MB)=0.741
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [7528 terms; 74337 terms/docs pairs; 359211
tokens]
test: stored fields.......OK [231 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
6 of 21: name=_wd docCount=62
compound=true
hasProx=true
numFiles=1
size (MB)=8.042
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [55645 terms; 112721 terms/docs pairs; 4896353
tokens]
test: stored fields.......OK [186 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
7 of 21: name=_wp docCount=180
compound=true
hasProx=true
numFiles=1
size (MB)=2.443
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [16275 terms; 171479 terms/docs pairs; 1329084
tokens]
test: stored fields.......OK [540 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
8 of 21: name=_wq docCount=6
compound=true
hasProx=true
numFiles=1
size (MB)=0.059
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [2131 terms; 5721 terms/docs pairs; 20329
tokens]
test: stored fields.......OK [18 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
9 of 21: name=_wr docCount=11
compound=true
hasProx=true
numFiles=1
size (MB)=0.732
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [9378 terms; 18783 terms/docs pairs; 443584
tokens]
test: stored fields.......OK [33 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
10 of 21: name=_ws docCount=5
compound=true
hasProx=true
numFiles=1
size (MB)=2.453
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [11782 terms; 27913 terms/docs pairs; 1576033
tokens]
test: stored fields.......OK [15 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
11 of 21: name=_x3 docCount=85
compound=true
hasProx=true
numFiles=1
size (MB)=0.543
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [5082 terms; 68529 terms/docs pairs; 241403
tokens]
test: stored fields.......OK [255 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
12 of 21: name=_x4 docCount=23
compound=true
hasProx=true
numFiles=1
size (MB)=0.141
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1990 terms; 17849 terms/docs pairs; 58751
tokens]
test: stored fields.......OK [69 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
13 of 21: name=_x5 docCount=12
compound=true
hasProx=true
numFiles=1
size (MB)=0.086
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1622 terms; 10473 terms/docs pairs; 35431
tokens]
test: stored fields.......OK [36 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
14 of 21: name=_x6 docCount=7
compound=true
hasProx=true
numFiles=1
size (MB)=0.053
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1236 terms; 5988 terms/docs pairs; 20532
tokens]
test: stored fields.......OK [21 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
15 of 21: name=_x7 docCount=28
compound=true
hasProx=true
numFiles=1
size (MB)=0.202
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [2824 terms; 25213 terms/docs pairs; 86466
tokens]
test: stored fields.......OK [84 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
16 of 21: name=_x8 docCount=22
compound=true
hasProx=true
numFiles=1
size (MB)=0.151
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [2306 terms; 18537 terms/docs pairs; 62645
tokens]
test: stored fields.......OK [66 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
17 of 21: name=_x9 docCount=14
compound=true
hasProx=true
numFiles=1
size (MB)=0.104
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [2121 terms; 12472 terms/docs pairs; 42585
tokens]
test: stored fields.......OK [42 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
18 of 21: name=_xa docCount=11
compound=true
hasProx=true
numFiles=1
size (MB)=0.084
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1789 terms; 9887 terms/docs pairs; 33684
tokens]
test: stored fields.......OK [33 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
19 of 21: name=_xb docCount=12
compound=true
hasProx=true
numFiles=1
size (MB)=0.093
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........FAILED
WARNING: fixIndex() would remove reference to this segment; full exception:
java.io.IOException: No sub-file with id _xb.fnm found
at
org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:137)
at
org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:125)
at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:68)
at
org.apache.lucene.index.SegmentReader$CoreReaders.<init>(SegmentReader.java:120)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:583)
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:470)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883)
20 of 21: name=_xc docCount=7
compound=true
hasProx=true
numFiles=1
size (MB)=0.06
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [1605 terms; 6529 terms/docs pairs; 22798
tokens]
test: stored fields.......OK [21 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
21 of 21: name=_xe docCount=15
compound=true
hasProx=true
numFiles=1
size (MB)=0.118
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [2228 terms; 14122 terms/docs pairs; 49732
tokens]
test: stored fields.......OK [45 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
WARNING: 2 broken segments (containing 17563 documents) detected
WARNING: would write new segments file, and 17563 documents would be lost, if
-fix were specifiedSegments file=segments_ng numSegments=18 version=FORMAT_DIAGNOSTICS [Lucene 2.9]
1 of 18: name=_ap docCount=29262
compound=false
hasProx=true
numFiles=8
size (MB)=413.426
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [11 fields]
test: field norms.........OK [6 fields]
test: terms, freq, prox...OK [399991 terms; 27579250 terms/docs pairs;
245320046 tokens]
test: stored fields.......OK [87786 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
2 of 18: name=_ej docCount=6607
compound=false
hasProx=true
numFiles=8
size (MB)=86.332
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [149415 terms; 6357186 terms/docs pairs;
48851691 tokens]
test: stored fields.......OK [19821 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
3 of 18: name=_jo docCount=9171
compound=false
hasProx=true
numFiles=8
size (MB)=128.155
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [212269 terms; 8935967 terms/docs pairs;
74287984 tokens]
test: stored fields.......OK [27513 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
4 of 18: name=_l4 docCount=2051
compound=true
hasProx=true
numFiles=1
size (MB)=34.312
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [84018 terms; 2036360 terms/docs pairs;
19835816 tokens]
test: stored fields.......OK [6153 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
5 of 18: name=_lp docCount=962
compound=true
hasProx=true
numFiles=1
size (MB)=17.458
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [63511 terms; 965921 terms/docs pairs;
10022696 tokens]
test: stored fields.......OK [2886 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
6 of 18: name=_m5 docCount=465
compound=true
hasProx=true
numFiles=1
size (MB)=10.21
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [56395 terms; 454308 terms/docs pairs; 5990208
tokens]
test: stored fields.......OK [1395 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
7 of 18: name=_mx docCount=1614
compound=true
hasProx=true
numFiles=1
size (MB)=15.174
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [52261 terms; 1502991 terms/docs pairs;
7764416 tokens]
test: stored fields.......OK [4842 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
8 of 18: name=_n7 docCount=557
compound=true
hasProx=true
numFiles=1
size (MB)=6.219
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [30631 terms; 526271 terms/docs pairs; 3450519
tokens]
test: stored fields.......OK [1671 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
9 of 18: name=_ni docCount=507
compound=true
hasProx=true
numFiles=1
size (MB)=7.264
diagnostics = {os.arch=amd64, mergeDocStores=true, java.vendor=IBM
Corporation, os=Windows Server 2008 R2, mergeFactor=10, source=merge,
java.version=1.6.0, lucene.version=3.0.3 1039909 - 2010-11-28 19:08:19,
optimize=false, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [38044 terms; 504757 terms/docs pairs; 3894247
tokens]
test: stored fields.......OK [1521 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
10 of 18: name=_nf docCount=30
compound=true
hasProx=true
numFiles=1
size (MB)=0.234
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [3687 terms; 27580 terms/docs pairs; 100661
tokens]
test: stored fields.......OK [90 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
11 of 18: name=_ng docCount=41
compound=true
hasProx=true
numFiles=1
size (MB)=0.81
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [9555 terms; 52066 terms/docs pairs; 432556
tokens]
test: stored fields.......OK [123 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
12 of 18: name=_nh docCount=54
compound=true
hasProx=true
numFiles=1
size (MB)=2.296
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [18563 terms; 59611 terms/docs pairs; 1528766
tokens]
test: stored fields.......OK [162 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
13 of 18: name=_nj docCount=48
compound=true
hasProx=true
numFiles=1
size (MB)=0.293
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [2973 terms; 38256 terms/docs pairs; 126664
tokens]
test: stored fields.......OK [144 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
14 of 18: name=_nk docCount=43
compound=true
hasProx=true
numFiles=1
size (MB)=0.297
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [3387 terms; 37864 terms/docs pairs; 130403
tokens]
test: stored fields.......OK [129 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
15 of 18: name=_nl docCount=36
compound=true
hasProx=true
numFiles=1
size (MB)=0.264
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [3089 terms; 33007 terms/docs pairs; 117014
tokens]
test: stored fields.......OK [108 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
16 of 18: name=_nm docCount=43
compound=true
hasProx=true
numFiles=1
size (MB)=0.305
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [3452 terms; 39078 terms/docs pairs; 134585
tokens]
test: stored fields.......OK [129 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
17 of 18: name=_nn docCount=47
compound=true
hasProx=true
numFiles=1
size (MB)=0.336
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........FAILED
WARNING: fixIndex() would remove reference to this segment; full exception:
java.io.IOException: No sub-file with id _nn.fnm found
at
org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:137)
at
org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:125)
at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:68)
at
org.apache.lucene.index.SegmentReader$CoreReaders.<init>(SegmentReader.java:120)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:583)
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:470)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883)
18 of 18: name=_no docCount=66
compound=true
hasProx=true
numFiles=1
size (MB)=0.47
diagnostics = {os.arch=amd64, java.vendor=IBM Corporation, os=Windows
Server 2008 R2, source=flush, java.version=1.6.0, lucene.version=3.0.3 1039909
- 2010-11-28 19:08:19, os.version=6.1 build 7601 Service Pack 1}
no deletions
test: open reader.........OK
test: fields..............OK [7 fields]
test: field norms.........OK [2 fields]
test: terms, freq, prox...OK [4302 terms; 60712 terms/docs pairs; 210884
tokens]
test: stored fields.......OK [198 total field count; avg 3 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector
fields per doc]
WARNING: 1 broken segments (containing 47 documents) detected
WARNING: would write new segments file, and 47 documents would be lost, if -fix
were specified
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
