mikemccand commented on pull request #128:
URL: https://github.com/apache/lucene/pull/128#issuecomment-847899963


   Next I ran `CheckIndex` with `-threadCount 1`:
   
   ```
   beast3:core[main]$ java -cp 
../core/build/libs/lucene-core-9.0.0-SNAPSHOT.jar 
org.apache.lucene.index.CheckIndex /l/indices/trunk.nightly.index.prev/index 
-threadCount 1
   
   NOTE: testing will be more thorough if you run java with 
'-ea:org.apache.lucene...', so assertions are enabled
   
   Opening index @ /l/indices/trunk.nightly.index.prev/index
   
   0.00% total deletions; 27625038 documents; 0 deleteions
   Segments file=segments_2 numSegments=15 version=9.0.0 
id=5kpcv7rf0icb64q1ern1xs4bp userData={userData=multi}
   [Segment 110]   1 of 15: name=_32 maxDoc=4978031
   [Segment 110]     version=9.0.0
   [Segment 110]     id=5kpcv7rf0icb64q1ern1xs35l
   [Segment 110]     codec=Lucene90
   [Segment 110]     compound=false
   [Segment 110]     numFiles=20
   [Segment 110]     size (MB)=3,890.496
   [Segment 110]     diagnostics = {java.version=15.0.1, 
java.vm.version=15.0.1+9-18, lucene.version=9.0.0, timestamp=1621919422678, 
os=Linux, java.runtime.version=15.0.1+9-18, mergeFactor=10\
   , os.arch=amd64, source=merge, java.vendor=Oracle Corporation, 
os.version=5.11.2-arch1-1, mergeMaxNumSegments=-1}
   [Segment 110]     no deletions
   [Segment 110]    test: open reader.........[Segment 110] OK [took 0.166 sec]
   [Segment 110]    test: check integrity.....[Segment 110] OK [took 0.580 sec]
   [Segment 110][LiveDocs]    test: check live docs.....[Segment 110][LiveDocs] 
OK [took 0.001 sec]
   [Segment 110][FieldInfos]    test: field infos.........[Segment 
110][FieldInfos] OK [23 fields] [took 0.000 sec]
   [Segment 110][FieldNorms]    test: field norms.........[Segment 
110][FieldNorms] OK [2 fields] [took 0.031 sec]
   [Segment 110][Postings]    test: terms, freq, prox...OK [16412141 terms; 
525829996 terms/docs pairs; 765284459 tokens] [took 35.202 sec]
   [Segment 110][StoredFields]    test: stored fields.......[Segment 
110][StoredFields] OK [14934093 total field count; avg 3.0 fields per doc] 
[took 0.836 sec]
   [Segment 110][TermVectors]    test: term vectors........[Segment 
110][TermVectors] OK [0 total term vector count; avg 0.0 term/freq vector 
fields per doc] [took 0.000 sec]
   [Segment 110][DocValues]    test: docvalues...........[Segment 
110][DocValues] OK [15 docvalues fields; 4 BINARY; 2 NUMERIC; 7 SORTED; 0 
SORTED_NUMERIC; 2 SORTED_SET] [took 3.205 sec]
   [Segment 110][Points]    test: points..............[Segment 110][Points] OK 
[4 fields, 19912124 points] [took 0.636 sec]
   [Segment 110][Vectors]    test: vectors..............[Segment 110][Vectors] 
OK [1 fields, 4978031 vectors] [took 0.169 sec]
   [Segment 110]
   [Segment 221]   2 of 15: name=_65 maxDoc=4978032
   [Segment 221]     version=9.0.0
   [Segment 221]     id=5kpcv7rf0icb64q1ern1xs3eu
   [Segment 221]     codec=Lucene90
   [Segment 221]     compound=false
   [Segment 221]     numFiles=20
   [Segment 221]     size (MB)=3,873.589
   [Segment 221]     diagnostics = {java.version=15.0.1, 
java.vm.version=15.0.1+9-18, lucene.version=9.0.0, timestamp=1621920782361, 
os=Linux, java.runtime.version=15.0.1+9-18, mergeFactor=10\
   , os.arch=amd64, source=merge, java.vendor=Oracle Corporation, 
os.version=5.11.2-arch1-1, mergeMaxNumSegments=-1}
   [Segment 221]     no deletions
   [Segment 221]    test: open reader.........[Segment 221] OK [took 0.172 sec]
   [Segment 221]    test: check integrity.....[Segment 221] OK [took 0.562 sec]
   [Segment 221][LiveDocs]    test: check live docs.....[Segment 221][LiveDocs] 
OK [took 0.000 sec]
   [Segment 221][FieldInfos]    test: field infos.........[Segment 
221][FieldInfos] OK [23 fields] [took 0.000 sec]
   [Segment 221][FieldNorms]    test: field norms.........[Segment 
221][FieldNorms] OK [2 fields] [took 0.009 sec]
   [Segment 221][Postings]    test: terms, freq, prox...OK [15879702 terms; 
497899770 terms/docs pairs; 726182953 tokens] [took 31.904 sec]
   [Segment 221][StoredFields]    test: stored fields.......[Segment 
221][StoredFields] OK [14934096 total field count; avg 3.0 fields per doc] 
[took 0.869 sec]
   [Segment 221][TermVectors]    test: term vectors........[Segment 
221][TermVectors] OK [0 total term vector count; avg 0.0 term/freq vector 
fields per doc] [took 0.000 sec]
   [Segment 221][DocValues]    test: docvalues...........[Segment 
221][DocValues] OK [15 docvalues fields; 4 BINARY; 2 NUMERIC; 7 SORTED; 0 
SORTED_NUMERIC; 2 SORTED_SET] [took 3.234 sec]
   [Segment 221][Points]    test: points..............[Segment 221][Points] OK 
[4 fields, 19912128 points] [took 0.618 sec]
   [Segment 221][Vectors]    test: vectors..............[Segment 221][Vectors] 
OK [1 fields, 4978032 vectors] [took 0.153 sec]
   [Segment 221]
   [Segment 332]   3 of 15: name=_98 maxDoc=4978032
   [Segment 332]     version=9.0.0
   [Segment 332]     id=5kpcv7rf0icb64q1ern1xs3o3
   [Segment 332]     codec=Lucene90
   [Segment 332]     compound=false
   [Segment 332]     numFiles=20
   [Segment 332]     size (MB)=3,837.561
   [Segment 332]     diagnostics = {java.version=15.0.1, 
java.vm.version=15.0.1+9-18, lucene.version=9.0.0, timestamp=1621922132326, 
os=Linux, java.runtime.version=15.0.1+9-18, mergeFactor=10\
   , os.arch=amd64, source=merge, java.vendor=Oracle Corporation, 
os.version=5.11.2-arch1-1, mergeMaxNumSegments=-1}
   [Segment 332]     no deletions
   [Segment 332]    test: open reader.........[Segment 332] OK [took 0.137 sec]
   [Segment 332]    test: check integrity.....[Segment 332] OK [took 0.516 sec]
   [Segment 332][LiveDocs]    test: check live docs.....[Segment 332][LiveDocs] 
OK [took 0.000 sec]
   [Segment 332][FieldInfos]    test: field infos.........[Segment 
332][FieldInfos] OK [23 fields] [took 0.000 sec]
   [Segment 332][FieldNorms]    test: field norms.........[Segment 
332][FieldNorms] OK [2 fields] [took 0.012 sec]
   [Segment 332][Postings]    test: terms, freq, prox...OK [16460318 terms; 
475335907 terms/docs pairs; 694693997 tokens] [took 28.982 sec]
   [Segment 332][StoredFields]    test: stored fields.......[Segment 
332][StoredFields] OK [14934096 total field count; avg 3.0 fields per doc] 
[took 0.870 sec]
   [Segment 332][TermVectors]    test: term vectors........[Segment 
332][TermVectors] OK [0 total term vector count; avg 0.0 term/freq vector 
fields per doc] [took 0.000 sec]
   [Segment 332][DocValues]    test: docvalues...........[Segment 
332][DocValues] OK [15 docvalues fields; 4 BINARY; 2 NUMERIC; 7 SORTED; 0 
SORTED_NUMERIC; 2 SORTED_SET] [took 3.323 sec]
   [Segment 332][Points]    test: points..............[Segment 332][Points] OK 
[4 fields, 19912128 points] [took 0.623 sec]
   [Segment 332][Vectors]    test: vectors..............[Segment 332][Vectors] 
OK [1 fields, 4978032 vectors] [took 0.151 sec]
   [Segment 332]
   
   ...
   
   [Segment 614]   15 of 15: name=_h2 maxDoc=46742
   [Segment 614]     version=9.0.0
   [Segment 614]     id=5kpcv7rf0icb64q1ern1xs4bl
   [Segment 614]     codec=Lucene90
   [Segment 614]     compound=false
   [Segment 614]     numFiles=20
   [Segment 614]     size (MB)=39.37
   [Segment 614]     diagnostics = {java.vendor=Oracle Corporation, os=Linux, 
timestamp=1621925578914, java.version=15.0.1, java.vm.version=15.0.1+9-18, 
lucene.version=9.0.0, source=flush, os\
   .arch=amd64, java.runtime.version=15.0.1+9-18, os.version=5.11.2-arch1-1}
   [Segment 614]     no deletions
   [Segment 614]    test: open reader.........[Segment 614] OK [took 0.004 sec]
   [Segment 614]    test: check integrity.....[Segment 614] OK [took 0.009 sec]
   [Segment 614][LiveDocs]    test: check live docs.....[Segment 614][LiveDocs] 
OK [took 0.000 sec]
   [Segment 614][FieldInfos]    test: field infos.........[Segment 
614][FieldInfos] OK [23 fields] [took 0.000 sec]
   [Segment 614][FieldNorms]    test: field norms.........[Segment 
614][FieldNorms] OK [2 fields] [took 0.001 sec]
   [Segment 614][Postings]    test: terms, freq, prox...OK [344318 terms; 
3965374 terms/docs pairs; 6341319 tokens] [took 0.342 sec]
   [Segment 614][StoredFields]    test: stored fields.......[Segment 
614][StoredFields] OK [140226 total field count; avg 3.0 fields per doc] [took 
0.009 sec]
   [Segment 614][TermVectors]    test: term vectors........[Segment 
614][TermVectors] OK [0 total term vector count; avg 0.0 term/freq vector 
fields per doc] [took 0.000 sec]
   [Segment 614][DocValues]    test: docvalues...........[Segment 
614][DocValues] OK [15 docvalues fields; 4 BINARY; 2 NUMERIC; 7 SORTED; 0 
SORTED_NUMERIC; 2 SORTED_SET] [took 0.075 sec]
   [Segment 614][Points]    test: points..............[Segment 614][Points] OK 
[4 fields, 186968 points] [took 0.006 sec]
   [Segment 614][Vectors]    test: vectors..............[Segment 614][Vectors] 
OK [1 fields, 46742 vectors] [took 0.002 sec]
   [Segment 614]
   No problems were detected with this index.
   
   Took 202.570 sec total.
   ```
   
   I think we should try to remove the duplicate segment/partId (e.g.`[Segment 
614][StoredFields]`) in some lines?  And in fact since each segment is still 
done "at once" (we don't do concurrency across segments, yet), we shouldn't 
need the e.g. `[Segment 614]` prefix on each line?
   
   Hmm, also why are we calling it `Segment 614` when its name is `_h2`?  Hmm, 
is that the decimal translation of the base36 value?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to