[
https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12663406#action_12663406
]
Michael McCandless commented on LUCENE-1483:
--------------------------------------------
OK here are the current results:
Queue size 10:
||numSeg||index||sortBy||method||query||topN||hits||warm||qps||warmnew||qpsnew||pctg||
|1|simple|country|val|text|10|2000000| 0.6| 10.7| 0.7| 12.4| 15.9%|
|1|simple|country|ordsub|text|10|2000000| 0.6| 10.7| 0.6| 14.7| 37.4%|
|1|simple|country|ordval|text|10|2000000| 0.6| 10.7| 0.6| 14.5| 35.5%|
|1|simple|country|orddem|text|10|2000000| 0.6| 10.7| 0.6| 14.6| 36.4%|
|1|simple|country|policy|text|10|2000000| 0.6| 10.7| 0.6| 14.5| 35.5%|
|1|simple|country|policy2|text|10|2000000| 0.6| 10.7| 0.6| 14.6| 36.4%|
|1|wiki|title|val|147|10| 4984| 2.1|3743.8| 2.3|2557.4|-31.7%|
|1|wiki|title|ordsub|147|10| 4984| 2.1|3743.8| 2.0|4561.8| 21.8%|
|1|wiki|title|ordval|147|10| 4984| 2.1|3743.8| 2.0|4551.4| 21.6%|
|1|wiki|title|orddem|147|10| 4984| 2.1|3743.8| 2.0|4569.4| 22.1%|
|1|wiki|title|policy|147|10| 4984| 2.1|3743.8| 2.0|4551.8| 21.6%|
|1|wiki|title|policy2|147|10| 4984| 2.1|3743.8| 2.1|4526.6| 20.9%|
|1|wiki|title|val|text|10| 97191| 2.1| 144.2| 2.4| 38.9|-73.0%|
|1|wiki|title|ordsub|text|10| 97191| 2.1| 144.2| 2.1| 166.3| 15.3%|
|1|wiki|title|ordval|text|10| 97191| 2.1| 144.2| 2.1| 166.1| 15.2%|
|1|wiki|title|orddem|text|10| 97191| 2.1| 144.2| 2.1| 168.3| 16.7%|
|1|wiki|title|policy|text|10| 97191| 2.1| 144.2| 2.1| 165.3| 14.6%|
|1|wiki|title|policy2|text|10| 97191| 2.1| 144.2| 2.1| 165.1| 14.5%|
|1|wiki|title|val|1|10| 386435| 2.1| 51.2| 2.4| 13.6|-73.4%|
|1|wiki|title|ordsub|1|10| 386435| 2.1| 51.2| 2.1| 68.8| 34.4%|
|1|wiki|title|ordval|1|10| 386435| 2.1| 51.2| 2.1| 68.9| 34.6%|
|1|wiki|title|orddem|1|10| 386435| 2.1| 51.2| 2.1| 69.3| 35.4%|
|1|wiki|title|policy|1|10| 386435| 2.1| 51.2| 2.1| 66.5| 29.9%|
|1|wiki|title|policy2|1|10| 386435| 2.1| 51.2| 2.1| 66.3| 29.5%|
||numSeg||index||sortBy||method||query||topN||hits||warm||qps||warmnew||qpsnew||pctg||
|10|simple|country|val|text|10|2000000| 0.7| 10.4| 0.5| 12.2| 17.3%|
|10|simple|country|ordsub|text|10|2000000| 0.7| 10.4| 0.5| 14.6| 40.4%|
|10|simple|country|ordval|text|10|2000000| 0.7| 10.4| 0.5| 14.7| 41.3%|
|10|simple|country|orddem|text|10|2000000| 0.7| 10.4| 0.5| 14.7| 41.3%|
|10|simple|country|policy|text|10|2000000| 0.7| 10.4| 0.5| 14.0| 34.6%|
|10|simple|country|policy2|text|10|2000000| 0.7| 10.4| 0.5| 14.0| 34.6%|
|10|wiki|title|val|147|10| 4984| 12.5|3004.5| 2.6|1735.7|-42.2%|
|10|wiki|title|ordsub|147|10| 4984| 12.5|3004.5| 2.1|3077.2| 2.4%|
|10|wiki|title|ordval|147|10| 4984| 12.5|3004.5| 2.1|3415.4| 13.7%|
|10|wiki|title|orddem|147|10| 4984| 12.5|3004.5| 2.1|3537.0| 17.7%|
|10|wiki|title|policy|147|10| 4984| 12.5|3004.5| 2.1|3463.8| 15.3%|
|10|wiki|title|policy2|147|10| 4984| 12.5|3004.5| 2.1|3356.7| 11.7%|
|10|wiki|title|val|text|10| 97191| 12.7| 139.4| 2.5| 38.5|-72.4%|
|10|wiki|title|ordsub|text|10| 97191| 12.7| 139.4| 2.1| 164.0| 17.6%|
|10|wiki|title|ordval|text|10| 97191| 12.7| 139.4| 2.1| 164.8| 18.2%|
|10|wiki|title|orddem|text|10| 97191| 12.7| 139.4| 2.1| 164.7| 18.1%|
|10|wiki|title|policy|text|10| 97191| 12.7| 139.4| 2.1| 163.1| 17.0%|
|10|wiki|title|policy2|text|10| 97191| 12.7| 139.4| 2.1| 162.9| 16.9%|
|10|wiki|title|val|1|10| 386435| 12.7| 50.3| 2.5| 15.2|-69.8%|
|10|wiki|title|ordsub|1|10| 386435| 12.7| 50.3| 2.1| 67.4| 34.0%|
|10|wiki|title|ordval|1|10| 386435| 12.7| 50.3| 2.1| 68.4| 36.0%|
|10|wiki|title|orddem|1|10| 386435| 12.7| 50.3| 2.1| 68.4| 36.0%|
|10|wiki|title|policy|1|10| 386435| 12.7| 50.3| 2.1| 65.7| 30.6%|
|10|wiki|title|policy2|1|10| 386435| 12.7| 50.3| 2.1| 66.2| 31.6%|
||numSeg||index||sortBy||method||query||topN||hits||warm||qps||warmnew||qpsnew||pctg||
|100|simple|country|val|text|10|2000000| 1.0| 8.8| 4.0| 9.5| 8.0%|
|100|simple|country|ordsub|text|10|2000000| 1.0| 8.8| 0.6| 11.5| 30.7%|
|100|simple|country|ordval|text|10|2000000| 1.0| 8.8| 0.6| 11.7| 33.0%|
|100|simple|country|orddem|text|10|2000000| 1.0| 8.8| 0.6| 11.8| 34.1%|
|100|simple|country|policy|text|10|2000000| 1.0| 8.8| 0.6| 11.4| 29.5%|
|100|simple|country|policy2|text|10|2000000| 1.0| 8.8| 0.6| 11.3| 28.4%|
|100|wiki|title|val|147|10| 4984| 94.6|1066.9| 4.6| 450.6|-57.8%|
|100|wiki|title|ordsub|147|10| 4984| 94.6|1066.9| 2.1| 480.8|-54.9%|
|100|wiki|title|ordval|147|10| 4984| 94.6|1066.9| 2.1| 624.2|-41.5%|
|100|wiki|title|orddem|147|10| 4984| 94.6|1066.9| 2.1| 703.3|-34.1%|
|100|wiki|title|policy|147|10| 4984| 94.6|1066.9| 2.1| 724.1|-32.1%|
|100|wiki|title|policy2|147|10| 4984| 94.6|1066.9| 2.1| 638.5|-40.2%|
|100|wiki|title|val|text|10| 97191| 94.9| 110.2| 3.2| 37.9|-65.6%|
|100|wiki|title|ordsub|text|10| 97191| 94.9| 110.2| 2.1| 118.1| 7.2%|
|100|wiki|title|ordval|text|10| 97191| 94.9| 110.2| 2.2| 121.6| 10.3%|
|100|wiki|title|orddem|text|10| 97191| 94.9| 110.2| 2.1| 123.4| 12.0%|
|100|wiki|title|policy|text|10| 97191| 94.9| 110.2| 2.1| 123.1| 11.7%|
|100|wiki|title|policy2|text|10| 97191| 94.9| 110.2| 2.1| 121.9| 10.6%|
|100|wiki|title|val|1|10| 386435| 94.3| 47.9| 3.2| 14.7|-69.3%|
|100|wiki|title|ordsub|1|10| 386435| 94.3| 47.9| 2.1| 61.8| 29.0%|
|100|wiki|title|ordval|1|10| 386435| 94.3| 47.9| 2.1| 62.5| 30.5%|
|100|wiki|title|orddem|1|10| 386435| 94.3| 47.9| 2.1| 63.3| 32.2%|
|100|wiki|title|policy|1|10| 386435| 94.3| 47.9| 2.1| 61.8| 29.0%|
|100|wiki|title|policy2|1|10| 386435| 94.3| 47.9| 2.1| 61.2| 27.8%|
Queue size 1000:
||numSeg||index||sortBy||method||query||topN||hits||warm||qps||warmnew||qpsnew||pctg||
|1|simple|country|val|text|1000|2000000| 0.9| 10.0| 0.7| 12.0| 20.0%|
|1|simple|country|ordsub|text|1000|2000000| 0.9| 10.0| 0.6| 14.1| 41.0%|
|1|simple|country|ordval|text|1000|2000000| 0.9| 10.0| 0.6| 14.0| 40.0%|
|1|simple|country|orddem|text|1000|2000000| 0.9| 10.0| 0.6| 13.8| 38.0%|
|1|simple|country|policy|text|1000|2000000| 0.9| 10.0| 0.7| 13.8| 38.0%|
|1|simple|country|policy2|text|1000|2000000| 0.9| 10.0| 0.6| 13.7| 37.0%|
|1|wiki|title|val|147|1000| 4984| 2.1| 740.6| 2.3| 385.0|-48.0%|
|1|wiki|title|ordsub|147|1000| 4984| 2.1| 740.6| 2.1| 970.0| 31.0%|
|1|wiki|title|ordval|147|1000| 4984| 2.1| 740.6| 2.1| 938.0| 26.7%|
|1|wiki|title|orddem|147|1000| 4984| 2.1| 740.6| 2.1| 839.3| 13.3%|
|1|wiki|title|policy|147|1000| 4984| 2.1| 740.6| 2.1| 938.4| 26.7%|
|1|wiki|title|policy2|147|1000| 4984| 2.1| 740.6| 2.1| 924.4| 24.8%|
|1|wiki|title|val|text|1000| 97191| 2.1| 108.7| 2.4| 33.1|-69.5%|
|1|wiki|title|ordsub|text|1000| 97191| 2.1| 108.7| 2.1| 127.8| 17.6%|
|1|wiki|title|ordval|text|1000| 97191| 2.1| 108.7| 2.1| 125.9| 15.8%|
|1|wiki|title|orddem|text|1000| 97191| 2.1| 108.7| 2.1| 122.8| 13.0%|
|1|wiki|title|policy|text|1000| 97191| 2.1| 108.7| 2.1| 125.7| 15.6%|
|1|wiki|title|policy2|text|1000| 97191| 2.1| 108.7| 2.1| 125.4| 15.4%|
|1|wiki|title|val|1|1000| 386435| 2.1| 46.2| 2.4| 12.8|-72.3%|
|1|wiki|title|ordsub|1|1000| 386435| 2.1| 46.2| 2.1| 62.0| 34.2%|
|1|wiki|title|ordval|1|1000| 386435| 2.1| 46.2| 2.1| 61.3| 32.7%|
|1|wiki|title|orddem|1|1000| 386435| 2.1| 46.2| 2.1| 60.6| 31.2%|
|1|wiki|title|policy|1|1000| 386435| 2.1| 46.2| 2.1| 60.0| 29.9%|
|1|wiki|title|policy2|1|1000| 386435| 2.1| 46.2| 2.1| 60.4| 30.7%|
||numSeg||index||sortBy||method||query||topN||hits||warm||qps||warmnew||qpsnew||pctg||
|10|simple|country|val|text|1000|2000000| 0.8| 9.7| 0.5| 11.9| 22.7%|
|10|simple|country|ordsub|text|1000|2000000| 0.8| 9.7| 0.5| 13.8| 42.3%|
|10|simple|country|ordval|text|1000|2000000| 0.8| 9.7| 0.6| 13.7| 41.2%|
|10|simple|country|orddem|text|1000|2000000| 0.8| 9.7| 0.6| 13.7| 41.2%|
|10|simple|country|policy|text|1000|2000000| 0.8| 9.7| 0.6| 13.5| 39.2%|
|10|simple|country|policy2|text|1000|2000000| 0.8| 9.7| 0.6| 13.5| 39.2%|
|10|wiki|title|val|147|1000| 4984| 12.7| 664.2| 2.3| 411.8|-38.0%|
|10|wiki|title|ordsub|147|1000| 4984| 12.7| 664.2| 2.2| 58.3|-91.2%|
|10|wiki|title|ordval|147|1000| 4984| 12.7| 664.2| 2.1| 71.1|-89.3%|
|10|wiki|title|orddem|147|1000| 4984| 12.7| 664.2| 2.1| 89.9|-86.5%|
|10|wiki|title|policy|147|1000| 4984| 12.7| 664.2| 2.1| 89.8|-86.5%|
|10|wiki|title|policy2|147|1000| 4984| 12.7| 664.2| 2.1| 71.2|-89.3%|
|10|wiki|title|val|text|1000| 97191| 12.6| 100.4| 2.4| 33.4|-66.7%|
|10|wiki|title|ordsub|text|1000| 97191| 12.6| 100.4| 2.3| 68.4|-31.9%|
|10|wiki|title|ordval|text|1000| 97191| 12.6| 100.4| 2.2| 80.6|-19.7%|
|10|wiki|title|orddem|text|1000| 97191| 12.6| 100.4| 2.2| 84.6|-15.7%|
|10|wiki|title|policy|text|1000| 97191| 12.6| 100.4| 2.2| 84.6|-15.7%|
|10|wiki|title|policy2|text|1000| 97191| 12.6| 100.4| 2.2| 79.7|-20.6%|
|10|wiki|title|val|1|1000| 386435| 12.7| 42.4| 2.4| 14.3|-66.3%|
|10|wiki|title|ordsub|1|1000| 386435| 12.7| 42.4| 2.7| 47.8| 12.7%|
|10|wiki|title|ordval|1|1000| 386435| 12.7| 42.4| 2.2| 52.9| 24.8%|
|10|wiki|title|orddem|1|1000| 386435| 12.7| 42.4| 2.2| 54.3| 28.1%|
|10|wiki|title|policy|1|1000| 386435| 12.7| 42.4| 2.2| 53.0| 25.0%|
|10|wiki|title|policy2|1|1000| 386435| 12.7| 42.4| 2.2| 51.9| 22.4%|
||numSeg||index||sortBy||method||query||topN||hits||warm||qps||warmnew||qpsnew||pctg||
|100|simple|country|val|text|1000|2000000| 1.0| 8.5| 0.6| 9.4| 10.6%|
|100|simple|country|ordsub|text|1000|2000000| 1.0| 8.5| 0.6| 10.5| 23.5%|
|100|simple|country|ordval|text|1000|2000000| 1.0| 8.5| 0.6| 10.3| 21.2%|
|100|simple|country|orddem|text|1000|2000000| 1.0| 8.5| 0.6| 10.6| 24.7%|
|100|simple|country|policy|text|1000|2000000| 1.0| 8.5| 0.7| 10.3| 21.2%|
|100|simple|country|policy2|text|1000|2000000| 1.0| 8.5| 0.7| 10.0|
17.6%|
|100|wiki|title|val|147|1000| 4984| 93.8| 442.8| 2.2| 243.4|-45.0%|
|100|wiki|title|ordsub|147|1000| 4984| 93.8| 442.8| 2.8| 12.5|-97.2%|
|100|wiki|title|ordval|147|1000| 4984| 93.8| 442.8| 2.2| 19.0|-95.7%|
|100|wiki|title|orddem|147|1000| 4984| 93.8| 442.8| 2.2| 58.4|-86.8%|
|100|wiki|title|policy|147|1000| 4984| 93.8| 442.8| 2.1| 58.6|-86.8%|
|100|wiki|title|policy2|147|1000| 4984| 93.8| 442.8| 2.2| 18.7|-95.8%|
|100|wiki|title|val|text|1000| 97191| 93.4| 88.0| 2.3| 32.1|-63.5%|
|100|wiki|title|ordsub|text|1000| 97191| 93.4| 88.0| 2.4| 15.9|-81.9%|
|100|wiki|title|ordval|text|1000| 97191| 93.4| 88.0| 2.2| 27.4|-68.9%|
|100|wiki|title|orddem|text|1000| 97191| 93.4| 88.0| 2.2| 46.6|-47.0%|
|100|wiki|title|policy|text|1000| 97191| 93.4| 88.0| 2.2| 46.8|-46.8%|
|100|wiki|title|policy2|text|1000| 97191| 93.4| 88.0| 2.2| 27.1|-69.2%|
|100|wiki|title|val|1|1000| 386435| 92.8| 41.0| 2.3| 13.2|-67.8%|
|100|wiki|title|ordsub|1|1000| 386435| 92.8| 41.0| 2.8| 15.9|-61.2%|
|100|wiki|title|ordval|1|1000| 386435| 92.8| 41.0| 2.2| 26.6|-35.1%|
|100|wiki|title|orddem|1|1000| 386435| 92.8| 41.0| 2.2| 37.3| -9.0%|
|100|wiki|title|policy|1|1000| 386435| 92.8| 41.0| 2.2| 37.3| -9.0%|
|100|wiki|title|policy2|1|1000| 386435| 92.8| 41.0| 2.2| 25.9|-36.8%|
> Change IndexSearcher multisegment searches to search each individual segment
> using a single HitCollector
> --------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-1483
> URL: https://issues.apache.org/jira/browse/LUCENE-1483
> Project: Lucene - Java
> Issue Type: Improvement
> Affects Versions: 2.9
> Reporter: Mark Miller
> Priority: Minor
> Attachments: LUCENE-1483-partial.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, sortBench.py, sortCollate.py
>
>
> FieldCache and Filters are forced down to a single segment reader, allowing
> for individual segment reloading on reopen.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
