[
https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12664984#action_12664984
]
Mark Miller commented on LUCENE-1483:
-------------------------------------
My previous results had a few oddities going with them (I was loosely playing
around). Being a little more careful, here is an example of the difference, and
the hotspots. Timings are probably not completely comparable as my comp couldnt
keep up profiling the second version very well - its much slower without
profiling as well though:
Index is 600000 docs, 46 segments, 63849 unique terms.
Load the fieldcache on one multireader
||method||time||invocations||
|FieldCacheImpl.createValue|156536(98%)|1|
|MultiTermDocs.next()|148499(93.5%)|621803|
|MutliTermDocs(int)|140397(88.4%)|1002938|
|SegmentTermDocs.seek(Term)|138332(87.1%)|1002938|
load the fieldcache on each sub reader of the multireader, one at a time
||method||time||invocations||
|FieldCacheImpl.createValue|7815(80.4%)|46|
|SegmentTermDocs.next()|3315(34.1%)|642046|
|SegmentTermEnum.next()|1936(19.9%)|42046|
|SegmentTermDocs.seek(TermEnum)|874(9%)|42046|
Unique terms per segment:
21312,41837,41843,41849,41854,41860,41865,41870,41878,41883,41888,41894,41902,41906,41910,41912,41916,41921,41924
41930,41932,41936,41943,41947,41951,41956,41960,41964,41970,41974,41979,41982,41989,41994,41999,42002,42005
42007,42011,42016,42020,42026,42033,42039,42044,42046
> Change IndexSearcher multisegment searches to search each individual segment
> using a single HitCollector
> --------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-1483
> URL: https://issues.apache.org/jira/browse/LUCENE-1483
> Project: Lucene - Java
> Issue Type: Improvement
> Affects Versions: 2.9
> Reporter: Mark Miller
> Priority: Minor
> Attachments: LUCENE-1483-partial.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> sortBench.py, sortCollate.py
>
>
> FieldCache and Filters are forced down to a single segment reader, allowing
> for individual segment reloading on reopen.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
