[
https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12664984#action_12664984
]
markrmil...@gmail.com edited comment on LUCENE-1483 at 1/18/09 8:20 PM:
--------------------------------------------------------------
My previous results had a few oddities going with them (I was loosely playing
around). Being a little more careful, here is an example of the difference, and
the hotspots. Timings are probably not completely comparable as my comp couldnt
keep up profiling the second version very well - its much slower without
profiling as well though:
Index is 600000 docs, 46 segments
Load the fieldcache on one multireader
||method||time||invocations||
|FieldCacheImpl.createValue|156536(98%)|1|
|MultiTermDocs.next()|148499(93.5%)|621803|
|MutliTermDocs(int)|140397(88.4%)|1002938|
|SegmentTermDocs.seek(Term)|138332(87.1%)|1002938|
load the fieldcache on each sub reader of the multireader, one at a time
||method||time||invocations||
|FieldCacheImpl.createValue|7815(80.4%)|46|
|SegmentTermDocs.next()|3315(34.1%)|642046|
|SegmentTermEnum.next()|1936(19.9%)|42046|
|SegmentTermDocs.seek(TermEnum)|874(9%)|42046|
*edit*
wrong values
was (Author: markrmil...@gmail.com):
My previous results had a few oddities going with them (I was loosely
playing around). Being a little more careful, here is an example of the
difference, and the hotspots. Timings are probably not completely comparable as
my comp couldnt keep up profiling the second version very well - its much
slower without profiling as well though:
Index is 600000 docs, 46 segments, 63849 unique terms.
Load the fieldcache on one multireader
||method||time||invocations||
|FieldCacheImpl.createValue|156536(98%)|1|
|MultiTermDocs.next()|148499(93.5%)|621803|
|MutliTermDocs(int)|140397(88.4%)|1002938|
|SegmentTermDocs.seek(Term)|138332(87.1%)|1002938|
load the fieldcache on each sub reader of the multireader, one at a time
||method||time||invocations||
|FieldCacheImpl.createValue|7815(80.4%)|46|
|SegmentTermDocs.next()|3315(34.1%)|642046|
|SegmentTermEnum.next()|1936(19.9%)|42046|
|SegmentTermDocs.seek(TermEnum)|874(9%)|42046|
*edit*
wrong values
> Change IndexSearcher multisegment searches to search each individual segment
> using a single HitCollector
> --------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-1483
> URL: https://issues.apache.org/jira/browse/LUCENE-1483
> Project: Lucene - Java
> Issue Type: Improvement
> Affects Versions: 2.9
> Reporter: Mark Miller
> Priority: Minor
> Attachments: LUCENE-1483-partial.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> sortBench.py, sortCollate.py
>
>
> FieldCache and Filters are forced down to a single segment reader, allowing
> for individual segment reloading on reopen.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
