[ 
https://issues.apache.org/jira/browse/LUCENE-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212346#comment-15212346
 ] 

Dawid Weiss commented on LUCENE-7141:
-------------------------------------

+1. This is something I was going to suggest.

> OfflineSorter shouldn't always forceMerge in the end
> ----------------------------------------------------
>
>                 Key: LUCENE-7141
>                 URL: https://issues.apache.org/jira/browse/LUCENE-7141
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>         Attachments: LUCENE-7141.patch
>
>
> Today it always does a final merge, to collapse all segments into a single 
> segment.
> But typically the caller is going to re-iterate all values anyway, to go off 
> and build an FST or a BKD tree or something, and so that final forceMerge is 
> often not necessary and the merging can be done on the fly when the caller 
> consumes the result.
> This is somewhat tricky to do ... I'd like to break it into steps, starting 
> with fixing the {{ByteSequencesReader}} API to implement {{BytesRefIterator}} 
> instead of its own {{read(BytesRefBuilder)}} method as a first step.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to