[ 
https://issues.apache.org/jira/browse/LUCENE-8264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16447672#comment-16447672
 ] 

Adrien Grand commented on LUCENE-8264:
--------------------------------------

Lucene only supports reading indices generated by versions N or N-1, so I don't 
think we should help users go into unsupported territory by attempting 
5x->6x->7x upgrades? For the record, it might "work" in that very particular 
case because we didn't change anything on top of the codec API between 5x and 
6x (I think?), but a 6x->7x->8x would be problematic since 7x started rejecting 
corrupt offsets and changed the encoding of norms, so attempting a 6x->7x->8x 
upgrade this way could propagate corrupt offsets to 8x and would corrupt norms. 
To avoid this trap we started recording the creation version in LUCENE-7703 and 
LUCENE-7756, and then failed opening 6x (or less) indices with 8x in 
LUCENE-7837.

> Allow an option to rewrite all segments
> ---------------------------------------
>
>                 Key: LUCENE-8264
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8264
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Erick Erickson
>            Assignee: Erick Erickson
>            Priority: Major
>
> For the background, see SOLR-12259.
> There are several use-cases that would be much easier, especially during 
> upgrades, if we could specify that all segments get rewritten. 
> One example: Upgrading 5x->6x->7x. When segments are merged, they're 
> rewritten into the current format. However, there's no guarantee that a 
> particular segment _ever_ gets merged so the 6x-7x upgrade won't necessarily 
> be successful.
> How many merge policies support this is an open question. I propose to start 
> with TMP and raise other JIRAs as necessary for other merge policies.
> So far the usual response has been "re-index from scratch", but that's 
> increasingly difficult as systems get larger.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to