I'm still thinking of manual updates or updating both indexes. Job pauses are acceptable but zero downtime clearly means read only then.
I'm curious if there is a clean solution or if something is planned here for the next releases? Matthias 2014-02-21 9:11 GMT+01:00 Andrew Kane <[email protected]>: > I tried to post a reply yesterday but it looks like it never made it. > > Thank you all for the quick replies. Here's a slightly better explanation > of where I believe the race condition occurs. > > When the scan/scroll starts, the alias is still pointing to the old index, > so updates go to the old index. Let's say you update Document 1. If the > scroll/scan has already passed Document 1, the new index never sees the > update. The three solutions you mentioned Nik are to either: > > 1. Keep track of updates manually [tedious] > 2. Pause the jobs that perform the updates [out of sync] > 3. Send updates to both indexes [also tedious] > > However, none of these seem ideal. > > - Andrew > > On Tuesday, February 18, 2014 8:41:18 PM UTC-8, Andrew Kane wrote: >> >> Hi, >> >> I've followed the documentation for zero-downtime mapping changes and it >> works great. http://www.elasticsearch.org/blog/changing-mapping-with- >> zero-downtime/ >> >> However, there is a (pretty big) race condition with this approach - >> while reindexing, changes may not make it to the new index. I've looked >> all over and haven't found a single solution to address this. The best >> attempt I've seen is to buffer updates, but this is tedious and still >> leaves a race condition (with a smaller window). My initial thoughts were >> to create a write alias that points to the old and new indices and use >> versioning. However, there is no way to write to multiple indices >> atomically. >> >> It seems like this issue should affect most Elasticsearch users (whether >> they realize it or not). Does anyone have a good solution to this? >> >> Thanks, >> Andrew >> >> -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/elasticsearch/s4RHF7qk7p8/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/8efce1a5-980b-4240-8bb5-6217071e1540%40googlegroups.com > . > > For more options, visit https://groups.google.com/groups/opt_out. > -- Matthias Richter Pregelstraße 14 53127 Bonn 0228 33 600 997 0171 4724384 -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CA%2BbHfFsuCT_aearEwWoULZoKKM%2BzDLwk34YQFdmGNcXk6wU4jw%40mail.gmail.com. For more options, visit https://groups.google.com/groups/opt_out.
