My indexes change somewhat frequently. If I let leave the merge settings as the default I end up with 25%-40% deleted documents (some indexes higher, some lower). I'm looking for some generic advice on: 1. Is that 25%-40% ok? 2. What kind of settings should I set to keep that in an acceptable range? For some meaning of acceptable.
On (1) I'm pretty sure 25%-40% is OK for my low query traffic indexes - no use optimizing them anyway. But for my high search traffic indexes I _think_ I see a performance improvement when I have lower (<5%) deleted documents and fewer segments. But computers are complicated and my performance tests might just have been testing cache warming.... Does this conclusion match other's experience? On (2) I'm not really sure what to do. It _looks_ _like_ Lucene isn't picking up the bigger segments to merge the deletes out of them. I assume that is because they are bumping against the max allowed segment size and therefor it can only merge one at a time so it always has something better to do. I'm not sure that is healthy though. Some of those old segments can get really bloated - like 40%-50% deleted. Thanks! Nik -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3AAYSOo%3DErSEp%3Dp-DpDJw7eKZObt%2B3gEmHdFO44uwsEg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
