Hi Emir
Thank you for pointing outdeleted docwill still existin the indextill it
is optimize and itwill skewed statistics. We dosort by score.
This new collectionsare partofa new business initiativeandwe do not know
as yet what will be their sizelike.
Willgo ponder on your inputs. Thank you.
Derek
On 3/23/2017 8:28 PM, Emir Arnautovic wrote:
Hi Derek,
There are both pros and cons for both approaches:
1. if you are doing full reindexing PRO is that you have clean index
all the time and even if something goes wrong, you don't have to
switch alias to updated index so your users will not notice issues.
CON is that you are doing full reindex all the time even amount of
changes is minimal. Also, this approach is not real time friendly if
you plan to have more frequent update cycles.
2. If you delete in existing index, you do min changes. But note that
deleted doc are just flagged in index as deleted and removed when
segments are merged. This can result in skewed statistics and if you
have replicas and sort by score, can result in different ordering
depending on replicas' merge cycles. Using optimize after update is
done would solve this issue.
In order to make the right decision, you have to look at size of your
collection, number of deleted items etc. You can even combine
approaches, e.g. delete daily and do full reindex once a week.
HTH,
Emir
On 23.03.2017 07:10, Derek Poh wrote:
Hi
I have collections of products. I am doing indexing 3-4 times daily.
Every day there are products that expired and I need to remove them
from these collectionsdaily.
Ican think of 2 ways to do this.
1. using collection aliasto switch between a main and temp collection.
- clear and index the temp collection
- create alias to temp collection.
- clear and index the main collection.
- create alias to main collection.
this way require additional collections.
2. get list of expired products and generate deleteby id queries to
the collections.
Would like to get some advice on which way should I adopt?
Derek
----------------------
CONFIDENTIALITY NOTICE
This e-mail (including any attachments) may contain confidential
and/or privileged information. If you are not the intended recipient
or have received this e-mail in error, please inform the sender
immediately and delete this e-mail (including any attachments) from
your computer, and you must not use, disclose to anyone else or copy
this e-mail (including any attachments), whether in whole or in part.
This e-mail and any reply to it may be monitored for security, legal,
regulatory compliance and/or other appropriate reasons.
----------------------
CONFIDENTIALITY NOTICE
This e-mail (including any attachments) may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error, please inform the sender immediately and delete this e-mail (including any attachments) from your computer, and you must not use, disclose to anyone else or copy this e-mail (including any attachments), whether in whole or in part.
This e-mail and any reply to it may be monitored for security, legal,
regulatory compliance and/or other appropriate reasons.
