ick Erickson <erickerick...@gmail.com>
> Sent: Wednesday 10th January 2018 22:41
> To: solr-user <solr-user@lucene.apache.org>
> Subject: Re: Very high number of deleted docs, part 2
>
> There's some background here:
> https://lucidworks.com/2017/10/13/segment-merging-d
;erickerick...@gmail.com>
> > Sent: Friday 5th January 2018 17:56
> > To: solr-user <solr-user@lucene.apache.org>
> > Subject: Re: Very high number of deleted docs, part 2
> >
> > I'm not 100% sure that playing with maxSegments will work.
> >
> &
y 2018 17:56
> To: solr-user <solr-user@lucene.apache.org>
> Subject: Re: Very high number of deleted docs, part 2
>
> I'm not 100% sure that playing with maxSegments will work.
>
> what will work is to re-index everything. You can re-index into the
> existing collection,
w about optimizing it again, with maxSegments set to ten, it should
> recover right?
>
> -Original message-
> > From:Shawn Heisey <apa...@elyograg.org>
> > Sent: Friday 5th January 2018 14:34
> > To: solr-user@lucene.apache.org
> > Subject: Re: Very hig
: Friday 5th January 2018 14:34
> To: solr-user@lucene.apache.org
> Subject: Re: Very high number of deleted docs, part 2
>
> On 1/5/2018 5:33 AM, Markus Jelsma wrote:
> > Another collection, now on 7.1, also shows this problem and has default TMP
> > settings. Thi
On 1/5/2018 5:33 AM, Markus Jelsma wrote:
Another collection, now on 7.1, also shows this problem and has default TMP
settings. This time size is different, each shard of this collection is over 40
GB, and each shard has about 50 % deleted documents. Each shard's largest
segment is just under
Well, that made a difference! Now we're back at 64 MB per replica.
Thanks,
Markus
-Original message-
> From:Erick Erickson <erickerick...@gmail.com>
> Sent: Wednesday 4th October 2017 16:19
> To: solr-user <solr-user@lucene.apache.org>
> Subject: Re: Very hig
rgeMerge after the periodic update cycle, but
> i preferred Lucene to do it for me.
>
> Thanks,
> Markus
>
> -Original message-
>> From:Erick Erickson <erickerick...@gmail.com>
>> Sent: Wednesday 4th October 2017 14:56
>> To: solr-user <solr-
update cycle, but i
preferred Lucene to do it for me.
Thanks,
Markus
-Original message-
> From:Erick Erickson <erickerick...@gmail.com>
> Sent: Wednesday 4th October 2017 14:56
> To: solr-user <solr-user@lucene.apache.org>
> Subject: Re: Very high number of deleted doc
Ah thanks for that!
-Original message-
> From:Emir Arnautović <emir.arnauto...@sematext.com>
> Sent: Wednesday 4th October 2017 15:03
> To: solr-user@lucene.apache.org
> Subject: Re: Very high number of deleted docs
>
> Hi Markus,
> It is passed but not expl
s
>>
>> -Original message-
>>> From:Amrit Sarkar <sarkaramr...@gmail.com>
>>> Sent: Wednesday 4th October 2017 14:42
>>> To: solr-user@lucene.apache.org
>>> Subject: Re: Very high number of deleted docs
>>>
>>> Hi Markus,
>&g
onfig.
>
> Thanks,
> Markus
>
> -Original message-
>> From:Amrit Sarkar <sarkaramr...@gmail.com>
>> Sent: Wednesday 4th October 2017 14:42
>> To: solr-user@lucene.apache.org
>> Subject: Re: Very high number of deleted docs
>>
>> Hi Markus,
>&g
ent: Wednesday 4th October 2017 14:42
>> To: solr-user@lucene.apache.org
>> Subject: Re: Very high number of deleted docs
>>
>> Hi Markus,
>>
>> Emir already mentioned tuning *reclaimDeletesWeight which *affects segments
>> about to merge priority. Optimising index
-Original message-
> From:Amrit Sarkar <sarkaramr...@gmail.com>
> Sent: Wednesday 4th October 2017 14:42
> To: solr-user@lucene.apache.org
> Subject: Re: Very high number of deleted docs
>
> Hi Markus,
>
> Emir already mentioned tuning *reclaimDeletesWeight w
; To: solr-user@lucene.apache.org
> Subject: Re: Very high number of deleted docs
>
> Hi Markus,
> You can set reclaimDeletesWeight in merge settings to some higher value than
> default (I think it is 2) to favor segments with deleted docs when merging.
>
> HTH,
> Emir
> -
Hi Markus,
Emir already mentioned tuning *reclaimDeletesWeight which *affects segments
about to merge priority. Optimising index time by time, preferably
scheduling weekly / fortnight / ..., at low traffic period to never be in
such odd position of 80% deleted docs in total index.
Amrit Sarkar
Hi Markus,
You can set reclaimDeletesWeight in merge settings to some higher value than
default (I think it is 2) to favor segments with deleted docs when merging.
HTH,
Emir
--
Monitoring - Log Management - Alerting - Anomaly Detection
Solr & Elasticsearch Consulting Support Training -
17 matches
Mail list logo