I'm sorry I forgot the pictures.
On 11/12/19 15:20, Danilo Tomasoni wrote:
Hello all,
we have a solr instance with around 41MLN documents.
Recently we stopped our forcemerge policy that ensured only 1 segment
was present at query time, because we read here in the ML and
elsewhere that this is considered bad practice and it's also very time
consuming.
So we implemented
<mergePolicyFactory
class="org.apache.lucene.index.LogByteSizeMergePolicy">
<int name="mergeFactor">10</int>
</mergePolicyFactory>
I don't know if this is related to our problem, but recently we
noticed spikes in CPU usage (without iowait, and that's the strange
thing, because otherwise I would have thought about an automatic merge)
every 3-5 seconds.
I attach a picture of the metrics collected from the system hosting
solr that show this behaviour, as well as the gc log.
Any idea why this can happen?
Thank you
Danilo
--
Danilo Tomasoni
Fondazione The Microsoft Research - University of Trento Centre for
Computational and Systems Biology (COSBI)
Piazza Manifattura 1, 38068 Rovereto (TN), Italy
tomas...@cosbi.eu
http://www.cosbi.eu
As for the European General Data Protection Regulation 2016/679 on the protection of natural persons with regard to the processing of personal data, we inform you that all the data we possess are object of treatment in the respect of the normative provided for by the cited GDPR.
It is your right to be informed on which of your data are used and how; you may
ask for their correction, cancellation or you may oppose to their use by
written request sent by recorded delivery to The Microsoft Research –
University of Trento Centre for Computational and Systems Biology Scarl, Piazza
Manifattura 1, 38068 Rovereto (TN), Italy.
P Please don't print this e-mail unless you really need to
