[
https://issues.apache.org/jira/browse/SOLR-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154807#comment-15154807
]
Michael Sun commented on SOLR-8707:
-----------------------------------
[[email protected]] Randomly stagger the starting of auto commit can help.
Another way is to delay the first commit for every core for a certain amount of
time. For example, in case there are 6 cores and auto commit time is 60 second,
the first core commit without delay, the second core do first commit after 10
seconds and commit in 60 seconds interval afterwards, and so on.
> Distribute commit requests evenly
> ---------------------------------
>
> Key: SOLR-8707
> URL: https://issues.apache.org/jira/browse/SOLR-8707
> Project: Solr
> Issue Type: Improvement
> Components: update
> Reporter: Michael Sun
>
> In current implementation, all Solr nodes start commit for all cores in a
> collection almost at the same time. As result, it creates a load spike in
> cluster at regular interval, particular when collection is on HDFS. The main
> reason is that all cores are created almost at the same time for a collection
> and do commit in a fixed interval afterwards.
> It's good to distribute the the commit load evenly to avoid load spike. It
> helps to improve performance and reliability in general.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
