[
https://issues.apache.org/jira/browse/SOLR-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347813#comment-14347813
]
Shawn Heisey commented on SOLR-7191:
------------------------------------
I have thought about this in terms of deciding whether we should even bother
with it at all... but I figured it wouldn't hurt to open the issue so we can
think about it, figure out whether any performance bottlenecks can be fixed,
and at the very least come up with some best practice information for the docs.
One of the big problems that I had was that the overseer queue was getting
REALLY filled up. I gave up and started over when I realized (from looking at
the logs) that there were over eight hundred thousand entries in the queue, all
from attempts to restart Solr repeatedly. That huge queue is what finally
pushed the znode size too high for jute.maxbuffer.
Zookeeper seems to be the real bottleneck here, which is not all that
surprising.
> Improve stability and startup performance of SolrCloud with thousands of
> collections
> ------------------------------------------------------------------------------------
>
> Key: SOLR-7191
> URL: https://issues.apache.org/jira/browse/SOLR-7191
> Project: Solr
> Issue Type: Bug
> Components: SolrCloud
> Affects Versions: 5.0
> Reporter: Shawn Heisey
> Labels: performance, scalability
>
> A user on the mailing list with thousands of collections (5000 on 4.10.3,
> 4000 on 5.0) is having severe problems with getting Solr to restart.
> I tried as hard as I could to duplicate the user setup, but I ran into many
> problems myself even before I was able to get 4000 collections created on a
> 5.0 example cloud setup. Restarting Solr takes a very long time, and it is
> not very stable once it's up and running.
> This kind of setup is very much pushing the envelope on SolrCloud performance
> and scalability. It doesn't help that I'm running both Solr nodes on one
> machine (I started with 'bin/solr -e cloud') and that ZK is embedded.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
