[ 
https://issues.apache.org/jira/browse/SOLR-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354379#comment-14354379
 ] 

Damien Kamerman commented on SOLR-7191:
---------------------------------------

I tested 4,000 cores on branch_5x and found better results. My setup:
3 nodes (32GB RAM each ; jdk1.8.0_40) running on a single server (256GB RAM).
2,000 collections (1 x shard ; 2 x replica)
1 x Zookeeper 3.4.6

Full restart (stop all nodes; start all nodes 1min staggered). Many cores on 
node1 are active, other cores are recovering. Lots of warnings 
'org.apache.solr.update.PeerSync; no frame of reference to tell if we've missed 
updates' on node2 and node3. But it is slowly recovering.

BTW: collection creation slows down the more collections you have in the cloud. 
Starts with qtimes of ~3s; ending with ~6s. Solr 4.x was always steady at ~3s.

> Improve stability and startup performance of SolrCloud with thousands of 
> collections
> ------------------------------------------------------------------------------------
>
>                 Key: SOLR-7191
>                 URL: https://issues.apache.org/jira/browse/SOLR-7191
>             Project: Solr
>          Issue Type: Bug
>          Components: SolrCloud
>    Affects Versions: 5.0
>            Reporter: Shawn Heisey
>              Labels: performance, scalability
>         Attachments: lots-of-zkstatereader-updates-branch_5x.log
>
>
> A user on the mailing list with thousands of collections (5000 on 4.10.3, 
> 4000 on 5.0) is having severe problems with getting Solr to restart.
> I tried as hard as I could to duplicate the user setup, but I ran into many 
> problems myself even before I was able to get 4000 collections created on a 
> 5.0 example cloud setup.  Restarting Solr takes a very long time, and it is 
> not very stable once it's up and running.
> This kind of setup is very much pushing the envelope on SolrCloud performance 
> and scalability.  It doesn't help that I'm running both Solr nodes on one 
> machine (I started with 'bin/solr -e cloud') and that ZK is embedded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to