Calculating maxShardsPerNode
Hi, Our cluster is a 20 node with numShards expected to be set to 10 and replication expected to be 4. Wondering what is the best value to set maxShardsPerNode to? Should I consider only numShards while calculating the value i.e. because I have only 10 shards, should I set maxShardsPerNode to 1or at number of physical replicas i.e. numShards * replicationFactor. So should I set maxShardsPerNode to 2 because the total physical replicas are 40 (numShards * replicationFactor) while the number of nodes are only 20? Please let me know your thoughts. Thanks
Re: Calculating maxShardsPerNode
I wouldn't spend a lot of time worrying about this, just set it to a big number ;). Solr won't create that many replicas (and the name is a bit confusing) unless you ask it to. It'll also distribute the replicas across nodes rather than putting them all together, and in the worst case you can place them individually yourself. This is more a safety valve to keep from doing ridiculous things, like telling Solr to create 1,000 replicas on 2 hosts or something. Best, Erick On Mon, Aug 13, 2018 at 8:37 AM, Greenhorn Techie wrote: > Hi, > > Our cluster is a 20 node with numShards expected to be set to 10 and > replication expected to be 4. Wondering what is the best value to > set maxShardsPerNode to? Should I consider only numShards while calculating > the value i.e. because I have only 10 shards, should I set maxShardsPerNode > to 1or at number of physical replicas i.e. numShards * replicationFactor. > So should I set maxShardsPerNode to 2 because the total physical replicas > are 40 (numShards * replicationFactor) while the number of nodes are only > 20? > > Please let me know your thoughts. > > Thanks
Re: Calculating maxShardsPerNode
Thanks Erick! On 13 August 2018 at 17:05:57, Erick Erickson (erickerick...@gmail.com) wrote: I wouldn't spend a lot of time worrying about this, just set it to a big number ;). Solr won't create that many replicas (and the name is a bit confusing) unless you ask it to. It'll also distribute the replicas across nodes rather than putting them all together, and in the worst case you can place them individually yourself. This is more a safety valve to keep from doing ridiculous things, like telling Solr to create 1,000 replicas on 2 hosts or something. Best, Erick On Mon, Aug 13, 2018 at 8:37 AM, Greenhorn Techie wrote: > Hi, > > Our cluster is a 20 node with numShards expected to be set to 10 and > replication expected to be 4. Wondering what is the best value to > set maxShardsPerNode to? Should I consider only numShards while calculating > the value i.e. because I have only 10 shards, should I set maxShardsPerNode > to 1or at number of physical replicas i.e. numShards * replicationFactor. > So should I set maxShardsPerNode to 2 because the total physical replicas > are 40 (numShards * replicationFactor) while the number of nodes are only > 20? > > Please let me know your thoughts. > > Thanks