Re: sharding guidelines

2018-06-06 Thread Emir Arnautović
In case you missed, following blog posts might come handy: https://lucidworks.com/2012/07/23/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/

Re: sharding guidelines

2018-06-05 Thread Shawn Heisey
On 6/4/2018 4:36 PM, Oakley, Craig (NIH/NLM/NCBI) [C] wrote: We have a collection (one shard, two replicas, currently running Solr6.6) which sometimes becomes unresponsive on the non-leader node. It is 214 gigabytes, and we were wondering whether there is a rule of thumb how large to allow a

Re: sharding guidelines

2018-06-04 Thread Erik Hatcher
I’d say that 100M/shard is in the smallest doc use case possible, such as straight up log items with only a timestamp, id, and short message kind of thing. In other contexts, big full text docs, 10M/shard is kind of a max. How many documents do you have in your collection? Erik

sharding guidelines

2018-06-04 Thread Oakley, Craig (NIH/NLM/NCBI) [C]
I have a sharding question. We have a collection (one shard, two replicas, currently running Solr6.6) which sometimes becomes unresponsive on the non-leader node. It is 214 gigabytes, and we were wondering whether there is a rule of thumb how large to allow a core to grow before sharding.