One other thing I did not mention is GC pauses. If you have smaller heap sizes, you would have less very long GC pauses, so that can be an advantage having many cores (if cores are distributed into seperate SOLR instances, as seperate processes). I think you can expect 1 second pause for each GB of heap size in worst case.
On Thu, Dec 15, 2011 at 2:14 PM, Robert Stewart <bstewart...@gmail.com> wrote: > It is true number of terms may be much more than N/10 (or even N for > each core), but it is the number of docs per term that will really > matter. So you can have N terms in each core but each term has 1/10 > number of docs on avg. > > > > > 2011/12/15 Yury Kats <yuryk...@yahoo.com>: >> On 12/15/2011 1:07 PM, Robert Stewart wrote: >> >>> I think overall memory usage would be close to the same. >> >> Is this really so? I suspect that the consumed memory is in direct >> proportion to the number of terms in the index. I also suspect that >> if I divided 1 core with N terms into 10 smaller cores, each smaller >> core would have much more than N/10 terms. Let's say I'm indexing >> English texts, it's likely that all smaller cores would have almost >> the same number of terms, close to the original N. Not so?
