Re: estimating memory needed for solr instances...

2008-07-10 Thread Preetam Rao
Oops. Sorry for the typo. I will be careful next time. Thanks a lot for digging out the old thread :-) It was helpful. Should we remove the option "useFilterForSortedQuery" altogether if its not being used anymore ? --- Preetam On Fri, Jul 11, 2008 at 2:10 AM, Chris Harris <[EMAIL PROTECTED

Re: estimating memory needed for solr instances...

2008-07-10 Thread Chris Harris
I didn't know what option was being referred to here, but I eventually figured it out. If anyone else was confused, the option is called useFilterForSortedQuery, you can set it via solrconfig.xml, and, at least according to Yonik in late 2006, you probably won't want to enable it even if you *do* s

Re: estimating memory needed for solr instances...

2008-07-09 Thread Preetam Rao
Thanks for the responses, Ian, Jacob. While I could not locate the previous thread, this is what I understand.. While we can fine tune the cache parameters and other stuff which we can directly control, with respect to index files the key is to give enough RAM and let the the OS do its best with

Re: estimating memory needed for solr instances...

2008-07-09 Thread Ian Connor
I would guess so also to a point. After you run out of RAM, indexing also takes a hit. I have noticed on a 2Gb machine when the index gets over 2Gb, my indexing rate when down from 100/s to 40/s. After reaching 4Gb it was down to 10/s. I am trying now with a 8Gb machine to see how far I get through

Re: estimating memory needed for solr instances...

2008-07-09 Thread Jacob Singh
My total guess is that indexing is CPU bound, and searching is RAM bound. Best, Jacob Ian Connor wrote: > There was a thread a while ago, that suggested just need to factor in > the index's total size (Mike Klaas I think was the author). It was > suggested having the RAM is enough and the OS will

Re: estimating memory needed for solr instances...

2008-07-09 Thread Ian Connor
There was a thread a while ago, that suggested just need to factor in the index's total size (Mike Klaas I think was the author). It was suggested having the RAM is enough and the OS will cache the files as needed to give you the performance boost needed. If I misread the thread, please chime in -

estimating memory needed for solr instances...

2008-07-09 Thread Preetam Rao
Hi, Since we plan to share the same box among multiple solr instances on a 16gb RAM multi core box, Need to estimate how much memory we need for our application. The index size is on disk 2.4G with close to 3 million documents. The plan is to use dismax query with some fqs. Since we do not sort