Re: my index has 500 million docs ,how to improve solr search performance?

2011-04-13 Thread lu.rongbin
5G memory per JVM -- View this message in context: http://lucene.472066.n3.nabble.com/my-index-has-500-million-docs-how-to-improve-solr-search-performance-tp1902595p2819179.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: my index has 500 million docs ,how to improve solr search performance?

2010-11-17 Thread Lance Norskog
This is pretty standard. I think the problem is basic probabilities: when there are multiple shards, the query waits until the final shard responds, then does another query which may wait for more than one shard. The nature of probabilities is that there will be "stragglers" (late responses) an

Re: my index has 500 million docs ,how to improve solr search performance?

2010-11-15 Thread Lance Norskog
It's not that EC2 instances have slow disks, it's that they have no quota system to guarantee you X amount of throughput. I've benchmarked 1x to 3x on the same instance type at different times. That is, 300% variation in disk speeds. Filter queries are only slow once; after that they create a

Re: my index has 500 million docs ,how to improve solr search performance?

2010-11-15 Thread Toke Eskildsen
On Mon, 2010-11-15 at 06:35 +0100, lu.rongbin wrote: > In addition,my index has only two store fields, id and price, and other > fields are index. I increase the document and query cache. the ec2 > m2.4xLarge instance is 8 cores, 68G memery. all indexs size is about 100G. Looking at http://aws.ama

my index has 500 million docs ,how to improve solr search performance?

2010-11-14 Thread lu.rongbin
llion-docs-how-to-improve-solr-search-performance-tp1902595p1902595.html Sent from the Solr - User mailing list archive at Nabble.com.