Re: SolrCloud AutoSharding? In enterprise environment?

2012-11-04 Thread joseph_12345
Thanks Eric for the explanation. It helps me a lot :). -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-AutoSharding-In-enterprise-environment-tp4017036p4018194.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud AutoSharding? In enterprise environment?

2012-10-31 Thread Erick Erickson
of where the index files will be > created in each shard. When I indexed few documents by pointing to one > shard, I saw few files getting created under > apache-solr-4.0.0\example\solr\mycollection\data\index. Is this the complete > index files location ? > > Thanks > Jaino > &g

Re: SolrCloud AutoSharding? In enterprise environment?

2012-10-31 Thread joseph_12345
://lucene.472066.n3.nabble.com/SolrCloud-AutoSharding-In-enterprise-environment-tp4017036p4017201.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud AutoSharding? In enterprise environment?

2012-10-30 Thread Otis Gospodnetic
://lucene.472066.n3.nabble.com/SolrCloud-AutoSharding-td4011834.html > > But I have few questions. > > We are exploring SolrCloud to index millions of product details. We are > planning to use a complete pool for SollCloud with a set of 15 physical > machines. The clients will be

SolrCloud AutoSharding? In enterprise environment?

2012-10-30 Thread joseph_12345
Hi All, I have looked at the below post URL and it really helps me a lot. http://lucene.472066.n3.nabble.com/SolrCloud-AutoSharding-td4011834.html But I have few questions. We are exploring SolrCloud to index millions of product details. We are planning to use a complete pool for SollCloud

Re: SolrCloud AutoSharding?

2012-10-04 Thread Jason Huang
Thanks Otis. This starts to make more sense to me. I will go through the links in your signature and dig into it. Still learning but this is a good direction. thanks! Jason On Thu, Oct 4, 2012 at 2:55 PM, Otis Gospodnetic wrote: > Hi, > > You could start with one node on which you could start

Re: SolrCloud AutoSharding?

2012-10-04 Thread Otis Gospodnetic
Hi, You could start with one node on which you could start with # shards == # CPU cores. Then, all while running a stress/performance test, observe the latency and other metrics you care about. Keep increasing the number of shards and keep observing. SPM for Solr (see signature) will help with th

Re: SolrCloud AutoSharding?

2012-10-04 Thread Jason Huang
Tomás, Thanks for the response. So basically at this point what I could do is to make a "best guess" of my estimated index size and specify a few shards to start with. I am guessing if I assigned too many shards, then the "join" between different shards may be the bottleneck? On the other side, i

Re: SolrCloud AutoSharding?

2012-10-04 Thread Tomás Fernández Löbbe
SolrCloud doesn't auto-shard at this point. It doesn't split indexes either (there is an open issue for this: https://issues.apache.org/jira/browse/SOLR-3755 ) At this point you need to specify the number of shards for a collection in advance, with the numShards parameter. When you have more than

SolrCloud AutoSharding?

2012-10-04 Thread Jason Huang
Hello, I am exploring SolrCloud and have a few questions about SolrCloud's auto-sharding functionality. I couldn't find any good answer from my online search - if anyone knows the answer to these questions or can point me to the right document, that would be great! (1) Does SolrCloud offer auto-s