Re: Exposing Solr routing to SolrJ client

2012-03-14 Thread Per Steffensen
FYI (if it is of any interest), we just hacked CloudSolrServer locally to support routing of realtime-get requests. Limitations are: - Only id-parameter and not ids-parameter supported in realtime-get requests. - Only schemas with uniqueKey on field named id and only id-field of type string

Exposing Solr routing to SolrJ client

2012-03-12 Thread Per Steffensen
Hi I believe Solr(Cloud) is doing some internal routing of update-requests to make sure documents are stored in the correct core/shard decided by Solrs internal routing algoritm (I believe it basically finds out who is the leader-shard for a given document, using shared information in ZK,

Re: Exposing Solr routing to SolrJ client

2012-03-12 Thread Mark Miller
Hey Per, A couple things: 1. Distributed realtime get is coming - I know Yonik was looking at this recently but got caught up in some other things. 2. There is a Solrj client that is aware of the cluster state - its called CloudSolrServer. You give it the zookeeper address rather than a

Re: Exposing Solr routing to SolrJ client

2012-03-12 Thread Per Steffensen
Mark Miller skrev: Hey Per, A couple things: 1. Distributed realtime get is coming - I know Yonik was looking at this recently but got caught up in some other things. Fantistic! I believe, if the client becomes routing aware, it is only necessary when you are sending more than one id

Re: Exposing Solr routing to SolrJ client

2012-03-12 Thread Mark Miller
On Mar 12, 2012, at 9:39 AM, Per Steffensen wrote: Mark Miller skrev: Hey Per, A couple things: 1. Distributed realtime get is coming - I know Yonik was looking at this recently but got caught up in some other things. Fantistic! I believe, if the client becomes routing aware, it

Re: Exposing Solr routing to SolrJ client

2012-03-12 Thread Per Steffensen
Right, you can't yet even with CloudSolrServer - but I think it will be done soon - certainly before the 4 release anyway. Ok, I will cross my fingers for it to be done soon. Thanks for your kind help. Regards, Steff - To

Re: Exposing Solr routing to SolrJ client

2012-03-12 Thread Yonik Seeley
On Mon, Mar 12, 2012 at 8:15 AM, Mark Miller markrmil...@gmail.com wrote: Currently it doesn't send directly to the leader, but this is planned - it's a little tricky due to lack of access to the Schema for hashing Hmmm, why is this? Identification of the uniqueKey field? Maybe we just

Re: Exposing Solr routing to SolrJ client

2012-03-12 Thread Mark Miller
On Mar 12, 2012, at 5:32 PM, Yonik Seeley wrote: On Mon, Mar 12, 2012 at 8:15 AM, Mark Miller markrmil...@gmail.com wrote: Currently it doesn't send directly to the leader, but this is planned - it's a little tricky due to lack of access to the Schema for hashing Hmmm, why is this?

Re: Exposing Solr routing to SolrJ client

2012-03-12 Thread Yonik Seeley
On Mon, Mar 12, 2012 at 5:39 PM, Mark Miller markrmil...@gmail.com wrote: On Mar 12, 2012, at 5:32 PM, Yonik Seeley wrote: On Mon, Mar 12, 2012 at 8:15 AM, Mark Miller markrmil...@gmail.com wrote: Currently it doesn't send directly to the leader, but this is planned - it's a little tricky