SolrCloud MatchAllDocsQuery returning different number of docs each request

2012-08-02 Thread Timothy Potter
Just starting to get into SolrCloud using 4.0.0-ALPHA and am very impressed so far ... I have a 12-shard index with ~104M docs with each shard having 1-replica (so 24 Solr servers running) Using the Query form on the Admin panel, I issue the MatchAllDocsQuery (*:*) and each time I send the

Re: SolrCloud MatchAllDocsQuery returning different number of docs each request

2012-08-02 Thread Mark Miller
On Aug 2, 2012, at 11:08 AM, Timothy Potter thelabd...@gmail.com wrote: Just starting to get into SolrCloud using 4.0.0-ALPHA and am very impressed so far ... I have a 12-shard index with ~104M docs with each shard having 1-replica (so 24 Solr servers running) Using the Query form on

Re: SolrCloud MatchAllDocsQuery returning different number of docs each request

2012-08-02 Thread Timothy Potter
Thanks Mark. I'm actually using SolrJ 3.4.0, so using CommonsHttpSolrServer: CollectionSolrInputDocument batch = ... ... build up batch ... solrServer.add( batch ); Basically, I have a custom Pig StoreFunc that sends docs to Solr from our Hadoop analytics nodes. The reason I'm not using SolrJ

Re: SolrCloud MatchAllDocsQuery returning different number of docs each request

2012-08-02 Thread Timothy Potter
Sorry, I didn't answer your other questions about shards being in-sync. Yes - all are green and happy according to the Cloud admin panel. Tim On Thu, Aug 2, 2012 at 12:16 PM, Timothy Potter thelabd...@gmail.com wrote: Thanks Mark. I'm actually using SolrJ 3.4.0, so using

Re: SolrCloud MatchAllDocsQuery returning different number of docs each request

2012-08-02 Thread Mark Miller
Can you do me a favor and try not using the batch add for a run? Just do the add one doc at a time. (solrServer.add(doc) rather than solrServer.add(collection)) I just fixed one issue with it this morning on trunk - it may be the cause of this oddity. I'm also working on some performance

Re: SolrCloud MatchAllDocsQuery returning different number of docs each request

2012-08-02 Thread Timothy Potter
Yes, I can but won't get to it today unfortunately. I had my eval environment running on some very expensive EC2 instances and shut it down for the time being until I can focus on it again. Will try to get back to this either tomorrow or over the weekend. Sorry for the delay. Tim On Thu, Aug 2,

Re: SolrCloud MatchAllDocsQuery returning different number of docs each request

2012-08-02 Thread Mark Miller
FYI: I've committed the rest of the work I was doing on trunk in this area. On Aug 2, 2012, at 4:42 PM, Timothy Potter thelabd...@gmail.com wrote: Yes, I can but won't get to it today unfortunately. I had my eval environment running on some very expensive EC2 instances and shut it down for