Re: [jira] [Created] (SOLR-6314) Multi-threaded facet counts differ when SolrCloud has >1 shard

2014-08-02 Thread Vamsee Yarlagadda
Thanks @Erick. I was able to replicate the issue on Solr trunk (5.0)
Let me know if there is anything I can do to help in the process.

On Saturday, August 2, 2014, Erick Erickson (JIRA)  wrote:

>
> [
> https://issues.apache.org/jira/browse/SOLR-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083620#comment-14083620
> ]
>
> Erick Erickson commented on SOLR-6314:
> --
>
> I know something about that code so I'll try to take a look.
>
> I'm not entirely sure when I'll get to it though, I'm slammed. So
> if someone wants to look at it instead, please feel free.
>
> Vamsee:
>
> What version of Solr are you seeing this on?
>
> > Multi-threaded facet counts differ when SolrCloud has >1 shard
> > --
> >
> > Key: SOLR-6314
> > URL: https://issues.apache.org/jira/browse/SOLR-6314
> > Project: Solr
> >  Issue Type: Bug
> >  Components: SearchComponents - other, SolrCloud
> >Affects Versions: 5.0
> >Reporter: Vamsee Yarlagadda
> >Assignee: Erick Erickson
> >
> > I am trying to work with multi-threaded faceting on SolrCloud and in the
> process i was hit by some issues.
> > I am currently running the below upstream test on different SolrCloud
> configurations and i am getting a different result set per configuration.
> >
> https://github.com/apache/lucene-solr/blob/trunk/solr/core/src/test/org/apache/solr/request/TestFaceting.java#L654
> > Setup:
> > - *Indexed 50 docs into SolrCloud.*
> > - *If the SolrCloud has only 1 shard, the facet field query has the
> below output (which matches with the expected upstream test output - #
> facet fields ~ 50).*
> > {code}
> > $ curl  "
> http://localhost:8983/solr/collection1/select?facet=true&fl=id&indent=true&q=id%3A*&facet.limit=-1&facet.threads=1000&facet.field=f0_ws&facet.field=f0_ws&facet.field=f0_ws&facet.field=f0_ws&facet.field=f0_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f6_ws&facet.field=f6_ws&facet.field=f6_ws&facet.field=f6_ws&facet.field=f6_ws&facet.field=f7_ws&facet.field=f7_ws&facet.field=f7_ws&facet.field=f7_ws&facet.field=f7_ws&facet.field=f8_ws&facet.field=f8_ws&facet.field=f8_ws&facet.field=f8_ws&facet.field=f8_ws&facet.field=f9_ws&facet.field=f9_ws&facet.field=f9_ws&facet.field=f9_ws&facet.field=f9_ws&rows=1&wt=xml
> "
> > 
> > 
> > 
> >   0
> >   21
> >   
> > true
> > id
> > true
> > id:*
> > -1
> > 1000
> > 
> >   f0_ws
> >   f0_ws
> >   f0_ws
> >   f0_ws
> >   f0_ws
> >   f1_ws
> >   f1_ws
> >   f1_ws
> >   f1_ws
> >   f1_ws
> >   f2_ws
> >   f2_ws
> >   f2_ws
> >   f2_ws
> >   f2_ws
> >   f3_ws
> >   f3_ws
> >   f3_ws
> >   f3_ws
> >   f3_ws
> >   f4_ws
> >   f4_ws
> >   f4_ws
> >   f4_ws
> >   f4_ws
> >   f5_ws
> >   f5_ws
> >   f5_ws
> >   f5_ws
> >   f5_ws
> >   f6_ws
> >   f6_ws
> >   f6_ws
> >   f6_ws
> >   f6_ws
> >   f7_ws
> >   f7_ws
> >   f7_ws
> >   f7_ws
> >   f7_ws
> >   f8_ws
> >   f8_ws
> >   f8_ws
> >   f8_ws
> >   f8_ws
> >   f9_ws
> >   f9_ws
> >   f9_ws
> >   f9_ws
> >   f9_ws
> > 
> > xml
> > 1
> >   
> > 
> > 
> >   
> > 0.0
> > 
> > 
> >   
> >   
> > 
> >   25
> >   25
> > 
> > 
> >   25
> >   25
> > 
> > 
> >   25
> >   25
> > 
> > 
> >   25
> >   25
> > 
> > 
> >   25
> >   25
> > 
> > 
> >   33
> >   17
> > 
> > 
> >   33
> >   17
> > 
> > 
> >   33
> >   17
> > 
> > 
> >   33
> >   17
> > 
> > 
> >   33
> >   17
> > 
> > 
> >   37
> >   13
> > 
> > 
> >   37
> >   13
> > 
> > 
> >   37
> >   13
> > 
> > 
> >   37
> >   13
> > 
> > 
> >   37
> >   13
> > 
> > 
> >   40
> >   10
> > 
> > 
> >   40
> >   10
> > 
> > 
> >   40
> >   10
> > 
> > 
> >   40
> >   10
> > 
> > 
> >   40
> >   10
> > 
> > 
> >   41
> >   9
> > 
> > 
> >   41
> >   9
> > 
> > 
> >   41
> >   9
> > 
> > 
> >   41
> >   9
> > 
> > 
> >   41
> >   9
> > 
> > 
> >   42
> >   

[jira] [Created] (SOLR-6314) Multi-threaded facet counts differ when SolrCloud has >1 shard

2014-08-01 Thread Vamsee Yarlagadda (JIRA)
Vamsee Yarlagadda created SOLR-6314:
---

 Summary: Multi-threaded facet counts differ when SolrCloud has >1 
shard
 Key: SOLR-6314
 URL: https://issues.apache.org/jira/browse/SOLR-6314
 Project: Solr
  Issue Type: Bug
  Components: SearchComponents - other, SolrCloud
Affects Versions: 5.0
Reporter: Vamsee Yarlagadda


I am trying to work with multi-threaded faceting on SolrCloud and in the 
process i was hit by some issues.

I am currently running the below upstream test on different SolrCloud 
configurations and i am getting a different result set per configuration.
https://github.com/apache/lucene-solr/blob/trunk/solr/core/src/test/org/apache/solr/request/TestFaceting.java#L654

Setup:
- *Indexed 50 docs into SolrCloud.*

- *If the SolrCloud has only 1 shard, the facet field query has the below 
output (which matches with the expected upstream test output - # facet fields ~ 
50).*

{code}
$ curl  
"http://localhost:8983/solr/collection1/select?facet=true&fl=id&indent=true&q=id%3A*&facet.limit=-1&facet.threads=1000&facet.field=f0_ws&facet.field=f0_ws&facet.field=f0_ws&facet.field=f0_ws&facet.field=f0_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f6_ws&facet.field=f6_ws&facet.field=f6_ws&facet.field=f6_ws&facet.field=f6_ws&facet.field=f7_ws&facet.field=f7_ws&facet.field=f7_ws&facet.field=f7_ws&facet.field=f7_ws&facet.field=f8_ws&facet.field=f8_ws&facet.field=f8_ws&facet.field=f8_ws&facet.field=f8_ws&facet.field=f9_ws&facet.field=f9_ws&facet.field=f9_ws&facet.field=f9_ws&facet.field=f9_ws&rows=1&wt=xml";




  0
  21
  
true
id
true
id:*
-1
1000

  f0_ws
  f0_ws
  f0_ws
  f0_ws
  f0_ws
  f1_ws
  f1_ws
  f1_ws
  f1_ws
  f1_ws
  f2_ws
  f2_ws
  f2_ws
  f2_ws
  f2_ws
  f3_ws
  f3_ws
  f3_ws
  f3_ws
  f3_ws
  f4_ws
  f4_ws
  f4_ws
  f4_ws
  f4_ws
  f5_ws
  f5_ws
  f5_ws
  f5_ws
  f5_ws
  f6_ws
  f6_ws
  f6_ws
  f6_ws
  f6_ws
  f7_ws
  f7_ws
  f7_ws
  f7_ws
  f7_ws
  f8_ws
  f8_ws
  f8_ws
  f8_ws
  f8_ws
  f9_ws
  f9_ws
  f9_ws
  f9_ws
  f9_ws

xml
1
  


  
0.0


  
  

  25
  25


  25
  25


  25
  25


  25
  25


  25
  25


  33
  17


  33
  17


  33
  17


  33
  17


  33
  17


  37
  13


  37
  13


  37
  13


  37
  13


  37
  13


  40
  10



  40
  10


  40
  10


  40
  10


  40
  10


  41
  9


  41
  9


  41
  9


  41
  9


  41
  9


  42
  8


  42
  8


  42
  8


  42
  8


  42
  8


  43
  7



  43
  7


  43
  7


  43
  7


  43
  7


  44
  6


  44
  6


  44
  6


  44
  6


  44
  6


  45
  5


  45
  5


  45
  5


  45
  5


  45
  5


  45
  5


  45
  5



  45
  5


  45
  5


  45
  5

  
  
  

 
{code}


- *Now, if a create a new collection with 2 shards (>1 shard SolrCloud), the 
same above query results in a different output. (# facet fields ~ 10 ;  
Expected 50)*

{code}
$ curl  
"http://localhost:8983/solr/collection1/select?facet=true&fl=id&indent=true&q=id%3A*&facet.limit=-1&facet.threads=1000&facet.field=f0_ws&facet.field=f0_ws&facet.field=f0_ws&facet.field=f0_ws&facet.field=f0_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f1_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f2_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f3_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f4_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f5_ws&facet.field=f