[ 
https://issues.apache.org/jira/browse/SOLR-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14050698#comment-14050698
 ] 

Shalin Shekhar Mangar commented on SOLR-5473:
---------------------------------------------

bq. I think because you are trying to tie that issue into this collections 
scaling issue, you are okay saying that, oh it just has to be ugly and hackey, 
because it's this whole pile of issues we are solving. I don't think it does 
have to be ugly or hackey and I think if we let that stay in trunk, it will 
haunt us like a lot of other code we have sometimes let in too easily.

bq. Finally, splitting the clusterstate by collection has not been a 
contentious issue. Some of the other things you are doing around watchers and 
caching is more contentious. We don't have full agreement on them, we never 
have, and it really feels like they are coming in as extra pork on a bill with 
the JIRA title "make one state.json per collection".

As Noble explained earlier, there's really no point in splitting cluster state 
by collection if we were not trying to scale to a large number of collections. 
They are the same issue. We aren't doing this because we want to work around ZK 
size limits for clusterstate.json. We are trying to make large clusters 
possible which have thousands of collections. There is really no point in 
splitting the cluster state per collection and multiplying the number of 
watchers in the system by the number of collections. Even if ZK and SolrCloud 
scales to that limit and I don't know if it would, it is just wasteful and not 
required at all.


> Make one state.json per collection
> ----------------------------------
>
>                 Key: SOLR-5473
>                 URL: https://issues.apache.org/jira/browse/SOLR-5473
>             Project: Solr
>          Issue Type: Sub-task
>          Components: SolrCloud
>            Reporter: Noble Paul
>            Assignee: Noble Paul
>             Fix For: 5.0
>
>         Attachments: SOLR-5473-74 .patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-74.patch, 
> SOLR-5473-74.patch, SOLR-5473-74.patch, SOLR-5473-configname-fix.patch, 
> SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, 
> SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, 
> SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, 
> SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, 
> SOLR-5473.patch, SOLR-5473.patch, SOLR-5473_undo.patch, 
> ec2-23-20-119-52_solr.log, ec2-50-16-38-73_solr.log
>
>
> As defined in the parent issue, store the states of each collection under 
> /collections/collectionname/state.json node



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to