[
https://issues.apache.org/jira/browse/SOLR-14928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231876#comment-17231876
]
Ilan Ginzburg commented on SOLR-14928:
--------------------------------------
A new
[commit|https://github.com/murblanc/lucene-solr/commit/4d96bcdbe0278c53a5c9283fe62af49715522e81]
allows running comparison tests (by toggling
{{StateChangeRecorder.USE_DISTRIBUTED_STATE_CHANGE}}) to see the time it takes
to run the create collection command (excluding actual replica creation on the
nodes where they should go!).
Initial (JMeter based) comparison between state update directly to ZK and via
Overseer seems promising (but the collection creation work done by
{{CreateCollectionCmd}} is the low hanging fruit expected to be faster, so no
major win here, but at least no fatal blow to this effort).
Note the Collection API is broken by this commit (so don't try deleting
collections or anything with it).
> Remove Overseer ClusterStateUpdater
> -----------------------------------
>
> Key: SOLR-14928
> URL: https://issues.apache.org/jira/browse/SOLR-14928
> Project: Solr
> Issue Type: Sub-task
> Security Level: Public(Default Security Level. Issues are Public)
> Components: SolrCloud
> Reporter: Ilan Ginzburg
> Assignee: Ilan Ginzburg
> Priority: Major
> Labels: cluster, collection-api, overseer
>
> Remove the Overseer {{ClusterStateUpdater}} thread and associated Zookeeper
> queue at {{<_chroot_>/overseer/queue}}.
> Change cluster state updates so that each (Collection API) command execution
> does the update directly in Zookeeper using optimistic locking (Compare and
> Swap on the {{state.json}} Zookeeper files).
> Following this change cluster state updates would still be happening only
> from the Overseer node (that's where Collection API commands are executing),
> but the code will be ready for distribution once such commands can be
> executed by any node (other work done in the context of parent task
> SOLR-14927).
> See the [Cluster State
> Updater|https://docs.google.com/document/d/1u4QHsIHuIxlglIW6hekYlXGNOP0HjLGVX5N6inkj6Ok/edit#heading=h.ymtfm3p518c]
> section in the Removing Overseer doc.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
