Ottomata has uploaded a new change for review. https://gerrit.wikimedia.org/r/278752
Change subject: Add DC named topics to event bus topic config ...................................................................... Add DC named topics to event bus topic config Bug: T127718 Change-Id: I6885dec5286e453821a0e38c26848efbdf76e6cb --- M modules/role/files/eventbus/topics.yaml 1 file changed, 43 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/52/278752/1 diff --git a/modules/role/files/eventbus/topics.yaml b/modules/role/files/eventbus/topics.yaml index cf09bff..eea040e 100644 --- a/modules/role/files/eventbus/topics.yaml +++ b/modules/role/files/eventbus/topics.yaml @@ -5,7 +5,50 @@ # be produced to topics. # +# Topics here are prefixd with DCs in order to differentiate +# the source of events in aggregate Kafka clusters in each DC. +# That is, the main (local) Kafka cluster in each DC will only have +# the topics prefixed with that DC, whereas the aggregate clusters +# will replicate topics from main local and main remote clusters. +# This allows (with extra effort) consumers to balance themselves between +# DCs. For some backround, see: +# - https://phabricator.wikimedia.org/T127718 +# - https://phabricator.wikimedia.org/T123954 + + +eqiad.mediawiki.page_delete: + schema_name: page_delete +codfw.mediawiki.page_delete: + schema_name: page_delete + +eqiad.mediawiki.page_move: + schema_name: page_move +codfw.mediawiki.page_move: + schema_name: page_move + +eqiad.mediawiki.page_restore: + schema_name: page_restore +codfw.mediawiki.page_restore: + schema_name: page_restore + +eqiad.mediawiki.revision_visibility_set: + schema_name: revision_visibility_set +codfw.mediawiki.revision_visibility_set: + schema_name: revision_visibility_set + +eqiad.mediawiki.revision_create: + schema_name: revision_create +codfw.mediawiki.revision_create: + schema_name: revision_create + +eqiad.wmf.resource_change: + schema_name: resource_change +codfw.wmf.resource_change: + schema_name: resource_change + # TODO: page_edit will be deprecated in favor of revision_create. +# TODO: Remove these non DC prefixed topic configs when +# Mediawiki begins producing to DC named topics. mediawiki.page_edit: schema_name: page_edit -- To view, visit https://gerrit.wikimedia.org/r/278752 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I6885dec5286e453821a0e38c26848efbdf76e6cb Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Ottomata <o...@wikimedia.org> _______________________________________________ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
