[
https://issues.apache.org/jira/browse/KAFKA-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421107#comment-17421107
]
Boyang Chen commented on KAFKA-13326:
-------------------------------------
[~wangguangyuan] Thanks for your interest. There are some known challenges to
support cross-cluster processing:
# The exactly-once semantic will break because Kafka couldn't do cross-cluster
transaction
# The topic tracking will need to be augmented with multi-cluster support in
mind, which is a significant amount of work
# The failure scenario will be complicated, as before it is within one broker
cluster but now multiple, any pair of topic-cluster mapping could fail and
cause a weird state to recover
Considering numerous replicators existing on the market, it's not a top
priority to support that natively in Kafka Streams. [~guozhang] [~mjsax]could
give more insights here.
> Add multi-cluster support to Kafka Streams
> ------------------------------------------
>
> Key: KAFKA-13326
> URL: https://issues.apache.org/jira/browse/KAFKA-13326
> Project: Kafka
> Issue Type: New Feature
> Components: streams
> Reporter: Guangyuan Wang
> Priority: Major
> Labels: needs-kip
>
> Dear Kafka Team,
> According to the link,
> https://kafka.apache.org/28/documentation/streams/developer-guide/config-streams.html#bootstrap-servers.
> Kafka Streams applications can only communicate with a single Kafka cluster
> specified by this config value. Future versions of Kafka Streams will support
> connecting to different Kafka clusters for reading input streams and writing
> output streams.
> Which version will this feature be added in the Kafka stream? This is really
> a very good feature.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
