As I know, MM2 cannot sync topics on same cluster as topics on source and target supposed to have same name or to come with prefix.sameName
plz correct me, there is no topicA -> topicB replication -----Original Message----- From: Anders Engström <epirea...@gmail.com> Sent: Tuesday, November 21, 2023 12:58 To: users@kafka.apache.org Subject: Re: Messages streaming from topic to topic [You don't often get email from epirea...@gmail.com. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ] CAUTION: This email is from an external source. Please don’t open any unknown links or attachments. Mirror Maker (2) might be a good solution.. It's "mostly" Kafka Connect, so it should be possible to do filtering etc. https://developers.redhat.com/articles/2023/11/13/demystifying-kafka-mirrormaker-2-use-cases-and-architecture#mirrormaker_2_internal_topics /Anders On Tue, Nov 21, 2023 at 11:55 AM Alexander Shapiro (ashapiro) <alexander.shap...@amdocs.com.invalid> wrote: > Thanks for instant reply > > Yes, I did > > I have checked till now the below: > Apache Storm > Apache Heron > Apache Samza > Apache Spark > Apache Flink > Apache NiFi > Confluent replicator > StreamSets Data collector > Envoy Filters > > > > > > -----Original Message----- > From: megh vidani <vidanimeg...@gmail.com> > Sent: Tuesday, November 21, 2023 12:46 > To: users@kafka.apache.org > Cc: dev <d...@kafka.apache.org>; kafka-clients < > kafka-clie...@googlegroups.com> > Subject: Re: Messages streaming from topic to topic > > [You don't often get email from vidanimeg...@gmail.com. Learn why this > is important at https://aka.ms/LearnAboutSenderIdentification ] > > CAUTION: This email is from an external source. Please don't open any > unknown links or attachments. > > Hi Alexander, > > Have you explored Spark or Flink? > > Thanks, > Megh > > On Tue, Nov 21, 2023, 15:50 Alexander Shapiro (ashapiro) < > alexander.shap...@amdocs.com.invalid> wrote: > > > Hi team! > > > > > > I am looking for an open-source Tool with capability to stream Kafka > > message from topic A to topic B with bellow conditions: > > a. A and B can be on same cluster. > > b. A and B can be on different clusters. > > c. Aggregation of messages > > d. Filtration of messages > > e. Customization options for payload manipulation > > before sending to topic B - preferable java. > > f. Optional - streaming message to other > > technologies > > > > For example, > > such capabilities can be implemented with "StreamSets Data > > Collector", but this tool looks like overkill for my needs This > > email and the information contained herein is proprietary and > > confidential and subject to the Amdocs Email Terms of Service, which > > you may review at > > https://www.amdocs.com/about/email-terms-of-service < > > https://www.amdocs.com/about/email-terms-of-service> > > > > > This email and the information contained herein is proprietary and > confidential and subject to the Amdocs Email Terms of Service, which > you may review at https://www.amdocs.com/about/email-terms-of-service > < https://www.amdocs.com/about/email-terms-of-service> > > This email and the information contained herein is proprietary and confidential and subject to the Amdocs Email Terms of Service, which you may review at https://www.amdocs.com/about/email-terms-of-service <https://www.amdocs.com/about/email-terms-of-service>
