Re: Reading from lagging replicas

Thanks. I'm aware of ISR but looking for exact logic inside Java client how is this handled so when follower replica, consumer is using, starts lagging / goes out-of-sync. On Mon, Sep 20, 2021 at 2:52 PM Luke Chen wrote: > Hi Michał, > I think you want to check the term in Kafka: In Sync Replica

Re: Kafka possibilities

Hi, You could try to use a stream processing library that supports joining multiple streams. Check out https://www.confluent.io/blog/crossing-streams-joins-apache-kafka/ Best, Denis On Mon, Sep 20, 2021 at 6:46 PM Andrew Rakov wrote: > Hello! > > I'm working with Kafka to send messages from on

Kafka possibilities

Hello! I'm working with Kafka to send messages from one microservice to another. And I have a problem. It completely stops my work. I have a couple of topics with a few partitions. I want to round-robin read from each topic. I mean to take one message from a topic and go to the next. But I can't

difference in disk utilization between replica and leader of a partition

Hi All, I have a kafka cluster running in kubernetes with 3 brokers. I have a topic with 3 partitions and replication factor of 3. Topic is evenly distributed across brokers. I have noticed that there is a huge difference in disk utilization of one partition between replica and leader. Ideally repl

Re: [ANNOUNCE] Apache Kafka 2.8.1

Thank you, David, for serving as the release manager for 2.8.1. Great work! And congratulations to the Apache Kafka community! Best regards, Randall On Mon, Sep 20, 2021 at 2:48 AM David Jacot wrote: > The Apache Kafka community is pleased to announce the release for > Apache Kafka 2.8.1 > >

Re: MM2 - Overriding MirrorSourceConnector Consumer & Producer values

did you try setting these values in the distributor.properties file? On Mon, Sep 20, 2021 at 12:43 AM Jamie wrote: > Hi All, > Has anyone been able to override the producer and consumer values of the > MM2 MirrorSourceConnector as described below? > Many Thanks, > Jamie > > > -Original Messa

ApacheCon starts tomorrow!

ApacheCon @Home starts tomorrow! Details at https://www.apachecon.com/acah2021/index.html (Note: You're receiving this because you are subscribed to one or more user lists for Apache Software Foundation projects.) We've got three days of great content lined up for you, spanning 14 project co

Re: Reading from lagging replicas

Hi Michał, I think you want to check the term in Kafka: In Sync Replicas (a.k.a ISR). You might want to check the "Replication" section in doc here . The configuration is this one: *replica.lag.time.max.ms * https

Reading from lagging replicas

Hey, When Java client is reading from replica then how is handled the case when such replica starts to lag? (struggles to replicate data from the leader). Does consumer, coordinator or group leader have any logic to detect such cases and try to switch over to other replica in those cases? (pointer

[ANNOUNCE] Apache Kafka 2.8.1

The Apache Kafka community is pleased to announce the release for Apache Kafka 2.8.1 Apache Kafka 2.8.1 is a bugfix release and fixes 49 issues since the 2.8.0 release. Please see the release notes for more information. All of the changes in this release can be found in the release notes: https:/

Re: MM2 - Overriding MirrorSourceConnector Consumer & Producer values

Hi All,  Has anyone been able to override the producer and consumer values of the MM2 MirrorSourceConnector as described below? Many Thanks,  Jamie -Original Message- From: Jamie To: users@kafka.apache.org Sent: Thu, 16 Sep 2021 15:52 Subject: MM2 - Overriding MirrorSourceConnector Con