Re: MirrorMaker 2 and Negative Lag

Hey Alan, I'm running into the same issue as you and I believe I've figured it out. I noticed that consumer partitions on the destination cluster that have a LOG-END-OFFSET=0 all exhibit this issue. It looks like Mirrormaker's offset sync does not work correctly if the partition is empty. Instead

Re: Redis as state store

> > it seems to me that local state stores might prove more performant in the > event of above > mentioned failures of streams application Note, the scenario I was describing with deleting all record from the remote store in event of failure is *not* what we do today -- I was describing a potentia

Re: MirrorMaker 2 and Negative Lag

Hey Alan, I'm running into the same issue as you and I believe I've figured it out. I noticed that consumer partitions on the destination cluster that have a LOG-END-OFFSET=0 all exhibit this issue. It looks like Mirrormaker's offset sync does not work correctly if the partition is empty. Instead

Kafka Streams Processor API state stores not restored via changelog topics

Hi all, Our team think we discovered a bug over the weekend withing the Kafka Streams / Processor API. We are running 2.7.0. When configuring a state store backed by a changelog topic with the cleanup policy configuration set to “compact,delete”: final StoreBuilder> store = Stores .keyValueS

Re: Kafka Connect Distributed Mode Doubt

Thanks for the clarifications, Robin. On Tue, Mar 23, 2021 at 2:51 PM Robin Moffatt wrote: > 1. Kafka Connect standalone workers have their connectors configured based > on properties file(s) passed on the command line at startup. You cannot use > REST to add or remove them > 2. Correct, Standal

Re: Kafka Connect Distributed Mode Doubt

1. Kafka Connect standalone workers have their connectors configured based on properties file(s) passed on the command line at startup. You cannot use REST to add or remove them 2. Correct, Standalone workers are isolated instances that cannot share load with other workers 3. Correct, Distributed w

Odd problem with Kafka, need help to troubleshoot

Hi! First time writing to this list, so excuse me if I am not following some conventions 😉 I am developing software using Kafka since about two years and normally I run the whole setup on my laptop including running Kafka in Docker to be able to test easily and this has been working fine. Now