Kafka Size of ISR Set(3) insufficient for min.isr 2

Hi all, I have a strange Kafka Server error when mirroring data with the MirrorMaker 1 in Apache Kafka 2.6. |org.apache.kafka.common.errors.NotEnoughReplicasException: The size of the current ISR Set(3) is insufficient to satisfy the min.isr re

Load balance Kafka record consumption when using topic pattern

Hi all, I habe a question: If two KafkaConsumer which uses the same consumer group (group.id) subscribe to the same topicPattern - will Kafka than load balance the resolved topics (! - not only partitions) between the two processes? In my case about 400 topics match the pattern and each topic h

Aw: Load balance Kafka record consumption when using topic pattern

act I have a MirrorMaker Job with this configuration which worked as expected. So does my application now ;-) Best regards, Franz   Gesendet: Mittwoch, 27. Februar 2019 um 10:54 Uhr Von: "Franz van Betteraey" An: users@kafka.apache.org Betreff: Load balance Kafka record consumpti

Kafka Mirror Maker place of execution

Hi all, there are best practices out there which recommend to run the Mirror Maker on the target cluster. https://community.hortonworks.com/articles/79891/kafka-mirror-maker-best-practices.html I wonder why this recommendation exists because ultimately all data must cross the border between the

Aw: Re: Kafka Mirror Maker place of execution

ch reduces throughput. I recommend running MM near the target cluster but not necessarily on the same machines, because often Kafka nodes are relatively expensive, with SSD arrays and huge IO bandwidth etc, which isn't necessary for MM. Ryanne On Tue, Mar 12, 2019, 8:13 AM Franz van Betteraey wrote:

Aw: Re: Kafka Mirror Maker place of execution

ghput. > > I recommend running MM near the target cluster but not necessarily on the > same machines, because often Kafka nodes are relatively expensive, with SSD > arrays and huge IO bandwidth etc, which isn't necessary for MM. > > Ryanne > > On Tue, Mar 12, 2019, 8:13

Re: Question about kafka log retention

Hello Xiaochi , I am not sure if I have understood the problem correctly but beware the fact that only old log segments and not the current log segment are taken into account for deletions. So if you want the data to be deleted in a timely manner, you also need to configure a tighter interval