Uneven distribution of messages in topic's partitions

Hello All I have a single producer service which is queuing message into a topic with let say 12 partitions. I want to evenly distribute the messages across all the partitions in a round robin fashion. Even after using default partitioning and keeping key 'NULL', the messages are not getting distr

kafka log compaction

Hi All I want some of my topics to retain data forever without any deletion since those topics hold static data that is always required by application. Also, for these topic I want to retain latest value for key. I believe the cleanup policy of 'compact' would meet my needs. I have following quest

Re: Kafka partitions replication issue

> On Jun 17, 2020, at 5:16 AM, Karnam, Sudheer wrote: > > Team, > We are using kafka version 2.3.0 and we are facing issue with brokers > replication > > 1.Kafka has 6 brokers. > 2.Mainly 7 topics exist in kafka cluster and each topic has 12

Re: NPE in kafka-streams with Avro input

Hi Dumitru, According to the stack trace that you've shared the NPE is being thrown by this framework called *Avro4S* that you're using. This is important to isolate the problem because it means that it is not Kafka Streams the problem but rather, your serialization framework. Nevertheless,

NPE in kafka-streams with Avro input

Hello kafka community, When the following kafka-streams starts with input topic values in avro format, we get this NPE below. The input is a record and a field of it is an array of other records. Reading the stack trace below what I understand is that at some point in deserializing a value structur

Re: Kafka partitions replication issue

Karnam, I think the combination of the setting preferred leader and auto leader rebalance enable along with the hardware issue in broker-3 might be giving you the opposite effect that you are expecting. If the broker-3 happens to be the preferred leader for a given partition (because it happe

Kafka partitions replication issue

Team, We are using kafka version 2.3.0 and we are facing issue with brokers replication 1.Kafka has 6 brokers. 2.Mainly 7 topics exist in kafka cluster and each topic has 128 partitions. 3.Each partition has 3 in-sync-replicas and these are dist