Re: UnknownProducerIdException every few minutes

Maybe related to https://issues.apache.org/jira/browse/KAFKA-7190 It's fixed in upcoming 2.4 release. -Matthias On 9/25/19 3:08 PM, Alessandro Tagliapietra wrote: > Hello everyone, > > I've another problem unrelated to the previous one so I'm creating another > thread > We've a stream applicat

Re: OutOfOrderSequenceException

An OutOfOrderSequenceException is a severe error indicating potential data loss. It can happen if there was a problem broker side, and data was truncated because of a leader change, even after the data was acknowledged as successfully written to the producer. What is your topic/brokers configs?

Re: Corrupted RocksDB KeyValueStore.get() returns null?

Hard to say. Are you sure you query the correct instance? As you have 16 partitions, you need to ensure that the instance you query actually hosts the key. Or do you have only one instance running? How do you know that there should be a value for the key? Note that everything is async and continu

Re: Is it possible to know the number of producers for a topic?

Not sure what yo ur exact use case is? Exactly once processing? Can you describe the full pipeline ? For what you have described you could use a producer id together with the message. However , your description opens new questions - what do you plan to do in case this happens? Depending on that

Re: Add me to the contributors list...

Hi, Senthil, Thanks for your interest. Just added you to the contributors list and gave you the wiki permissions. Jun On Thu, Oct 10, 2019 at 5:26 PM Senthilnathan Muthusamy wrote: > Hi, > > I am Senthil from Microsoft Azure Compute and will be contributing to the > KIP-280. Can you please add

Add me to the contributors list...

Hi, I am Senthil from Microsoft Azure Compute and will be contributing to the KIP-280. Can you please add me to the contributors list and provide access to the KIP-280, JIRA & the repo. My details: Name: Senthilnathan Muthusamy Username: senthilm-ms Email: senth...@microsoft.com

Is it possible to know the number of producers for a topic?

I have a situation where I should always have exactly one producer per topic, but under certain rare circumstances I can have more than one, and that's really bad when it happens, so I want to detect it. Can I know how many producer a topic has? Can I identify them? Thanks! -Dylan The infor

Records with null value (tombstone) are not removed during compaction

I have created a topic with cleanup.policy set to compact. segment.ms and delete.retention.ms are also configured for the topic. Compaction is happening but records with null value are not removed. But when segment.bytes is configured, records with null value are removed. Please help. Thanks, U

Records will null value (tombstone) not removed during compaction

I have a topic with cleanup.policy set to compact. segment.ms and delete.retention.ms are configured for the topic. Compaction is happening but records with null value are not removed (tombstone). Whereas when segment.bytes is configured for the topic, records with null values are removed. Pleas

Re: Long delay between incoming and outgoing messages using kafka streams

Hi Sophie, Thank you for your response. I tested the proposed setting for CACHE_MAX_BYTES_BUFFERING_CONFIG and it seem to not significantly change the behavior of the application. The latency remains very similar. The documentation states the following regarding CACHE_MAX_BYTES_BUFFERING_CONFIG a

Upgrading from 0.11.0.2 to 2.2.1

Hello, I have a cluster still on 0.11.0.2 that we're planning to upgrade to 2.2.1 eventually (I don't want to upgrade to 2.3.0 just yet). I'm aware of the documentation at https://kafka.apache.org/22/documentation.html#upgrade and I plan to follow each steps. I'm just wondering if folks aroun