Re: Streams/RocksDB: Why Universal Compaction?

2023-07-27 Thread Guozhang Wang
Thanks Colt! For a library's default configs, I think the principle would be "it runs appropriately out of the box for the first time you played with it", so I'm not suggesting we should try to make sure it is a generally good combination for a wide range of production usage since in that case

Re: Consuming an entire partition with control messages

2023-07-27 Thread Matthias J. Sax
Well, `kafka-consumer-group.sh` can only display the difference between "committed offset" and "end offset". It cannot know what the "right" offset to be committed is. It's really the responsibility of the consumers to commit correctly. -Matthias On 7/27/23 1:03 AM, Vincent Maurin wrote:

Re: Consuming an entire partition with control messages

2023-07-27 Thread Vincent Maurin
Thank you Matthias for your answer, I open an issue on the aiokafka project as follow up, let's see how we can resolve it there https://github.com/aio-libs/aiokafka/issues/911 As mentioned in the issue, some tools like kafka-consumer-groups.sh also display a lag of "1" in this kind of