Re: Splitting partition may cause message loss for consumers

2021-02-18 Thread Haruki Okada
Thanks for your quick response. Yeah, agree with that. (also replied on the issue) 2021年2月19日(金) 16:25 Luke Chen : > Hi Okada san, > Yes, I agree the "latest" setting in this situation is not good, and we > should document it. > But I don't think we should change the default auto.offset.reset set

Re: Splitting partition may cause message loss for consumers

2021-02-18 Thread Luke Chen
Hi Okada san, Yes, I agree the "latest" setting in this situation is not good, and we should document it. But I don't think we should change the default auto.offset.reset setting to the earliest. The auto.offset.reset setting starts before kafka V1.0, which means, there are already a lot of users u

Splitting partition may cause message loss for consumers

2021-02-18 Thread Haruki Okada
Hi, Kafka. Recently I noticed that splitting partition may cause message delivery loss for consumers with auto.offset.reset=latest. I described details in https://issues.apache.org/jira/browse/KAFKA-12261 . Since delivery loss is undesired in most cases, I think this should be described in Consu