There is not upper limit. And yes, you are right about rebalancing. This would be an issue and yes, you can use the rebalance listener to address it (it's the purpose of the rebalance listener to be used for cases like this).
-Matthias On 10/16/18 2:19 PM, pradeep s wrote: > Hi, > I have a usecase to stream messages from Kafka and buffer it in memory till > a message count is reached and then write these to output file . I am using > manual commit . I have a question on whats the maximum time i can wait > after consuming the message and till we commit back to Kafka . Is there a > upper limit for this ? Is consumer rebalance the only issue while waiting > long periods, then can i write the contents using a rebalance listener and > commit at that point . > Thanks > Pradeep >
signature.asc
Description: OpenPGP digital signature