Re: Offsets getting lost if no messages sent for a long time

I don't know the answer to the second question, if you don't use (much) auto-generated id's for the consumer group you should be ok, since it's a compacted topic after all, you might want to check if the compaction is on. We set the offsets.retention.minutes to a week without a problem. On Tue,

Re: Offsets getting lost if no messages sent for a long time

Might be easier to handle duplicate messages as opposed to handling long periods of time without messages. Michael > On 22 Aug 2016, at 15:55, Misra, Rahul wrote: > > Hi, > > Can anybody provide any guidance on the following: > > 1. Given a limited set of groups

RE: Offsets getting lost if no messages sent for a long time

Hi, Can anybody provide any guidance on the following: 1. Given a limited set of groups and consumers, will increasing 'offsets.retention.minutes' to a high value (say 30 days) cause the __consumer_offsets topic to bloat unnecessarily or will compaction ensure that the entries for each key

Re: Offsets getting lost if no messages sent for a long time

Since nothing was written to the __consumer_offsets topic for more than its configured retention period (offsets.retention.minutes, by default 1440 minutes, or one day), the offset info will be removed. Retention period is all about when the last offset was written, not the last time a Consumer