Re: _consumer_offsets is becoming rather big. How to purge?

2019-09-12 Thread Ash G
Thanks Colin, that is the reason. On 2019/09/11 17:16:46, "Colin McCabe" wrote: > Hi Ash, > > At first guess, you probably had a problem with your log cleaner thread, > which resulted in the offsets log not being cleaned. Check if that thread is > running. > > best, > Colin > > On Wed,

Re: _consumer_offsets is becoming rather big. How to purge?

2019-09-11 Thread Colin McCabe
Hi Ash, At first guess, you probably had a problem with your log cleaner thread, which resulted in the offsets log not being cleaned. Check if that thread is running. best, Colin On Wed, Sep 11, 2019, at 09:52, Ash G wrote: > Bump, no reply, > > It seems this condition was missed by devs

Re: _consumer_offsets is becoming rather big. How to purge?

2019-09-11 Thread Ash G
Bump, no reply, It seems this condition was missed by devs when this feature was designed and implemented. On 2019/09/06 14:45:47, Ash G wrote: > > _consumer_offsets is becoming rather big > 1 TB. Is there a way to purge > dead/inactive consumer id rows from it? > I am assuming

_consumer_offsets is becoming rather big. How to purge?

2019-09-06 Thread Ash G
_consumer_offsets is becoming rather big > 1 TB. Is there a way to purge dead/inactive consumer id rows from it? I am assuming dead/inactive consumer id rows is the reason. could there be another reason? [reposting from user list]