We have changed the __consumer_offsets topic policy to "delete" from
"compact" and it is working as expected for us. The segments older than
segment.ms are purged like it happens for a normal topic. Offsets fetch and
commit also worked fine. Thanks
On Tue, Mar 8, 2016 at 12:59 PM, Achanta Vamsi
Thanks for the reply Jason.
Our topics global retention is for 4 days and as we are planning to set the
__consumer_offsets retention to the same interval, in the worst case, we
won't loose any message offsets as the data will anyways be rotated.
Reg. the problems with log cleaner:
1. I enabled
This is actually a really good question. If you change the retention policy
of the offsets topic, then in the worst case, consumer groups could lose
their last committed positions and fall back to the auto reset behavior.
However, if your consumers are not down for a long time and you set the
Hi,
We tested this on our stage environment and works fine if we change the
policy to delete from compact. Will there be any side effects if we change
it to delete for the __consumer_offsets topic?
On Wed, Mar 2, 2016 at 4:43 PM, Achanta Vamsi Subhash <
achanta.va...@flipkart.com> wrote:
> Hi
Hi all,
We have a __consumer_offsets topic has cleanup.policy=compact and
log.cleaner.enable=false. What would happen if we change the cleanup.policy
to delete? Will that treat the offsets topic as same as any other topic?
We currently have a setup without log.cleaner.enable=false and we have
