Hi, Bo, I embedded my answers in-between:
On Sun, May 8, 2016 at 9:00 PM, Liu Bo <diabl...@gmail.com> wrote: > The other thing is log retention is set to 24 hour or 30GB. But seems not > working for checkpoint topic. As all the *.log file are there unlike the > data topic which only has recent ones. > > When your topic cleanup policy is set to log compact, the time-retention policy will not be effective again. Hence, the reduction of checkpoint topic size purely depends on the log compaction on the Kafka broker. > I am going to dig further on this (never config compaction before), and > your suggestions would be grateful. > > It would be good to check whether your log compact thread on the Kafka broker works in a healthy mode, and how often it is triggered. > > > -- > All the best > > Liu Bo >