Re: AW: Configuration of log compaction

2019-04-29 Thread Ethan Stein
I received the same error as well. Were any of you able to fix this issue? On 2018/12/18 09:42:58, Claudia Wegmann wrote: > Hi Liam,> > > > > thanks for the pointer. I found out, that the log cleaner on all kafka > brokers died with the following error message:> > > > > [2018-12-04

AW: Configuration of log compaction

2019-02-28 Thread Claudia Wegmann
etreff: AW: Configuration of log compaction Hi Liam, My brokers are running in version 2.0.0 Restarting was not a problem, it just seemed "a lot" for just restarting the log cleaner. I will think about piping the logs of the log cleaner to elk. And I will definitely keep an eye on the logs to see

AW: Configuration of log compaction

2018-12-18 Thread Claudia Wegmann
Hi Liam, My brokers are running in version 2.0.0 Restarting was not a problem, it just seemed "a lot" for just restarting the log cleaner. I will think about piping the logs of the log cleaner to elk. And I will definitely keep an eye on the logs to see if the error occurs again. Thanks

AW: Configuration of log compaction

2018-12-18 Thread Claudia Wegmann
Hi Liam, thanks for the pointer. I found out, that the log cleaner on all kafka brokers died with the following error message: [2018-12-04 15:33:24,886] INFO Cleaner 0: Caught segment overflow error during cleaning: Detected offset overflow at offset -1 in segment

AW: Configuration of log compaction

2018-12-17 Thread Claudia Wegmann
Hi, thanks for the quick response. My problem is not, that no new segments are created, but that segments with old data do not get compacted. I had to restart one broker because there was no diskspace left. After recreating all indexes etc. the broker recognized the old data and compacted it