By the way, is there a bug that was fixed in the later release.
https://issues.apache.org/jira/browse/KAFKA-6030
Can you please confirm ?
On Tue, Feb 6, 2018 at 1:38 PM, Ted Yu <yuzhih...@gmail.com> wrote:
> The log cleaner abortion in the log file preceded log deletion.
>
> On Tue, Feb 6, 2018 at 1:36 PM, Raghav <raghavas...@gmail.com> wrote:
>
> > Ted
> >
> > Sorry, I did not understand your point here.
> >
> > On Tue, Feb 6, 2018 at 1:09 PM, Ted Yu <yuzhih...@gmail.com> wrote:
> >
> > > bq. but is aborted.
> > >
> > > See the following in LogManager#asyncDelete():
> > >
> > > //We need to wait until there is no more cleaning task on the log
> > to
> > > be deleted before actually deleting it.
> > >
> > > if (cleaner != null && !isFuture) {
> > >
> > > cleaner.abortCleaning(topicPartition)
> > >
> > > FYI
> > >
> > > On Tue, Feb 6, 2018 at 12:56 PM, Raghav <raghavas...@gmail.com> wrote:
> > >
> > > > From the log-cleaner.log, I see the following. It seems like it
> resume
> > > but
> > > > is aborted. Not sure how to read this:
> > > >
> > > >
> > > > [2018-02-06 18:06:22,178] INFO Compaction for partition topic043-27
> is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,178] INFO The cleaning for partition topic043-27
> > is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,182] INFO The cleaning for partition topic043-51
> > is
> > > > aborted and paused (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,182] INFO Compaction for partition topic043-51
> is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,182] INFO The cleaning for partition topic043-51
> > is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,190] INFO The cleaning for partition topic043-52
> > is
> > > > aborted and paused (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,190] INFO Compaction for partition topic043-52
> is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,190] INFO The cleaning for partition topic043-52
> > is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,192] INFO The cleaning for partition topic043-45
> > is
> > > > aborted and paused (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,192] INFO Compaction for partition topic043-45
> is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,192] INFO The cleaning for partition topic043-45
> > is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,198] INFO The cleaning for partition topic043-20
> > is
> > > > aborted and paused (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,198] INFO Compaction for partition topic043-20
> is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,198] INFO The cleaning for partition topic043-20
> > is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,204] INFO The cleaning for partition topic043-63
> > is
> > > > aborted and paused (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,204] INFO Compaction for partition topic043-63
> is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,204] INFO The cleaning for partition topic043-63
> > is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,209] INFO The cleaning for partition topic043-44
> > is
> > > > aborted and paused (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,209] INFO Compaction for partition topic043-44
> is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,209] INFO The cleaning for partition topic043-44
> > is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,214] INFO The cleaning for partition topic043-38
> > is
> > > > aborted and paused (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,214] INFO Compaction for partition topic043-38
> is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,214] INFO The cleaning for partition topic043-38
> > is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,219] INFO The cleaning for partition topic043-50
> > is
> > > > aborted and paused (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,219] INFO Compaction for partition topic043-50
> is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,219] INFO The cleaning for partition topic043-50
> > is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,224] INFO The cleaning for partition topic043-2
> is
> > > > aborted and paused (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,224] INFO Compaction for partition topic043-2 is
> > > > resumed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:22,224] INFO The cleaning for partition topic043-2
> is
> > > > aborted (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:54,643] INFO Shutting down the log cleaner.
> > > > (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:54,643] INFO [kafka-log-cleaner-thread-0], Shutting
> > > down
> > > > (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:54,644] INFO [kafka-log-cleaner-thread-0], Shutdown
> > > > completed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:54,644] INFO [kafka-log-cleaner-thread-0], Stopped
> > > > (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:57,663] INFO Starting the log cleaner
> > > > (kafka.log.LogCleaner)
> > > > [2018-02-06 18:06:57,665] INFO [kafka-log-cleaner-thread-0], Starting
> > > > (kafka.log.LogCleaner)
> > > > [2018-02-06 18:08:07,187] INFO Shutting down the log cleaner.
> > > > (kafka.log.LogCleaner)
> > > > [2018-02-06 18:08:07,187] INFO [kafka-log-cleaner-thread-0], Shutting
> > > down
> > > > (kafka.log.LogCleaner)
> > > > [2018-02-06 18:08:07,187] INFO [kafka-log-cleaner-thread-0], Stopped
> > > > (kafka.log.LogCleaner)
> > > > [2018-02-06 18:08:07,187] INFO [kafka-log-cleaner-thread-0], Shutdown
> > > > completed (kafka.log.LogCleaner)
> > > > [2018-02-06 18:08:11,701] INFO Starting the log cleaner
> > > > (kafka.log.LogCleaner)
> > > > [2018-02-06 18:08:11,703] INFO [kafka-log-cleaner-thread-0], Starting
> > > > (kafka.log.LogCleaner)
> > > >
> > >
> >
> >
> >
> > --
> > Raghav
> >
>
--
Raghav
