Hi Avinash,
This is working as expected. Since delete topics is not enabled, they get
marked for deletion, but never get deleted. Once you enable topic
deletion (delete.topic.enable=true)
the topics marked get delete.
Once the topic is marked for deletion messages will still be available. It
is when the topic is actually deleted that messages can no longer be
consumed. However, in order for a topic to be safely deleted all
producers/consumers of that topic should be stopped. Not stopping the
clients can cause weird behavior especially when auto topic creation is
enabled.
Thank you,
Grant
On Tue, Nov 3, 2015 at 3:15 PM, Kumar, Avinash wrote:
> Hi,
>
> I am trying to delete the kafka topic, verison I am using is 2.9.2-0.8.2.
> I am using dockerized kafka to delete the topic already created and didn’t
> set the “delete.topic.enable=true”. When I am listing the topics, it is
> giving as “ marked for deletion”.
>
> Is this a bug? However when I am setting “delete.topic.enable=true” as
> true, it gets deleted immediately. Apart from this I have one more
> question, once the topic is marked for deletion; will messages be still
> available for consumer?
>
> I do see regular updated in controller update with
>
> [2015-11-03 21:05:57,753] TRACE [Controller 1]: checking need to trigger
> partition rebalance (kafka.controller.KafkaController)
>
> [2015-11-03 21:05:57,754] DEBUG [Controller 1]: preferred replicas by
> broker Map(1 -> Map([abcdefghApp,0] -> List(1), [abcdefgApp,0] -> List(1),
> [abcdefApp,0] -> List(1), [adbceApp,0] -> List(1), [abcdApp,0] -> List(1),
> [abcApp,0] -> List(1), [abApp,0] -> List(1), [aApp,0] -> List(1)))
> (kafka.controller.KafkaController)
>
> [2015-11-03 21:05:57,754] DEBUG [Controller 1]: topics not in preferred
> replica Map() (kafka.controller.KafkaController)
>
> [2015-11-03 21:05:57,754] TRACE [Controller 1]: leader imbalance ratio for
> broker 1 is 0.00 (kafka.controller.KafkaController)
>
> Out of these aApp,abApp and abcApp topics has been marked for deletion.
>
> Thanks,
> Avinash
>
>
> The information contained in this e-mail is confidential and/or
> proprietary to Capital One and/or its affiliates and may only be used
> solely in performance of work or services for Capital One. The information
> transmitted herewith is intended only for use by the individual or entity
> to which it is addressed. If the reader of this message is not the intended
> recipient, you are hereby notified that any review, retransmission,
> dissemination, distribution, copying or other use of, or taking of any
> action in reliance upon this information is strictly prohibited. If you
> have received this communication in error, please contact the sender and
> delete the material from your computer.
>
--
Grant Henke
Software Engineer | Cloudera
gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke
