[ 
https://issues.apache.org/jira/browse/KAFKA-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089686#comment-15089686
 ] 

Mayuresh Gharat commented on KAFKA-2410:
----------------------------------------

I would like to bump up discussion on this. 
The way I understand this is that we have 2 points :

1) Have a config on the producer and consumer.
   a) TMR is disabled on the broker side.
   b) Producer and consumer have this config set to TRUE.
  c) The producer does the send(), it issues a TMR and finds that the topic 
does not exist. It will check this config and issue a createTopicRequest. When 
the createTopicRequest returns  success, it will start producing the actual 
data.
  d) Same goes for Consumer, if the topic does not exist, consumer will create 
it if the config is enabled. This is not a hard requirement on the consumer 
side.

2) No config and the topic creation is left to user explicitly.

The problem with 2) is that, if we have mirror makers running, we have to do 
the topic creation in producer, in some sort of callback may be, but it would 
be better to go with 1) in this scenario.

+ Joel [~jjkoshy] 



> Implement "Auto Topic Creation" client side and remove support from Broker 
> side
> -------------------------------------------------------------------------------
>
>                 Key: KAFKA-2410
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2410
>             Project: Kafka
>          Issue Type: Improvement
>          Components: clients, core
>    Affects Versions: 0.8.2.1
>            Reporter: Grant Henke
>            Assignee: Grant Henke
>
> Auto topic creation on the broker has caused pain in the past; And today it 
> still causes unusual error handling requirements on the client side, added 
> complexity in the broker, mixed responsibility of the TopicMetadataRequest, 
> and limits configuration of the option to be cluster wide. In the future 
> having it broker side will also make features such as authorization very 
> difficult. 
> There have been discussions in the past of implementing this feature client 
> side. 
> [example|https://issues.apache.org/jira/browse/KAFKA-689?focusedCommentId=13548746&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13548746]
> This Jira is to track that discussion and implementation once the necessary 
> protocol support exists: KAFKA-2229



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to