Re: Create Kafka Topic Programatically

2016-01-20 Thread Tommy Becker
Awesome, glad to see that's being worked on! On 01/20/2016 12:39 PM, Joel Koshy wrote: https://issues.apache.org/jira/browse/KAFKA-2945 and related jiras is probably what you are looking for. That is planned for the next release. On Wed, Jan 20, 2016 at 8:41 AM, Tommy Becker

Re: Create Kafka Topic Programatically

2016-01-20 Thread Joel Koshy
https://issues.apache.org/jira/browse/KAFKA-2945 and related jiras is probably what you are looking for. That is planned for the next release. On Wed, Jan 20, 2016 at 8:41 AM, Tommy Becker wrote: > This works, but it's clumsy and has limitations. Unfortunately, I'm not > aware of any alternative

Re: Create Kafka Topic Programatically

2016-01-20 Thread Tommy Becker
This works, but it's clumsy and has limitations. Unfortunately, I'm not aware of any alternatives. We do some programmatic topic creation when we want to create a topic with a non-default configuration. But specifying the configuration is an all or nothing affair. For example, there's no way to

Re: Create Kafka Topic Programatically

2016-01-20 Thread Timo Ahokas
Hi Joe, We're doing a similar thing that you're looking for with some of our app nodes. We use the kafka.admin.AdminTools and its topicExists()/createTopic() methods. Some additional code (e.g. Kafka context check/creation) might be needed for dev/test environments if you're using a specific Kafka

Re: Create Kafka Topic Programatically

2016-01-20 Thread Damian Guy
Hi, I believe it is a broker property. It will create the topic with the name you provide. The topic will not get deleted unless you manually delete it. It wont get re-created on subsequent calls (unless you've deleted it) HTH, Damian On 20 January 2016 at 13:14, Joe San wrote: > I doubt that

Re: Create Kafka Topic Programatically

2016-01-20 Thread Joe San
I doubt that might be enough. Could you tell me if the auto.create.topics.enable satisfies the following requirement? 1. I want to create a topic with a specific name 2. If I restart the producer client, if the topic with that name already exists, it should do nothing and use the topic as is 3. Up

Re: Create Kafka Topic Programatically

2016-01-20 Thread Franco Giacosa
Hi Joe, There is an option in the producer called auto.create.topics.enable, so the producer can just start sending data to a topic and the topic will be created with the default values. 2016-01-20 13:19 GMT+01:00 Joe San : > Kafka Users, > > How can I create a kafka topic programatically? > >

Create Kafka Topic Programatically

2016-01-20 Thread Joe San
Kafka Users, How can I create a kafka topic programatically? I would like to create the topics when I initialize my application. It should also be in such a way that if the topic already exists, the initialization code should do nothing! Thanks and Regards, Joe