Re: Using Kafka AdminUtils

2020-02-17 Thread Israel Ekpo
Take a look at the new AdminClient or KafkaAdminClient classes https://kafka.apache.org/24/javadoc/org/apache/kafka/clients/admin/KafkaAdminClient.html https://kafka.apache.org/24/javadoc/org/apache/kafka/clients/admin/AdminClient.html You can describe the topic or topics in question and it shoul

Re: Using Kafka AdminUtils

2020-02-16 Thread John Roesler
Hi Victoria, Sorry for the vagueness, I’m not in front of a computer right now, so I can only answer from memory. I’m not sure why that interface is still tagged “evolving”. Any changes to it would go through a deprecation period, just like any public interface in Kafka. We should probably re

Re: Using Kafka AdminUtils

2020-02-16 Thread Victoria Zuberman
Hi, John Thanks a lot for valuable information. I looked at KafkaAdminClient and I see that it offers createTopics method that indeed seems suitable. I still have a couple of questions: 1. In the documentation it is not mentioned what is the expected behavior if the specified topic already exi

Re: Using Kafka AdminUtils

2020-02-16 Thread John Roesler
Hi Victoria, I’ve used the AdminClient for this kind of thing before. It’s the official java client for administrative actions like creating topics. You can create topics with any partition count, replication, or any other config. I hope this helps, John On Sat, Feb 15, 2020, at 22:41, Victor

Using Kafka AdminUtils

2020-02-15 Thread Victoria Zuberman
Hi, I have an application based on Kafka Streams. It reads from Kafka topic (I call this topic “input topic”). That topic has many partitions and their number varies based on the env in which application is running. I don’t want to create different input topics manually. Configuration of auto.cre