Thanks Manoj. It makes sense to use Consumer itself for fetching meta data.
On Wed, May 6, 2020 at 12:39 AM <manoj.agraw...@cognizant.com> wrote: > > > > > Glade , it work for you . > > > > Kafka Admin API run on zookeeper and sometime you don’t have access to > Zookeeper host /port . I don’t know in your scenario how you are managing > kafka/Zk cluster but for security purpose , Zookeeper access only limited > to kafka Cluster . > > > > > > *From: *SenthilKumar K <senthilec...@gmail.com> > *Date: *Tuesday, May 5, 2020 at 12:06 PM > *To: *"Agrawal, Manoj (Cognizant)" <manoj.agraw...@cognizant.com>, > Senthil kumar <senthilec...@gmail.com> > *Cc: *"users@kafka.apache.org" <users@kafka.apache.org>, " > senthilec...@apache.org" <senthilec...@apache.org> > *Subject: *Re: KafkaConsumer.partitionsFor() Vs > KafkaAdminClient.describeTopics() > > > > *[External]* > > Thanks Manoj. It works for me. > > > > Looks to me the KafkaAdminClient (Singleton instance ) is faster than > Consumer.partitionsFor() API. In terms of performance which one is good to > fetch the metadata of a given topic. Thanks! > > > > On Wed, May 6, 2020 at 12:26 AM <manoj.agraw...@cognizant.com> wrote: > > I think you can filter list of topic return by > KafkaConsumer.partitionsFor() on by using method type , if this is > PartitionInfo.leader() then include those partition in list . > > > > On 5/5/20, 11:44 AM, "SenthilKumar K" <senthilec...@gmail.com> wrote: > > [External] > > > Hi Team, We are using KafkaConsumer.partitionsFor() API to find the > list of > available partitions. After fetching the list of partitions, We use > Consumer.offsetsForTimes() API to find the offsets for a given > timestamp. > > The API Consumer.partitionsFor() simply returning all partitions > including > the partitions which the leader is set to -1. It's causing an issue > (Timeout Exception) when we call Consumer.offsetsForTimes() API. > > I'm planning to use adminClient.describeTopics(list).all().get(); And > filter only the partitions which are healthy. Will there be any > performance > impact of using AdminClient? > > Kafka Version: 2.4.1 > Kafka Client: 2.3.0 > > --Senthil > > > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and > from Cognizant e-mail addresses may be monitored. > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and > from Cognizant e-mail addresses may be monitored. > > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and > from Cognizant e-mail addresses may be monitored. This e-mail and any files > transmitted with it are for the sole use of the intended recipient(s) and > may contain confidential and privileged information. If you are not the > intended recipient(s), please reply to the sender and destroy all copies of > the original message. Any unauthorized review, use, disclosure, > dissemination, forwarding, printing or copying of this email, and/or any > action taken in reliance on the contents of this e-mail is strictly > prohibited and may be unlawful. Where permitted by applicable law, this > e-mail and other e-mail communications sent to and from Cognizant e-mail > addresses may be monitored. >
