The KIP looks good to me. However, if there is willingness in the community to work on metadata request with patterns, the feature proposed here and filtering by '*' or '.*' would be redundant.
Andras On Fri, Jul 13, 2018 at 12:38 AM Jason Gustafson <ja...@confluent.io> wrote: > Hey Manikumar, > > As Kafka begins to scale to larger and larger numbers of topics/partitions, > I'm a little concerned about the scalability of APIs such as this. The API > looks benign, but imagine you have have a few million partitions. We > already expose similar APIs in the producer and consumer, so probably not > much additional harm to expose it in the AdminClient, but it would be nice > to put a little thought into some longer term options. We should be giving > users an efficient way to select a smaller set of the topics they are > interested in. We have always discussed adding some filtering support to > the Metadata API. Perhaps now is a good time to reconsider this? We now > have a convention for wildcard ACLs, so perhaps we can do something > similar. Full regex support might be ideal given the consumer's > subscription API, but that is more challenging. What do you think? > > Thanks, > Jason > > On Thu, Jul 12, 2018 at 2:35 PM, Harsha <ka...@harsha.io> wrote: > > > Very useful. LGTM. > > > > Thanks, > > Harsha > > > > On Thu, Jul 12, 2018, at 9:56 AM, Manikumar wrote: > > > Hi all, > > > > > > I have created a KIP to add describe all topics API to AdminClient . > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > 327%3A+Add+describe+all+topics+API+to+AdminClient > > > > > > Please take a look. > > > > > > Thanks, > > >
