> > > > > > >
> > > > > > > > >
> > > > > > > > > On Fri, Jul 13, 2018 at 12:38 AM Jason Gustafson
> > > > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hey Manikumar,
> > > > > > > > > >
> > > > > > > > > > As Kafka begins to scale to larger and larger numbers of
> > > > > > > > topics/partitions,
> > > > > > > > > > I'm a little concerned about the scalability of APIs such
> > as
> > > > > > > > > > this. The> > API
> > > > > > > > > > looks benign, but imagine you have have a few million
> > > > > > > > > > partitions. We> > > > already expose similar APIs in the
> > > > producer
> > > > > > and consumer, so
> > > > > > > > > > probably> > not
> > > > > > > > > > much additional harm to expose it in the AdminClient, but
> > it
> > > > > > > > > > would be> > nice
> > > > > > > > > > to put a little thought into some longer term options. We
> > > > should
> > > > > > > > > > be> > giving
> > > > > > > > > > users an efficient way to select a smaller set of the
> > topics
> > > > > > > > > > they are> > > > interested in. We have always discussed
> > adding
> > > > > > some filtering
> > > > > > > > > > support> > to
> > > > > > > > > > the Metadata API. Perhaps now is a good time to reconsider
> > > > this?
> > > > > > > > > > We now> > > > have a convention for wildcard ACLs, so
> > perhaps
> > > > we
> > > > > > can do
> > > > > > > > > > something> > > > similar. Full regex support might be ideal
> > > > given
> > > > > > the consumer's> > > > subscription API, but that is more
> > challenging.
> > > > > What
> > > > > > do you
> > > > > > > > > > think?> > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Jason
> > > > > > > > > >
> > > > > > > > > > On Thu, Jul 12, 2018 at 2:35 PM, Harsha
> > > > > wrote:>
> > > > > > > > >
> > > > > > > > > > > Very useful. LGTM.
> > > > > > > > > > >
> > > > > > > > > > > Thanks,
> > > > > > > > > > > Harsha
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Jul 12, 2018, at 9:56 AM, Manikumar wrote:
> > > > > > > > > > > > Hi all,
> > > > > > > > > > > >
> > > > > > > > > > > > I have created a KIP to add describe all topics API to
> > > > > > > > > > > > AdminClient> > .
> > > > > > > > > > > >
> > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > > > > > > > > 327%3A+Add+describe+all+topics+API+to+AdminClient
> > > > > > > > > > > >
> > > > > > > > > > > > Please take a look.
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> >
fson
> > > > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hey Manikumar,
> > > > > > > > >
> > > > > > > > > As Kafka begins to scale to larger and larger numbers of
d larger numbers of
> > > > > > topics/partitions,
> > > > > > > > I'm a little concerned about the scalability of APIs such as
> > > > > > > > this. The> > API
> > > > > > > > looks benign, but imagine
AdminClient, but it
> > > > > > would be> > nice
> > > > > > to put a little thought into some longer term options. We should
> > > > > > be> > giving
> > > > > > users an efficient way
t; producer
> > > and consumer, so
> > > > > > > probably> > not
> > > > > > > much additional harm to expose it in the AdminClient, but it
> > > > > > > would be> > nice
> > > > > > > to put a little thought into some longer term options. We
> should
> > > > > > > be> > giving
> > > > > > > users an efficient way to select a smaller set of the topics
> > > > > > > they are> > > > interested in. We have always discussed adding
> > > some filtering
> > > > > > > support> > to
> > > > > > > the Metadata API. Perhaps now is a good time to reconsider
> this?
> > > > > > > We now> > > > have a convention for wildcard ACLs, so perhaps
> we
> > > can do
> > > > > > > something> > > > similar. Full regex support might be ideal
> given
> > > the consumer's> > > > subscription API, but that is more challenging.
> > What
> > > do you
> > > > > > > think?> > > >
> > > > > > > Thanks,
> > > > > > > Jason
> > > > > > >
> > > > > > > On Thu, Jul 12, 2018 at 2:35 PM, Harsha
> > wrote:>
> > > > > >
> > > > > > > > Very useful. LGTM.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Harsha
> > > > > > > >
> > > > > > > > On Thu, Jul 12, 2018, at 9:56 AM, Manikumar wrote:
> > > > > > > > > Hi all,
> > > > > > > > >
> > > > > > > > > I have created a KIP to add describe all topics API to
> > > > > > > > > AdminClient> > .
> > > > > > > > >
> > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > > > > > 327%3A+Add+describe+all+topics+API+to+AdminClient
> > > > > > > > >
> > > > > > > > > Please take a look.
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > >
> > > > > > >
> > > > >
> > >
> > >
> >
>
gt; > > > > would be> > nice
> > > > > > to put a little thought into some longer term options. We should
> > > > > > be> > giving
> > > > > > users an efficient way to select a smaller set of the topics
> > > > > > they are> > > > interested in. We have always discussed adding
> > some filtering
> > > > > > support> > to
> > > > > > the Metadata API. Perhaps now is a good time to reconsider this?
> > > > > > We now> > > > have a convention for wildcard ACLs, so perhaps we
> > can do
> > > > > > something> > > > similar. Full regex support might be ideal given
> > the consumer's> > > > subscription API, but that is more challenging.
> What
> > do you
> > > > > > think?> > > >
> > > > > > Thanks,
> > > > > > Jason
> > > > > >
> > > > > > On Thu, Jul 12, 2018 at 2:35 PM, Harsha
> wrote:>
> > > > >
> > > > > > > Very useful. LGTM.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Harsha
> > > > > > >
> > > > > > > On Thu, Jul 12, 2018, at 9:56 AM, Manikumar wrote:
> > > > > > > > Hi all,
> > > > > > > >
> > > > > > > > I have created a KIP to add describe all topics API to
> > > > > > > > AdminClient> > .
> > > > > > > >
> > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > > > > 327%3A+Add+describe+all+topics+API+to+AdminClient
> > > > > > > >
> > > > > > > > Please take a look.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > >
> > > > > >
> > > >
> >
> >
>
; interested in. We have always discussed adding
> some filtering
> > > > > support> > to
> > > > > the Metadata API. Perhaps now is a good time to reconsider this?
> > > > > We now> > > > have a convention for wildcard ACLs, so perhaps we
> can do
> > > > > something> > > > similar. Full regex support might be ideal given
> the consumer's> > > > subscription API, but that is more challenging. What
> do you
> > > > > think?> > > >
> > > > > Thanks,
> > > > > Jason
> > > > >
> > > > > On Thu, Jul 12, 2018 at 2:35 PM, Harsha wrote:>
> > > >
> > > > > > Very useful. LGTM.
> > > > > >
> > > > > > Thanks,
> > > > > > Harsha
> > > > > >
> > > > > > On Thu, Jul 12, 2018, at 9:56 AM, Manikumar wrote:
> > > > > > > Hi all,
> > > > > > >
> > > > > > > I have created a KIP to add describe all topics API to
> > > > > > > AdminClient> > .
> > > > > > >
> > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > > > 327%3A+Add+describe+all+topics+API+to+AdminClient
> > > > > > >
> > > > > > > Please take a look.
> > > > > > >
> > > > > > > Thanks,
> > > > > >
> > > > >
> > >
>
>
t> > to
> > > > the Metadata API. Perhaps now is a good time to reconsider this?
> > > > We now> > > > have a convention for wildcard ACLs, so perhaps we can do
> > > > something> > > > similar. Full regex support might be ideal given the
> > > > consumer's> > > > subscription API, but that is more challenging. What
> > > > do you
> > > > think?> > > >
> > > > Thanks,
> > > > Jason
> > > >
> > > > On Thu, Jul 12, 2018 at 2:35 PM, Harsha wrote:> > > >
> > > > > Very useful. LGTM.
> > > > >
> > > > > Thanks,
> > > > > Harsha
> > > > >
> > > > > On Thu, Jul 12, 2018, at 9:56 AM, Manikumar wrote:
> > > > > > Hi all,
> > > > > >
> > > > > > I have created a KIP to add describe all topics API to
> > > > > > AdminClient> > .
> > > > > >
> > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > > 327%3A+Add+describe+all+topics+API+to+AdminClient
> > > > > >
> > > > > > Please take a look.
> > > > > >
> > > > > > Thanks,
> > > > >
> > > >
> >
t; > Thanks,
> > > Jason
> > >
> > > On Thu, Jul 12, 2018 at 2:35 PM, Harsha wrote:
> > >
> > > > Very useful. LGTM.
> > > >
> > > > Thanks,
> > > > Harsha
> > > >
> > > > On Thu, Jul 12, 2018, at 9:56 AM, Manikumar wrote:
> > > > > Hi all,
> > > > >
> > > > > I have created a KIP to add describe all topics API to AdminClient
> .
> > > > >
> > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > 327%3A+Add+describe+all+topics+API+to+AdminClient
> > > > >
> > > > > Please take a look.
> > > > >
> > > > > Thanks,
> > > >
> > >
>
sha
> > >
> > > On Thu, Jul 12, 2018, at 9:56 AM, Manikumar wrote:
> > > > Hi all,
> > > >
> > > > I have created a KIP to add describe all topics API to AdminClient .
> > > >
> > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > 327%3A+Add+describe+all+topics+API+to+AdminClient
> > > >
> > > > Please take a look.
> > > >
> > > > Thanks,
> > >
> >
have created a KIP to add describe all topics API to AdminClient .
> > >
> > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > 327%3A+Add+describe+all+topics+API+to+AdminClient
> > >
> > > Please take a look.
> > >
> > > Thanks,
> >
>
pache.org/confluence/display/KAFKA/KIP-
> 327%3A+Add+describe+all+topics+API+to+AdminClient
> >
> > Please take a look.
> >
> > Thanks,
>
Very useful. LGTM.
Thanks,
Harsha
On Thu, Jul 12, 2018, at 9:56 AM, Manikumar wrote:
> Hi all,
>
> I have created a KIP to add describe all topics API to AdminClient .
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-327%3A+Add+describe+all+topics+API+to+AdminClient
&
Hi all,
I have created a KIP to add describe all topics API to AdminClient .
https://cwiki.apache.org/confluence/display/KAFKA/KIP-327%3A+Add+describe+all+topics+API+to+AdminClient
Please take a look.
Thanks,
14 matches
Mail list logo
