Re: Adding partitons | Unaffected producers

[Sameer Kumar]

Thanks. Any possible reasons why we didnt made consumers partition aware.
do we have a similar property for consumers.

I found that in streams application, if i increase partitions i need to
restart my stream application, same would hold for consumers as well.

-Sameer.

On Fri, Aug 4, 2017 at 8:22 PM, Hans Jespersen  wrote:

> See the producer param called metadata.max.age.ms which is "The period of
> time in milliseconds after which we force a refresh of metadata even if we
> haven't seen any partition leadership changes to proactively discover any
> new brokers or partitions."
>
> -hans
>
> > On Aug 4, 2017, at 5:17 AM, Sameer Kumar  wrote:
> >
> > According to Kafka docs, producer decides on which partition the data
> shall
> > reside. I am aware that neither broker nor producer needs to be restarted
> > to detect added partitions.
> >
> > Would like to understand if there is some frequency through which
> producer
> > detects new partitions.
> >
> > Though consumers were not made partiton aware, any possible reasons for
> the
> > same.
> >
> > -Sameer.
>

Re: Adding partitons | Unaffected producers

[Hans Jespersen]

See the producer param called metadata.max.age.ms which is "The period of time 
in milliseconds after which we force a refresh of metadata even if we haven't 
seen any partition leadership changes to proactively discover any new brokers 
or partitions."

-hans

> On Aug 4, 2017, at 5:17 AM, Sameer Kumar  wrote:
> 
> According to Kafka docs, producer decides on which partition the data shall
> reside. I am aware that neither broker nor producer needs to be restarted
> to detect added partitions.
> 
> Would like to understand if there is some frequency through which producer
> detects new partitions.
> 
> Though consumers were not made partiton aware, any possible reasons for the
> same.
> 
> -Sameer.

Adding partitons | Unaffected producers

[Sameer Kumar]

According to Kafka docs, producer decides on which partition the data shall
reside. I am aware that neither broker nor producer needs to be restarted
to detect added partitions.

Would like to understand if there is some frequency through which producer
detects new partitions.

Though consumers were not made partiton aware, any possible reasons for the
same.

-Sameer.