Re: The limit on the number of consumers in a group.

2018-10-25 Thread Dominic Kim
I always have more number of partitions than the number of consumers.
When I face "hangs" with 150 consumers, the number of partitions was 300.


2018년 10월 26일 (금) 오전 11:09, Liam Clarke 님이 작성:

> How many partitions?
>
> On Fri, 26 Oct. 2018, 2:52 pm Dominic Kim,  wrote:
>
> > Dear all.
> >
> > Is there any limit on the number of consumers in a group?
> > I want to utilize about 300 or more consumers in a group, but rebalancing
> > hangs and never get finished.
> > When I invoke only 130~140 consumers in a group, it works fine.
> > Buf from 150 consumers, rebalancing is never stopped.
> >
> > I am using Kafka-11.0.2
> >
> > Is this an expected behavior? or Did I miss or misconfigure something?
> >
> > Thanks
> > Regards
> > Dominic
> >
>


The limit on the number of consumers in a group.

2018-10-25 Thread Dominic Kim
Dear all.

Is there any limit on the number of consumers in a group?
I want to utilize about 300 or more consumers in a group, but rebalancing
hangs and never get finished.
When I invoke only 130~140 consumers in a group, it works fine.
Buf from 150 consumers, rebalancing is never stopped.

I am using Kafka-11.0.2

Is this an expected behavior? or Did I miss or misconfigure something?

Thanks
Regards
Dominic


The limit on the number of consumers in a group.

2018-10-23 Thread Dominic Kim
Dear all.

Is there any limit on the number of consumers in a group?
I want to utilize about 300 or more consumers in a group, but rebalancing
hangs and never get finished.
When I invoke only 130~140 consumers in a group, it works fine.
Buf from 150 consumers, rebalancing is never stopped.

Is this an expected behavior? or Did I miss or misconfigure something?

Thanks
Regards
Dominic.