Thanks, I forgot to mention that all my consumers (sarama go consumer) have the same groupid. And I would like the “starvation” to happen to 2 of my 3 consumers. and yes my topic really have single partition.
I am getting unique message to each consumer. So somehow all three consumers are sharing one partition. Does it effect that I have replication factor of 3? I am just puzzled what could be the reason. Any pointers? Regards, -Rami > On 14 Jun 2016, at 14:18, Jan Omar <jan.o...@wooga.net> wrote: > > > Hi Rami, > > Each consumer will receive every single message if they belong to different > consumer groups. Messages will only be distributed between consumers of the > same consumer group. > > So make sure they are in the same consumer group, beware in your case this > means 2 of the 3 consumers will be starving. To solve this issue you need to > increase your partition count. > > Regards > > Jan > >> On 14 Jun 2016, at 13:07, Joris Peeters <j.peet...@wintoncapital.com> wrote: >> >> I suppose the consumers would also need to all belong to the same consumer >> group for your expectation to hold. If the three consumers belong to >> different consumer groups, I'd expect each of them to receive all the >> messages, regardless of the number of partitions. >> So perhaps they are on different consumer groups? What client are you using? >> >> -----Original Message----- >> From: thinking [mailto:letianyi...@qq.com] >> Sent: 14 June 2016 12:04 >> To: users <users@kafka.apache.org> >> Subject: Re: Three consumers on a single partition >> >> hi, >> 1. you should check, if your topic partition really have one. >> 2. does your consumer get same message or different message. >> e.x all message is 1,2,3,4,5,6,7. consumer1 get 1,3,7 consumer2 get 2,6, >> consumer3 get 4,5? >> >> >> >> >> ------------------ Original ------------------ >> From: "Al-Isawi Rami";<rami.al-is...@comptel.com>; >> Date: Tue, Jun 14, 2016 06:58 PM >> To: "users@kafka.apache.org"<users@kafka.apache.org>; >> >> Subject: Three consumers on a single partition >> >> >> >> Hi, >> >> I have a cluster of 3 brokers and 1 topic which has 1 partition and >> replication factor of 3. There are also 3 consumers consuming from that >> topic. >> >> Now all the docs I have seen say that if number of consumers is bigger than >> the number of partition ( like in my case 3 consumers 1 partition), then >> only one consumer will get messages and the other two will not get any, >> nonetheless, they are all connected. >> >> However, in my case, all the three consumers are getting messages. Any ideas >> why this is happening? >> >> Regards, >> -Rami >> Disclaimer: This message and any attachments thereto are intended solely for >> the addressed recipient(s) and may contain confidential information. If you >> are not the intended recipient, please notify the sender by reply e-mail and >> delete the e-mail (including any attachments thereto) without producing, >> distributing or retaining any copies thereof. Any review, dissemination or >> other use of, or taking of any action in reliance upon, this information by >> persons or entities other than the intended recipient(s) is prohibited. >> Thank you. >> >> >> Winton Capital Management Limited (“Winton”) is a limited company registered >> in England and Wales with its registered offices at 16 Old Bailey, London, >> EC4M 7EG (Registered Company No. 3311531). Winton is authorised and >> regulated by the Financial Conduct Authority in the United Kingdom, >> registered as an investment adviser with the US Securities and Exchange >> Commission, registered with the US Commodity Futures Trading Commission and >> a member of the National Futures Association in the United States. >> >> This communication, including any attachments, is confidential and may be >> privileged. This email is for use by the intended recipient only. If you >> receive it in error, please notify the sender and delete it. You should not >> copy or disclose all or any part of this email. >> >> This email does not constitute an offer or solicitation and nothing >> contained in this email constitutes, and should not be construed as, >> investment advice. Prospective investors should request offering materials >> and consult their own advisers with respect to investment decisions and >> inform themselves as to applicable legal requirements, exchange control >> regulations and taxes in the countries of their citizenship, residence or >> domicile. Past performance is not indicative of future results. >> >> Winton takes reasonable steps to ensure the accuracy and integrity of its >> communications, including emails. However Winton accepts no liability for >> any materials transmitted. Emails are not secure and cannot be guaranteed to >> be error free. Winton handles personal information in accordance with its >> privacy >> notice.<https://www.wintoncapital.com/en/regulatory-disclosures#privacypolicy> > Disclaimer: This message and any attachments thereto are intended solely for the addressed recipient(s) and may contain confidential information. If you are not the intended recipient, please notify the sender by reply e-mail and delete the e-mail (including any attachments thereto) without producing, distributing or retaining any copies thereof. Any review, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient(s) is prohibited. Thank you.
