Subbu Srinivasan created KAFKA-986:
--------------------------------------
Summary: Topic Consumption Across multiple instances of consumer
groups
Key: KAFKA-986
URL: https://issues.apache.org/jira/browse/KAFKA-986
Project: Kafka
Issue Type: Bug
Components: consumer
Affects Versions: 0.8
Environment: Linux
Reporter: Subbu Srinivasan
Assignee: Neha Narkhede
Folks,
How can we simulate the notion of queues for consumers from multiple instances?
For eg: I have a topic log.
>From a single machine ( I tried from different machines also) I started two
>consumers on same topic with same group id. Both the consumers get copes of
>messages.
bin/kafka-console-consumer.sh --zookeeper kafka1:2181 --topic log --group 1
bin/kafka-console-consumer.sh --zookeeper kafka1:2181 --topic log --group 1
>From the design section at http://kafka.apache.org/design.html
<clipped from there>
Each consumer process belongs to a consumer group and each message is delivered
to exactly one process within every consumer group. Hence a consumer group
allows many processes or machines to logically act as a single consumer. The
concept of consumer group is very powerful and can be used to support the
semantics of either a queue or topic as found in JMS. To support queue
semantics, we can put all consumers in a single consumer group, in which case
each message will go to a single consumer.
</clipped from there>
Can someone elaborate on this?
Thanks
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira