Hi, I am from Intuit. We want to use Kafka as message bus where Single Producer produces message and 1 Million Consumer listens it.
Requirement – 1. Single producer and 1 Million Consumer and one particular Topic with message. 2. When Pushed Message thru producer, should be received by all consumers 3. Consumers can be added any time and may be removed any time. Query – 1. Can I use a Single Consumer Group for the above requirement? 2. Do I need to config 1 Million Partitions for all the Consumers manually? Or Kafka will automatically do load balancing? 3. Should Consumer need to subscribe every time, it listens? 4. Or should consumer need to assign itself for the particular topic? 5. Can all consumer listen to same host with post 9092 of Zoo Keeper? Need help to finalize my design. I just did a POC with One topic and One consumer. Thank you, Satarupa
