Re: the problems of parititons assigned to consumers

2017-04-25 Thread Robert Quinlivan
For problem 1, you could implement your own PartitionAssignor class to do static assignments. The downside of that is that if one consumer goes offline (due to hardware failure or a bug) then you aren't consuming from the respective partition. For problem 2, if you are finding that the throughput

Re: the problems of parititons assigned to consumers

2017-04-25 Thread David Garcia
For Problem 1, you will probably have to either use the low-level API, and/or do manual partition assignment. For problem 2, you can simply re-publish the messages to a new topic with more partitions…or, as in the first problem, just use the low level API. You can also create more consumer gro

the problems of parititons assigned to consumers

2017-04-24 Thread 揣立武
Hi, all. There are two problems when we use kafka about partitions assigned to consumers. Problem 1: Partitions will be reassigned to consumers when consumer online or offline, then the messages latency become higher. Problem 2: If we have two partitions, only two consumers can consume messages。H