Hi,
We have a partition which has many more messages than all other partitions.
Does anyone know if there has been any discussions on having a partition
balancer that tries to balance consumers based on consumer group lag?
Example:
[
{ partition: 0, consumers: "192.168.1.2", lag: 20000 },
{ partition: 1, consumers: "192.168.1.2", lag: 20000 },
{ partition: 2, consumers: "192.168.1.3", lag: 0 },
]
Clearly, it would be more optimial if "192.168.1.3" also takes care of
partition 1.
Cheers,
Jens
--
Jens Rantil
Backend engineer
Tink AB
Email: [email protected]
Phone: +46 708 84 18 32
Web: www.tink.se
Facebook <https://www.facebook.com/#!/tink.se> Linkedin
<http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_photo&trkInfo=VSRPsearchId%3A1057023381369207406670%2CVSRPtargetId%3A2735919%2CVSRPcmpt%3Aprimary>
Twitter <https://twitter.com/tink>
