So, we finally figured out why our __consumer_offsets topics was so skewed
in volume across partitions. Turns out that the partition is chosen based
on the consumer group_id (which makes sense), and we had a few extremely
over-committing consumers in prod. A few of them were committing several
th
I apologize for sending this to dev. Reposting to the Users mailing list.
-- Forwarded message --
I was investigating some performance issues we're issues in one of our
production clusters, and I ran into extremely unbalanced offset partitions
for the __consumer_offsets topic. I
