Are there plans to move consumer group coordination off of Zk as well? And if
so:-- what's the approximate planned release for that?-- and what dependencies
on Zk will be left in Kafka after that?
thanks!Marina
From: Ewen Cheslack-Postava <[email protected]>
To: "[email protected]" <[email protected]>
Sent: Thursday, October 15, 2015 2:27 AM
Subject: Re: Difference between storing offset on Kafka and on Zookeeper
server?
There are a couple of advantages. First, scalability. Writes to Kafka are
cheaper than writes to ZK. Kafka-based offset storage is going to be able
to handle significantly more consumers (and scale out as needed since
writes are spread across all partitions in the offsets topic). Second, once
you move offsets *and* consumer group coordination off of ZK, then clients
don't need access to ZK at all.
-Ewen
On Wed, Oct 14, 2015 at 10:09 PM, Kiran Singh <[email protected]> wrote:
> What are the major advantage to store Offset on kafka server instead of
> zookeeper?
>
> Please share any link for the same.
>
--
Thanks,
Ewen