Hi Apache Kafka,
I'm evaluating Apache Kafka for one of the projects that I'm into. I have
used ActiveMQ in the past which makes using Kafka pretty straightforward.
One thing that I do not understand is the need for Zookeeper?
I understand what Zookeeper is, but I fail to understand what purpose
As a cluster, each none in the cluster should know each other to function
properly. For a Cassandra cluster(I don't know ActiveMQ's mechanism), as an
example, it has its own
protocal to communicate with each other to know their condition.
For Kafka, each node stays independantly, they use
Zookeeper is a distributed coordination service. Kafka uses Zookeeper for
various things like leader election, storing consumer-partition offsets etc.
More information on each service is available at
http://kafka.apache.org/documentation.html and https://zookeeper.apache.org/
I highly recommend
I wrote a short blog on what's being fixed in 0.8.2.1 release.
http://blog.confluent.io/2015/03/13/apache-kafka-0-8-2-1-release/
We recommend everyone upgrade to 0.8.2.1.
Thanks,
Jun
