Re: Best practices for running Storm, HBase, Kafka (regading Zookeeper cluster)

2016-03-02 Thread Peyman Mohajerian
Option 1 clearly is more reliable but some choose option 2 to reduce the overhead of having multiple ZK cluster from resource and management point of view. I've seen both cases and more than anything else depends on you workload on each of the components. For example Kafka and Storm may run on the

Best practices for running Storm, HBase, Kafka (regading Zookeeper cluster)

2016-03-02 Thread Spico Florin
Hello! I would like to know how it is best to run the three systems regarding the Zookeeper cluster usage: 1. separately per each system (ZK cluster/Storm, Zk Cluster/HBase, Zk/Hbase) 2. single cluster for all of them (Storm,HBase,Kafka->single ZK cluster) In my opinion the first one is the