Re: Understanding zookeper and kafka server failures

2016-11-08 Thread Karolis Pocius
It depends on the size and load of your cluster. Zookeeper is very I/O sensitive, so at least you have to make sure it doesn't share disk with the OS or Kafka. I assume you've read the documentation, but you might want to have a look at https://kafka.apache.org/documentation.html#zkops again,

Re: Understanding zookeper and kafka server failures

2016-11-08 Thread Sachin Mittal
Hi, Thanks for the reply. From one obvious reason that is server crashes then both zookeeper and broker crashes, is there any other reason why we should not run broker and zookeeper on same server. If chances of server crash are extremely low can can be brought back up quickly, then can we keep bo

Re: Understanding zookeper and kafka server failures

2016-11-08 Thread Karolis Pocius
The question is what happens if one of the zookeeper crashes. Will the broker on that node also will crash? If 1/3 zookeeper nodes crashes, the other two will take over. Kafka broker will not crash. However, you should not run zookeeper and kafka on the same server in production. What happens i

Understanding zookeper and kafka server failures

2016-11-08 Thread Sachin Mittal
Hi, We have following setup. 1. Three instances of zookeeper on three machines. 2. Three instances of kafka server on same three machines. 3. All the topics have replication factor 3. So when we create a topic on any node, i see that it gets replicated on all three instances. I also see that topic