Kafka Replication Factor

2016-07-24 Thread Avi Asulin
Hi All Just double checking If i have created a topic with replication factor 1 does it mean i dont have replication if one of my disks crashes do i loose data? Thanks Avi

Kafka Replication Factor

2018-01-17 Thread Sameer Kumar
Hi, I have a cluster of 3 Kafka brokers, and replication factor is 2. This means I can tolerate failure of 1 node without data loss. Recently, one of my node crashed and some of my partitions went offline. I am not sure if this should be the case. Am I missing something. -Sameer.

Kafka replication factor mode

2014-12-05 Thread Ankit Jain
Hi All, I have two nodes kafka cluster and using replication factor 2. If both the node is running, then i am able to push data, but if any nodes goes down, then getting exception. I explored and found that, the default replication factor mode is quorum, means at least (f+1) node must be availa

Re: Kafka Replication Factor

2016-07-24 Thread Stevo Slavić
Hello Avi, Yes, replication factor of 1 means just one lead replica gets assigned for the topic partitions. To achieve HA of messages there are more things to watch out, not only replication factor - metadata/ZK HA, producer acks, min-in-sync replicas, rack awareness for replica assignment to nam

Re: Kafka Replication Factor

2018-01-17 Thread Svante Karlsson
whats your config for min.insync.replicas? 2018-01-17 13:37 GMT+01:00 Sameer Kumar : > Hi, > > I have a cluster of 3 Kafka brokers, and replication factor is 2. This > means I can tolerate failure of 1 node without data loss. > > Recently, one of my node crashed and some of my partitions went off

Re: Kafka Replication Factor

2018-01-17 Thread Brett Rann
if RF=2 and min.insync.replicas=1 (the default) then you shouldn't have offline partitions if 1 of 3 brokers is down. I'd first double check your topic config (and broker defaults) for the one that went offline to verify RF/Min. Be sure to check each partition they can be different! ( kafka-topics

Re: Kafka replication factor mode

2014-12-08 Thread Jun Rao
Kafka tolerates 2f failures with 2f+1 replicas by default. What error are you seeing? Thanks, Jun On Fri, Dec 5, 2014 at 10:01 AM, Ankit Jain wrote: > Hi All, > > I have two nodes kafka cluster and using replication factor 2. If both the > node is running, then i am able to push data, but if a