RE: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Tauzell, Dave
throughput quite a bit. -Dave -Original Message- From: Hans Jespersen [mailto:h...@confluent.io] Sent: Friday, October 28, 2016 11:36 AM To: Mudit Agarwal Cc: users@kafka.apache.org Subject: Re: Kafka Multi DataCenter HA/Failover Are you willing to have a maximum throughput of 6.67

Re: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Hans Jespersen
ahoo.com> > *Sent:* Friday, 28 October 2016 4:34 PM > *Subject:* Re: Kafka Multi DataCenter HA/Failover > > > What is the latency between the two datacenters? I ask because unless they > are very close, you probably don’t want to do any form of synchronous > replicatio

RE: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Tauzell, Dave
: Kafka Multi DataCenter HA/Failover I means 1.The producers in Datacenter A will start writing to Kafka in Datacenter B if Kafka in A is failing? From: "Tauzell, Dave" <dave.tauz...@surescripts.com> To: "users@kafka.apache.org" <users@kafka.apache.org>; Mu

Re: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Mudit Agarwal
> Sent: Friday, 28 October 2016 4:22 PM Subject: RE: Kafka Multi DataCenter HA/Failover By failover do you mean: 1. The producers in Datacenter A will start writing to Kafka in Datacenter B if Kafka in A is failing? Or 2. Consumers in Datacenter B have access to messages written to Kafka

Re: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Mudit Agarwal
Subject: Re: Kafka Multi DataCenter HA/Failover What is the latency between the two datacenters? I ask because unless they are very close, you probably don’t want to do any form of synchronous replication.The Confluent Replicator (coming very soon in Confluent Enterprise 3.1) will do async

Re: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Hans Jespersen
,Mudit > > From: "Tauzell, Dave" <dave.tauz...@surescripts.com> > To: "users@kafka.apache.org" <users@kafka.apache.org>; Mudit Agarwal > <mudit...@yahoo.com> > Sent: Friday, 28 October 2016 4:02 PM > Subject: RE: Kafka Multi DataCenter H

RE: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Tauzell, Dave
...@yahoo.com.INVALID] Sent: Friday, October 28, 2016 10:09 AM To: users@kafka.apache.org Subject: Re: Kafka Multi DataCenter HA/Failover Thanks dave. Any ways for how we can achieve HA/Failover in kafka across two DC? Thanks,Mudit From: "Tauzell, Dave" <dave.tauz...@surescripts.com

Re: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Mudit Agarwal
, 28 October 2016 4:02 PM Subject: RE: Kafka Multi DataCenter HA/Failover >> without any lag You are going to have some lag at some point between datacenters. I haven't used this but from taking to them they are working or have created a replacement for MirrorMaker using t

RE: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Tauzell, Dave
talked to anybody about Kafka failoer. -Dave -Original Message- From: Mudit Agarwal [mailto:mudit...@yahoo.com.INVALID] Sent: Friday, October 28, 2016 9:38 AM To: Users Subject: Kafka Multi DataCenter HA/Failover Hi, I learned that Confluent Enterprise provides Multi DC failover and HA synchro

Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Mudit Agarwal
Hi, I learned that Confluent Enterprise provides Multi DC failover and HA synchronously and without any lag.I'm looking to learn further information and more detailed documentation on this.I have gone thorugh the white paper and it just talks about Replicator. Any pointers for more information