Re: Replication Factor and number of brokers

2016-02-17 Thread Alex Loddengaard
Thanks, Alexis and Ben! Alex On Wed, Feb 17, 2016 at 5:57 AM, Ben Stopford wrote: > If you create a topic with more replicas than brokers it should throw an > error but if you lose a broker you'd have under replicated partitions. > > B > > On Tuesday, 16 February 2016, Alex Loddengaard wrote:

Re: Replication Factor and number of brokers

2016-02-17 Thread Ben Stopford
If you create a topic with more replicas than brokers it should throw an error but if you lose a broker you'd have under replicated partitions. B On Tuesday, 16 February 2016, Alex Loddengaard wrote: > Hi Sean, you'll want equal or more brokers than your replication factor. > Meaning, if your r

Re: Replication Factor and number of brokers

2016-02-17 Thread Alexis Midon
it will throw an exception: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/AdminUtils.scala#L76-L78 On Tue, Feb 16, 2016 at 3:55 PM Alex Loddengaard wrote: > Hi Sean, you'll want equal or more brokers than your replication factor. > Meaning, if your replication factor

Re: Replication Factor and number of brokers

2016-02-16 Thread Alex Loddengaard
Hi Sean, you'll want equal or more brokers than your replication factor. Meaning, if your replication factor is 3, you'll want 3 or more brokers. I'm not sure what Kafka will do if you have fewer brokers than your replication factor. It will either give you the highest replication factor it can (i

Re: Replication Factor and number of brokers

2016-02-16 Thread Damian Guy
Then you'll have under-replicated partitions. However, even if you have 3 brokers with a replication factor of 2 and you lose a single broker you'll still likely have under-replicated partitions. Partitions are assigned to brokers, 1 broker will be the leader and n brokers will be followers. If any

Re: Replication Factor and number of brokers

2016-02-16 Thread Sean Morris (semorris)
So if I have a replication factor of 2, but only 2 brokers, then replication works, but what if I lose one broker? Thanks, Sean On 2/16/16, 9:14 AM, "Damian Guy" wrote: >Hi, > >You need to have at least replication factor brokers. >replication factor = 1 is no replication. > >HTH, >Damian > >O

Re: Replication Factor and number of brokers

2016-02-16 Thread Damian Guy
Hi, You need to have at least replication factor brokers. replication factor = 1 is no replication. HTH, Damian On 16 February 2016 at 14:08, Sean Morris (semorris) wrote: > Should your number of brokers be atleast one more then your replication > factor of your topic(s)? > > So if I have a r

Replication Factor and number of brokers

2016-02-16 Thread Sean Morris (semorris)
Should your number of brokers be atleast one more then your replication factor of your topic(s)? So if I have a replication factor of 2, I need atleast 3 brokers? Thanks, Sean