Re: kafka cluster on aws

2015-01-14 Thread Dillian Murphey
> > > For redundancy make sure you run at least two that have full replicas of > > all other partitions. We run replication factor of 3 with three > instances > > so if any goes down the other two bring it back in sync once a fresh > server > > spins in the aut

Re: kafka cluster on aws

2015-01-14 Thread Dillian Murphey
Thanks for the comments. Hey Joe, I'm looking at your project now. I'm going to give it a try.

Re: kafka cluster on aws

2015-01-14 Thread Joe Stein
___ > From: Dillian Murphey > Sent: Wednesday, January 14, 2015 2:42 PM > To: users@kafka.apache.org > Subject: kafka cluster on aws > > I can't seem to find much information to help me (being green to kafka) on > setting up a cluster on aws

Re: kafka cluster on aws

2015-01-14 Thread Joseph Lawson
fresh server spins in the autoscaling group. From: Dillian Murphey Sent: Wednesday, January 14, 2015 2:42 PM To: users@kafka.apache.org Subject: kafka cluster on aws I can't seem to find much information to help me (being green to kafka) on setting

kafka cluster on aws

2015-01-14 Thread Dillian Murphey
I can't seem to find much information to help me (being green to kafka) on setting up a cluster on aws. Does anyone have any sources? The question I have off the bat is, what methods have already been explored to generate a unique broker id? If I spin up a new server, do I just need to maintain my