How to deploy Kafka on AWS

Hi I am starting to analyze how to deploy Kafka (we are using AWS) and would like to hear what are you doing. I am particularly interested in knowing things like these: Do you use Docker for Kafka and/or ZooKeeper? If using Docker, which OS, CoreOS, other? Are you using some scheduler like Kuber

Trying to understand 0.9.0 producer and Consumer design

Hi Everybody is there any design document you can point me to understand producer and consumer in Kafka 0.9.0? I am reading https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite but would like to know if this is "up to date" and reflect actual implementation. Regards Luciano

Re: Change kafka broker ids dynamically

t; 3. Use Kafka 0.9.0 where Kafka can auto-generate the broker name and then > store it in a data file, so if you still have the files, you have the same > broker ID > > On Tue, Nov 24, 2015 at 2:58 PM, SpikyHawk SpikyHawk < > listas.luaf...@gmail.com> wrote: > > > Hi t

Re: Change kafka broker ids dynamically

Hi there. I have a similar question but is related to this scenario. Docker server running in EC2 instance with an EBS volume attached to it. Kafka running in a Docker container in this host with server.properties "autogenerated" using a bootstrap script. Part of the bootstrapping process is to