Re: Multiple brokers - do they share the load?

2017-12-04 Thread Skip Montanaro
kafka-topics.sh --create --zookeeper localhost:2181 >> > --replication-factor 3 --partitions 3 --topic my-replicated-topic >> > >> > -Dave >> > >> > -Original Message- >> > From: Skip Montanaro [mailto:skip.montan...@gmail.com] >>

Re: Multiple brokers - do they share the load?

2017-12-01 Thread Ben Davison
actor 3 --partitions 3 --topic my-replicated-topic > > > > -Dave > > > > -Original Message- > > From: Skip Montanaro [mailto:skip.montan...@gmail.com] > > Sent: Thursday, November 30, 2017 4:20 PM > > To: users@kafka.apache.org > > Subject: Re: Multiple b

RE: Multiple brokers - do they share the load?

2017-12-01 Thread Skip Montanaro
plication-factor 3 --partitions 3 --topic my-replicated-topic > > -Dave > > -Original Message- > From: Skip Montanaro [mailto:skip.montan...@gmail.com] > Sent: Thursday, November 30, 2017 4:20 PM > To: users@kafka.apache.org > Subject: Re: Multiple brokers - do they

RE: Multiple brokers - do they share the load?

2017-11-30 Thread Tauzell, Dave
ursday, November 30, 2017 4:20 PM To: users@kafka.apache.org Subject: Re: Multiple brokers - do they share the load? > If you create a partitioned topic with at least 3 partitions then you will > see your client connect to all of the brokers. The client decides which > partition a me

Re: Multiple brokers - do they share the load?

2017-11-30 Thread Skip Montanaro
> If you create a partitioned topic with at least 3 partitions then you will > see your client connect to all of the brokers. The client decides which > partition a message should go to and then sends it directly to the broker > that is the leader for that partition. If you have replicated

RE: Multiple brokers - do they share the load?

2017-11-28 Thread Tauzell, Dave
, then the brokers themselves will also be connected to one-another in order to replication messages. -Dave -Original Message- From: Skip Montanaro [mailto:skip.montan...@gmail.com] Sent: Tuesday, November 28, 2017 8:06 AM To: users@kafka.apache.org Subject: Multiple brokers - do they share

Re: Multiple brokers - do they share the load?

2017-11-28 Thread Svante Karlsson
You are connecting to a single seed node - your kafka library will then under the hood connect to the partition leaders for each partition you subscribe or post to. The load is not different compared to if you gave all nodes as connect parameter. However if your seed node crashes then your client

Multiple brokers - do they share the load?

2017-11-28 Thread Skip Montanaro
Apologies for the rather long set-up... I've been using Kafka as a client for a few months now. The setup I've been using has three brokers on separate servers, all listening to port 9092. My consumers always connected to server1:9092. I've ignored server2 and server3. Now I'm starting to mess