David's answer is correct. Just start the same application multiple times on different nodes and the library does the rest for you.
Just one addition: as Kafka Streams is for standard application development, there is no need to run the application on the same nodes as your brokers are running (ie, applications instances could run on any machine outside of your broker cluster). Of course, it is possible to run the application on broker nodes. Just wanted to point out, that there is no co-location required between brokers and app instances. -Matthias On 07/26/2016 08:08 PM, David Garcia wrote: > http://docs.confluent.io/3.0.0/streams/architecture.html#parallelism-model > > you shouldn’t have to do anything. Simply starting a new thread will > “rebalance” your streaming job. The job coordinates with tasks through kafka > itself. > > > > On 7/26/16, 12:42 PM, "Davood Rafiei" <rafieidavo...@gmail.com> wrote: > > Hi, > > I am newbie in Kafka and Kafka-Streams. I read documentation to get > information how it works in multi-node environment. As a result I want to > run streams library on cluster that consists of more than one node. > From what I understood, I try to resolve the following conflicts: > - Streams is a standalone java application.So it runs in a single node, of > n-node cluster of kafka. > - However, streams runs on top of kafka, and if we set a multi-broker > kafka > cluster, and then run streams library from master node, then streams > library will run in entire cluster. > > So, streams library is standalone java application but to force it to run > in multiple nodes, do we need to do something extra (in configuration for > example) if we have already kafka running in multi-broker mode? > > > Thanks > Davood > >
signature.asc
Description: OpenPGP digital signature
