Hello, I am sorry, but I don't know why you cannot emulate those scale up factors by using rebalance; after all it spawns the requested amount of workers (in topology) and executors (in spouts/bolts) only bounded by the topology_max_task_parallelism. Have you read the article in order to understand how parallelism works in storm?
Regards. On Thu, Jun 9, 2016 at 3:34 PM, Adrien Carreira <[email protected]> wrote: > Yes, > > But the rebalance command doesn't do what I would like. > > > Let's suppose that I've : > > SPOUT A (1) => BOLT 1 (1) => BOLT2 (1) => BOLT3 (3) > > (number is the parallelism hint) > It means that If I scale to n worker I would like : > > SPOUT A (1*n) => BOLT 1 (1*n) => BOLT2 (1*n) => BOLT3 (3*n) > > > But, the storm rebalance keeps the parralisme_hint :/ > > > > 2016-06-09 14:29 GMT+02:00 Andrew Xor <[email protected]>: > >> Hello, >> >> Why not use the rebalance command? It's well documented here >> <http://storm.apache.org/releases/current/Understanding-the-parallelism-of-a-Storm-topology.html> >> . >> >> Regards. >> >> On Thu, Jun 9, 2016 at 3:22 PM, Adrien Carreira <[email protected]> >> wrote: >> >>> Hi, >>> >>> After a month building a topology on storm. I've one question about >>> parallelism that I can't answer. >>> >>> I've developed my topology and tested on a cluster with two nodes. >>> >>> My parallelism_hint are ok, everything are fine. >>> >>> My question is, if I need to scale the number of worker in the topology >>> to have more worker dooing the same thing how can I achieve that without >>> kill/restart the topology >>> >>> Thanks for your reply >>> >> >> >
