Re: Storm Memory Consumption Issue

2015-09-12 Thread Hong Wind
ll list of rules. > On Sep 12, 2015 10:37 AM, "Hong Wind" wrote: > >> Hi all again, >> >> Since no reply I guess the question might be not described clearly >> enough. >> So let me try to elaborate it ... >> >> Performance requirements for

Re: Storm Memory Consumption Issue

2015-09-12 Thread Hong Wind
y, the load of dispatching rules is distributed to the rule evaluation bolt instances (in different workers and nodes) so it does not cause the explosion. We trade off the latency to memory. Is the thinking correct? Or is it a correct solve? Any idea is welcome and appreciated. Thanks BR/Wind O

Storm Memory Consumption Issue

2015-09-09 Thread Hong Wind
Hi all, I am doing a performance benchmark for our topology which is to evaluate a set of rules. The topology is as below: Spout -> Bolt#1(Dispatch) -> Bolt#2(Evaluation) The bolt#1 load the rules from DB and dispatch them to bolt#2 for evaluation. One bolt#2 task evaluates one rule. So how many