Re: Storm worker becoming zombie process

2015-11-26 Thread Longda Feng
I have met zombie worker process before. But at that time, the OS load is high and the OS version is old (the OS is redhat 5).  Later, I upgrade OS to redhat 6. And keeping the CPU usage is less than 80%.Another tuning method is as the following:In JStorm, supervisor will issue kill command

Will Storm/JStorm new a separate bolt instance for every task/thread?

2015-11-26 Thread Dollyn
For example: builder.setBolt("xxx", new XXXBolt(), 10) Assume that there is only one worker, how many XXXBolt's java object instance will be there? 1 or 10? In fact, I did some test by add the following code in the execute method: LOGGER.debug("BoltID: {}, ThreadID: {} - {}",

Re: Will Storm/JStorm new a separate bolt instance for every task/thread?

2015-11-26 Thread 封仲淹(纪君祥)
Please read this page http://storm.apache.org/documentation/Concepts.html firstly.Let me explain several conception:In storm,  one worker means one process, one executor means one thread, one task means one bolt or spout instance.In jstorm, worker means process, task also means one thread and

Fwd: Unable to shade guava correctly in uber-jar

2015-11-26 Thread aurelien violette
Hi, I've been trying to upgrade to Storm 0.10.0 version. While it worked great in 0.9.5, the uber-jar is now failing. I'm using such dependencies : com.optimaize.languagedetector language-detector 0.5 Which uses guava 16.0.1 under the hood. And I'm building the

Re: Will Storm/JStorm new a separate bolt instance for every task/thread?

2015-11-26 Thread Dollyn
If the bolt class is class XXXBolt { private int x; } builder.setBolt("xxx", new XXXBolt(), 10).setNumTasks(20); In jstorm there is no thread-safe problem on the field x. And if builder.setBolt("xxx", new XXXBolt(), 10) There is no thread-safe problem in both storm and storm. Is that

Re: Will Storm/JStorm new a separate bolt instance for every task/thread?

2015-11-26 Thread yuanjun Li
You can read the links below: http://storm.apache.org/documentation/Understanding-the-parallelism-of-a-Storm-topology.html https://groups.google.com/forum/#!topic/storm-user/IS8PijLjU8c

Re: Will Storm/JStorm new a separate bolt instance for every task/thread?

2015-11-26 Thread Dollyn
That is very helpful, Thank you very much yuanjun Li and Longda! On Thu, Nov 26, 2015 at 10:34 PM, yuanjun Li wrote: > You can read the links below: > > > http://storm.apache.org/documentation/Understanding-the-parallelism-of-a-Storm-topology.html > >

Status of REST API in 0.10.x versions

2015-11-26 Thread Spico Florin
Hello! I would like to ask you what is the status of the REST API in 0.10.x versions for the followings: 1. submitting a topology 2. killing a topology 3. listing a topology I have read something about these features in https://github.com/apache/storm/pull/464 and