RE: Extra classpath entries

2014-07-25 Thread Michael Dev
, Michael Dev wrote: Is there a way to provide extra classpath entries for the worker jvms when using the storm script? I see that storm.cmd utilizes the STORM_CLASSPATH environment variable yet the python script does not provide any such capability. Our reasoning behind wanting

RE: Workers constantly restarted due to session timeout

2014-06-05 Thread Michael Dev
. There are tools like iotop that can give information about disk load. -- Derek On 6/3/14, 13:14, Michael Dev wrote: Thank you Derek for the explanation between :disallowed and :timed-out. That was extremely helpful in understanding what decisions Storm is making. I increased

RE: Workers constantly restarted due to session timeout

2014-06-03 Thread Michael Dev
connections from the worker to ZK are timing out in the first place. What about the ZK servers? Sometimes ZooKeeper servers cannot keep up, and that causes pretty severe problems with timeouts. -- Derek On 5/30/14, 17:51, Michael Dev wrote: Michael R, We don't have GC logging

RE: Workers constantly restarted due to session timeout

2014-05-30 Thread Michael Dev
nodes? What do the ZK logs say? -- Derek On 5/29/14, 11:45, Michael Dev wrote: Derek, We are currently running with -Xmx60G and only about 20-30G of that has been observed to be used. I'm still observing workers restarted every 2 minutes. What timeout is relevant

RE: Workers constantly restarted due to session timeout

2014-05-29 Thread Michael Dev
, Michael Dev wrote: Hi all, We are seeing our workers constantly being killed by Storm with to the following logs: worker: 2014-05-23 20:15:08 INFO ClientCxn:1157 - Client session timed out, have not heard from the server in 28105ms for sessionid 0x14619bf2f4e0109, closing socket

Workers constantly restarted due to session timeout

2014-05-23 Thread Michael Dev
Hi all, We are seeing our workers constantly being killed by Storm with to the following logs: worker: 2014-05-23 20:15:08 INFO ClientCxn:1157 - Client session timed out, have not heard from the server in 28105ms for sessionid 0x14619bf2f4e0109, closing socket and attempting reconnect