Failing a tuple tree with BaseBasicBolt

2014-01-18 Thread Mark Greene
Version: 0.8.2 I'm seeing my spout's ack method being called when I explicitly call collector.reportError(exception) in my BaseBasicBolt. Is there a different way to fail a tuple tree or do I have to extend BaseRichBolt?

Re: How to capture custom Storm UI related metrics using Ganglia

2014-01-20 Thread Mark Greene
Hey Bijoy, Not sure how you would go about capturing number of spouts/bolts but we've done some custom metrics capturing with respect to latencies inside spouts and bolts. For spouts, when you override the open method, you have access to a TopologyContext object. This is where you can add a TaskH

Re: How to capture custom Storm UI related metrics using Ganglia

2014-01-21 Thread Mark Greene
> What I am looking for is a way to forward those to Ganglia to display on > Ganglia web screen. > > Thanks > Bijoy > > > On Tue, Jan 21, 2014 at 6:31 AM, Mark Greene wrote: > >> Hey Bijoy, >> >> Not sure how you would go about capturing number of spouts/b

Re: How does one map a component id back to the name of a component in trident? (implementing a metrics consumer)

2014-01-21 Thread Mark Greene
This isn't as elegant of a solution as it doesn't take advantage of the new features you mention in 0.9 but I simply implement ITaskHook with a constructor that takes in a sensible name for bolts and spouts. This name is used to dump metrics into Codahale and then the Codahale GraphiteReporter ship

Re: How to capture custom Storm UI related metrics using Ganglia

2014-01-22 Thread Mark Greene
from Storm,I am looking for some api that can be used to push the > metrics to Ganglia server. > > Thanks > > > On Tue, Jan 21, 2014 at 7:52 PM, Mark Greene wrote: > >> Ah sorry. So I use a singleton that runs a ScheduledThreadExecutor that >> ships the counters to my ch

Re: quick question ab failed tuple on only 1 of the 2 bolts

2014-01-24 Thread Mark Greene
This is true so long as when you emit, the tuple is anchored. If it is not, it will not cause a replay of the entire tuple tree. On Thu, Jan 23, 2014 at 2:49 PM, P. Taylor Goetz wrote: > Correct. The spout will replay the tuple, so it will go through the entire > graph. > > - Taylor > > > > On

Topology dies immediately upon deployment when configured with two workers instead of one

2014-01-30 Thread Mark Greene
Exception in log: 2014-01-31 02:58:14 task [INFO] Emitting: change-spout default [[B@38fc659c] 2014-01-31 02:58:14 task [INFO] Emitting: change-spout __ack_init [1863657906985036001 0 2] 2014-01-31 02:58:14 util [ERROR] Async loop died! java.lang.RuntimeException: org.zeromq.ZMQException: Invalid

Re: Topology dies immediately upon deployment when configured with two workers instead of one

2014-01-31 Thread Mark Greene
> or if it has already been released),they are supposed to remove the ZMQ > dependency at all,so the above error should not be coming then. > > Thanks > Bijoy > > > On Fri, Jan 31, 2014 at 8:42 AM, Mark Greene wrote: > >> Exception in log: >> >> 2014-01-31 02:58:1

Re: Topology dies immediately upon deployment when configured with two workers instead of one

2014-01-31 Thread Mark Greene
. Is the version of libzmq you installed the same as the one you > are using in production? > > > On Fri, Jan 31, 2014 at 9:47 AM, Mark Greene wrote: > >> Storm uses the internal queuing (through ZMQ) only when there is a >>> communication between two worker processes

Re: http-client version conflict

2014-02-06 Thread Mark Greene
We had this problem as well. We modified our chef cookbook to just replace the older version with the newer one and storm didn't complain or have any other issues as a result. On Wed, Feb 5, 2014 at 10:31 AM, P. Taylor Goetz wrote: > Your best bet is probably to use the shade plugin to relocat