Re: When i set TOPOLOGY_TICK_TUPLE_FREQ_SECS into my Storm config, I get Non-system tuples should never be sent to __system bolt

2014-06-20 Thread Chris Bedford
, emitFrequencyInSeconds); return conf; } Hope this is helpful for other people seeking to incorporate ticks (the clock kind) into their topologies. On Thu, Jun 19, 2014 at 1:08 AM, Chris Bedford ch...@buildlackey.com wrote: Hello, Storm experts: I'm trying to use the system 'ticks' in Storm

When i set TOPOLOGY_TICK_TUPLE_FREQ_SECS into my Storm config, I get Non-system tuples should never be sent to __system bolt

2014-06-19 Thread Chris Bedford
backtype.storm.util - Halting process: (Worker died) -- Chris Bedford Founder Lead Lackey Build Lackey Labs: http://buildlackey.com Go Grails!: http://blog.buildlackey.com

Re: Is there any way for my application code to get notified after it gets deserialized on a worker node and before spouts/bolts are opened/prepared ?

2014-06-02 Thread Chris Bedford
/topology/base/BaseRichSpout.html Is that sufficient for your needs or were you thinking of something different? Marc On Sun, Jun 01, 2014 at 04:47:03PM -0700, Chris Bedford wrote: Hi there - I would like to set up some state that spouts and bolts share, and I'd like to prepare

Re: Is there any way for my application code to get notified after it gets deserialized on a worker node and before spouts/bolts are opened/prepared ?

2014-06-02 Thread Chris Bedford
(Config.TOPOLOGY_AUTO_TASK_HOOKS, Lists.newArrayList(MyTaskHook.class.getName())); Michael Rose (@Xorlev https://twitter.com/xorlev) Senior Platform Engineer, FullContact http://www.fullcontact.com/ mich...@fullcontact.com On Mon, Jun 2, 2014 at 7:25 PM, Chris Bedford ch...@buildlackey.com wrote: Yes.. if i used

Is there any way for my application code to get notified after it gets deserialized on a worker node and before spouts/bolts are opened/prepared ?

2014-06-01 Thread Chris Bedford
it in production.. but during testing/development it helps catch bugs]. -- Chris Bedford Founder Lead Lackey Build Lackey Labs: http://buildlackey.com Go Grails!: http://blog.buildlackey.com

Best way to get JMX access to storm metrics for spout tuples emitted / acked | bolt tuples emitted, latency etc.

2014-03-17 Thread Chris Bedford
Hi, I'm interested in getting metrics via JMX on not onlycontainer level factors (such as # of garbage collects, heap usage,etc.), but also metrics that describe how spouts and bolts are performing (e.g., # of tuples emitted, # transferred -- the same kind of stuff that the storm UI

Re: Best way to get JMX access to storm metrics for spout tuples emitted / acked | bolt tuples emitted, latency etc.

2014-03-17 Thread Chris Bedford
. Michael Rose (@Xorlev https://twitter.com/xorlev) Senior Platform Engineer, FullContact http://www.fullcontact.com/ mich...@fullcontact.com On Mon, Mar 17, 2014 at 6:21 PM, Chris Bedford ch...@buildlackey.comwrote: Hi, I'm interested in getting metrics via JMX on not onlycontainer

when running a negative test that forces exception in my spout i find that the JVM abruptly exits. Any way to intercept this ?

2014-03-17 Thread Chris Bedford
Hi there.. I tried writing a negative testng test which starts my topology in local mode, then submits it. I provide parameters that deliberately cause my code called by my spout to choke and throw a RuntimeException. This causes my test runner (maven's surefire) to complain that The forked

Wondering where my System.out.println()'s go, also why can't i see results of logging at error() level to my class's slf4j logger

2014-03-06 Thread Chris Bedford
); TopologyBuilder builder = new TopologyBuilder(); etc. etc. the rest is the same as the 'stock version.. -- Chris Bedford Founder Lead Lackey Build Lackey Labs: http://buildlackey.com Go Grails!: http://blog.buildlackey.com