Monitoring Storm with Ganglia

2014-09-17 Thread Noam Cohen
Hey guys - We've just installed Storm 0.91 next to our Hadoop cluster. For Hadoop - we use Ganglia extensively to get visual representation of aggregative metrics (for example - number of bytes read in a given time, either from a certain server or from the entire cluster, etc.). This really help

Re: Decouple topology configuration from code

2014-09-17 Thread Andrew Montalenti
Storm bundles a comprehensive Clojure DSL for topology definition. In the streamparse project, we extended this DSL to make Python bolts and spouts easier to define, and the bundled streamparse CLI tool can submit Clojure DSL topologies to remote or local clusters. Some docs on this are here. http

storm bolts receiving tuples with null values

2014-09-17 Thread Vincent Russell
All, When I change my topology workers from 1 to 2 my topology starts sending tuples with null values. Is there a reason why this might happen? The tuple isn't null, but when I call getValueByField I get a null value. Is there a size limit for a tuple that I might be crossing? I'm using storm