Hi -
Thanks - it turns out that the JSON parsing is actually fine with HEAD,
although inaccurate without the required message format (comments mention
expecting an “s” property with timestamp value).
My problem was that I was not specifying the spout root properly, i.e.
--spoutroot
I found this blog helpful:
http://www.bigdata-cookbook.com/post/72320512609/storm-metrics-how-to
Best regards,
Tyson
On May 29, 2014, at 8:41 AM, Raphael Hsieh
raffihs...@gmail.commailto:raffihs...@gmail.com wrote:
Can someone explain to me what LoggingMetrics is ?
I've heard of it and people
Thanks Tyson!
This blog is super helpful.
I've been able to get LoggingMetrics working to an extent, however if I try
to create multiple CountMetrics in the same function, I only see one show
up in my NimbusUI. Does anybody know why this is ?
On Thu, May 29, 2014 at 8:57 AM, Tyson Norris
Hi,
On Wed, May 28, 2014 at 11:39 AM, Tyson Norris tnor...@adobe.com wrote:
Thanks Cody -
I tried the BrightTag fork and still have problems with
storm 0.9.1-incubating and kafka 0.8.1, I get an error with my trident
topology (haven’t tried non-trident yet):
(venv)tnorris-osx:stormkafkamon
Yes, Trident Kafka spouts give you the same metrics. Take a look at the
code to find out what's available.
On Wed, May 28, 2014 at 3:55 AM, Tyson Norris tnor...@adobe.com wrote:
Do Trident variants of kafka spouts do something similar?
Thanks
Tyson
On May 27, 2014, at 3:19 PM, Harsha
You can also use stormkafkamon to track this stuff. Its not good for
historical analysis like graphite/ganglia, but its good if you just want to
see how things currently stand.
The original: https://github.com/otoolep/stormkafkamon
This didn't work for us without some updates (incompatibility
Thanks Cody -
I tried the BrightTag fork and still have problems with storm 0.9.1-incubating
and kafka 0.8.1, I get an error with my trident topology (haven’t tried
non-trident yet):
(venv)tnorris-osx:stormkafkamon tnorris$ ./monitor.py --topology
TrendingTagTopology --spoutroot storm
Right, its trying to read your kafka messages and parse as JSON. See the
error:
simplejson.scanner.JSONDecodeError: Expecting value: line 1 column 1 (char
0)
If you want to use the BrightTag branch, you'll need to go a couple commits
back. Try this:
git clone
Is there a way to tell where in the kafka stream my topology is starting
from?
From my understanding Storm will use zookeeper in order to tell its place
in the Kafka stream. Where can I find metrics on this ?
How can I see how large the stream is? What how much data is sitting in the
stream and
Do Trident variants of kafka spouts do something similar?
Thanks
Tyson
On May 27, 2014, at 3:19 PM, Harsha st...@harsha.io wrote:
Raphael,
kafka spout sends metrics for kafkaOffset and kafkaPartition you can
look at those by using LoggingMetrics or setting up a ganglia. Kafka uses
10 matches
Mail list logo
