Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/1099#discussion_r202812681
--- Diff: metron-platform/metron-parsers/README.md ---
@@ -82,6 +82,12 @@ topology in kafka. Errors are collected with the
context of the error
(e.g. stacktrace) and original message causing the error and sent to an
`error` queue. Invalid messages as determined by global validation
functions are also treated as errors and sent to an `error` queue.
+
+Multiple sensors can be aggregated into a single Storm topology. When this
is done, there will be
+multiple Kafka spouts, but only a single parser bolt which will handle
delegating to the correct
--- End diff --
what *is* the intermediate kafka step? That is what is confusing me.
My understanding is that for each sensor you reference it will build a
spout for that sensor parser topic, and then pass everything from those to this
bolt, which will call the right parser and output to.... I'm not sure.
Why have to have a sensor specific topic at all?
---
