Re: Motivations for using Apache Storm?

2018-01-12 Thread Casey Stella
At the time, we chose storm because of a few reasons: - Metron inherited its codebase from OpenSOC, which chose Storm as it predated flink and spark streaming, the two other major contenders in the hadoop stack - Storm was battle tested at the time and, at least then, we had some co

Re: Motivations for using Apache Storm?

2018-01-12 Thread M. Aaron Bossert
Perhaps it might be useful for you to articulate your use case? Not to sound like a generic non-answer, but most of the streaming/CEP frameworks are pretty good, narrowing down a short list of which ones to use beyond basic requirements can be highly subjective: does your language of choice ha

Motivations for using Apache Storm?

2018-01-12 Thread Tarik Courdy
Good afternoon - I've started doing research on various stream processing frameworks and it seems like there are a ton of them out there. Out of curiosity what were the underlying motivations to go with Storm as opposed to one of the other frameworks out there? Thank you for your time.

Re: Getting Syslogs to Metron

2018-01-12 Thread zeo...@gmail.com
In Ambari under storm you can find the UI under quick links at the top. That said, the issue seems to be upstream of Metron, in NiFi. That is something I can't help with as much, but if you can share the listensyslog processor config that would be a start. Also, share the config of the thing that