Prashanth, Storm seems to be more focused on data flow between Storm processors (spout? bolt? i forget). My particular use case follows this pattern:
* read id from kafka queue * fetch object from database * modify the object * write back to database Would Storm be a good fit for this? It doesn't seem to fit in with the whole bolt/spout pattern. It's more like a distributed task queue. Thoughts? On Nov 8, 2012, at 10:45 AM, Prashanth Menon wrote: > Yup, I believe Storm as a KafkaSpout that you can use. Is there something > specific you were interested in? > > On Thu, Nov 8, 2012 at 10:32 AM, David Arthur <mum...@gmail.com> wrote: > >> There is a line item on the project ideas for "improved stream processing >> libraries". I was wondering if anyone has done any work on this. I know you >> can hook Kafka into things like Storm and S4(?), but I'm not looking for a >> CEP/dataflow thing, just distributed stream processing >> >> -David
