Re: Load Balancing in Storm

2016-05-13 Thread Steven Lewis
; Subject: Re: Load Balancing in Storm Hi I already know about the shuffling/grouping in storm, but the documentation says that the shuffling/grouping is part of defining the topology (i.e. before you start running the topology). What I am asking is can you define new shuffling/grouping while t

Re: Load Balancing in Storm

2016-05-13 Thread Steven Lewis
Look at how to do the shuffling/grouping for what you are asking. From: "Gharaibeh, Ammar" > Reply-To: "user@storm.apache.org" > Date: Friday, May 13, 2016 at 8:12 AM To:

Re: Getting Kafka Offset in Storm Bolt

2016-05-11 Thread Steven Lewis
It sounds like you want to use Spark / Spark Streaming to do that kind of batching output. From: Milind Vaidya > Reply-To: "user@storm.apache.org" > Date: Wednesday, May

Re: thread safe output collector

2016-04-28 Thread Steven Lewis
italpeb...@gmail.com<mailto:lists.digitalpeb...@gmail.com>> wrote: Hi Stephen I asked the same question in February but did not get a reply https://mail-archives.apache.org/mod_mbox/storm-user/201602.mbox/%3cca+-fm0urpf3fuerozywpzmxu-kdbgf-zj3wbyr8evsaqjc6...@mail.gmail.com%3E Anyone who cou

thread safe output collector

2016-04-27 Thread Steven Lewis
I have conflicting information, and have not checked personally but has the output collector finally been made thread safe for emitting in version 1.0 or 0.10? I know it was a huge problem in 0.9.5 when trying to do threading in a bolt for async future calls and emitting once it returns. This