unsubscribe

Re: hdfsbolt in secure cluster failing with

Can you share your topology config with us? Excuse typos On Feb 16, 2016 1:07 PM, "Raja.Aravapalli" wrote: > > Hi, > > I have a hdfs bolt in my storm topology, it is running perfectly fine for > some time, but suddently it is failing with SASL security exceptions!! >

Re: Is SpoutOutputCollector thread-safe?

It is not thread safe in 0.9.4. It is thread safe in later versions (0.10.0 onwards) Excuse typos On Feb 16, 2016 11:01 PM, "Evgeniy Khyst" wrote: > Hello! > > I'm currently using Apache Storm 0.9.4 and have question about > thread-safety of *SpoutOutputCollector*. Is

Re: localOrShuffleGrouping load balanced tuple distribution

We are working on way to try to improve this by having the grouping be aware of the load downstream and try to route tuples locally unless it is overloaded and then send them remotely.  - Bobby On Tuesday, February 16, 2016 8:27 AM, Nathan Leung wrote: My guess is

Re: localOrShuffleGrouping load balanced tuple distribution

My guess is this only happens because you have one executor per worker so nothing is local to the spout anyways. If your component has number of executors less than your number of workers it's often better to use shuffle grouping. In your two worker example, half the tuples would stay local

Re: localOrShuffleGrouping load balanced tuple distribution

Hi, Nathan! Thank you for your answer. You are right: the only bolts that are used will be the ones located nearby the spout. The other two will be unused. If we increase the number of workers to 5, then it will behave as shuffleGrouping (distributing evenly among the bolts). I got it!