Storm deploy time lifecycle hook?

Hey! I have a question about the storm topology lifecycle. Are there any hooks in the storm deployment/topology lifecycle? Basically I'd be great if there was a way to run a block of code during deployment of a new topology that got fired once on each JVM. The issue we've seen so far is when

Re: Need Help regarding topology with numWorker>1

Topology param numWorkers i meant On Thursday, 11 February 2016, Rudraneel chakraborty < rudraneel.chakrabo...@gmail.com> wrote: > More specifically , i have seen a topology performs better if it is > assigned a single worker compared to more than one worker. > > I want a situation where a

Re: Need Help regarding topology with numWorker>1

I am not sure what you mean: - number of worker slots per supervisor or - topology parameter "number of workers" Can you clarify? -Matthias On 02/11/2016 05:14 AM, anshu shukla wrote: > Not like that.. But i have used workers equal to number of cores. Each > vm with 8 corea. > > On 11

Re: Need Help regarding topology with numWorker>1

More specifically , i have seen a topology performs better if it is assigned a single worker compared to more than one worker. I want a situation where a topology performs better with more than one worker. And it doesnt matter if both workers are on same supervisor or different supervisor On

Re: Need Help regarding topology with numWorker>1

Any situation where you require more CPU than 1 server can provide for you - there are tuning parameters (e.g. localOrShuffleGrouping) that you can use to reduce the amount of data sent over the network too. Any situation where you need to have tolerance in case of machine failure. On Thu, Feb

Storm DRPC servers load balancing

Hi everybody, I’m trying to find out how to scale Storm DRPC server. As far as I can see from the documentation I can start several DRPC servers and configure my slaves to know about them: drpc.servers: - "drpc1.foo.com" - "drpc2.foo.com" On the other hand java client can connect only

unsubscribe

Re: Storm deploy time lifecycle hook?

you can try using Hooks API http://storm.apache.org/documentation/Hooks.html; add desired block of code which is supposed to run when topology is started inside prepare() method. On Thu, Feb 11, 2016 at 3:15 PM Stephen Powis wrote: > Hey! > > I have a question about the

unsubscribe

worker cannot download topology from Nimbus

Hi, I am really stuck with this problem. Could someone tell why storm workers cannot download the topology folder from /storm_working_dir/nimbus/stormdist folder while I run the topology? I thought it was problem as I was using windows in host computer and Ubuntu in the cloud. Now that I have

Re: worker cannot download topology from Nimbus

Are you able to telnet to nimbus m/c 127.214.99.215:6627 from the machine where this supervisor is running? Can you confirm it once? Excuse typos On Feb 11, 2016 10:25 PM, wrote: > Hi, > > I am really stuck with this problem. Could someone tell why storm workers >

Re: Alerting on Topology Error

I have written a tool which can can email errors seen in last x minutes. It is not on public repo right now. I will put it up and let you know. Check out nimbus rest API, using which you can build such tools easily Excuse typos On Feb 11, 2016 12:44 PM, "Sudip Hazra Choudhury"

ApacheCon NA 2016 - Important Dates!!!

Hello everyone! I hope this email finds you well.  I hope everyone is as excited about ApacheCon as I am! I'd like to remind you all of a couple of important dates, as well as ask for your assistance in spreading the word! Please use your social media platform(s) to get the word out! The more