Re: machine reboot

2020-02-24 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
and assuming everything works fine (somehow it's not) I guess some assumptions above about Storm continues to work is wrong, what is the best practice or recommended way for our situation? Thanks, zainal From: rui.ab...@gmail.com At: 02/21/20 18:01:56To: Zainal Arifin (BLOOMBERG/ 731 LEX )

Re: machine reboot

2020-02-21 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
Thanks Rui! Can I force the rebalance from a script? I am thinking to add in my current script, after it starts Storm, and checks if the topology is running. If yes, what would be the command or API? From: rui.ab...@gmail.com At: 02/21/20 16:48:53To: Zainal Arifin (BLOOMBERG/ 731 LEX

machine reboot

2020-02-21 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
Hi, We run Storm on 2 machines (let's call it machine A and B), and everything works fine. Then I want to test the machine being reboot, so basically when the machine being brought down, it'll call my script to stop Storm, and when the machine back up, it called my script to start Storm. From m

using dns instead of machine names in nimbus.seeds

2020-02-21 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
Hi, Will it work if I replace list of machines in nimbus.seeds config, with a single DNS name? I guess that won't work, but I want to check it first. Thanks!

Re:page not found error

2020-02-18 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
Never mind. The UI now works fine again, after I restart Storm on the cluster. I still don't know why it could go into that state earlier, and unfortunately nothing in the log file that can help me uncover the mystery. From: user@storm.apache.org At: 02/17/20 11:19:31To: user@storm.apache.org S

page not found error

2020-02-17 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
Hi, I don't know what's going on but last week this was working fine. I can open Chrome browser and type dev machine url with port 8080, i.e. http://foobar:8080, and it'll redirect to http://foobar:8080/index.html and showing the Storm UI. However, now I always got error "Page not found" :-( I lo

Re: question on deactivate and kill

2020-01-15 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
-workers From: user@storm.apache.org At: 01/15/20 09:58:08To: Zainal Arifin (BLOOMBERG/ 731 LEX ) , user@storm.apache.org Subject: Re: question on deactivate and kill Deactivating a topology means the spouts stop consuming, but everything else continues to work as expected, meaning your bolts

question on deactivate and kill

2020-01-15 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
Hi, Right now we have a bolt task that is in back log, i.e. ~10 hours behind processing the data. There was a bug and we have the fix which will speed up drastically. I think if I kill the topology (to deploy the fix), I will definitely lose those events been processed by the bolt, is that correc

unsubscribe

2019-11-12 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)

reset storm data in zookeeper

2019-09-05 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
Hi, I got this error when browsing Storm UI: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts ["dev-dob1-tmon-machine-01.foo.dns.com" "dev-dob1-tmon-machine-02.foo.dns.com" "dev-dob1-tmon-machine-03.foo.dns.com"]. Did you specify a valid list of

streamparse

2019-08-29 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
Hi, anyone is using streamparse to run python code on apache storm?

need help: storm worker keep crashing

2019-08-29 Thread Zainal Arifin (BLOOMBERG/ 731 LEX)
Hi, I wonder if anyone who ever used streamparse (for storm topology in python code), ever run into this issue I am facing right now. Unfortunately, I don't see any error from streamparse log, but I see exception below in the storm worker log. The serializer exception section seems the culprit, b