Re: programmatically call rebalance

2014-10-07 Thread Gahl Rinat
An Amazon engineer asking questions about Storm. -Gahl -- Forwarded message -- From: Raphael Hsieh raffihs...@gmail.com Date: Tue, Oct 7, 2014 at 12:27 AM Subject: programmatically call rebalance To: u...@storm.incubator.apache.org Is there an api or some way to

Re: Automatic throttling of spout

2014-10-07 Thread Jan Sipke van der Veen
Thanks for your reply Nathan. I have experimented a bit more with this topology and have now set the topology.max.spout.pending to a fixed value that makes sense for the topology. I still see some strange behavior however. The cluster consists of four Storm worker nodes with two processor cores

Is storm a good choice for our architecture?

2014-10-07 Thread Albert Vila
Hi I just came across Storm when I was trying to find solutions to scale our current architecture. We are currently downloading and processing 6M documents per day from online and social media. We have a different workflow for each type of document, but some of the steps are keyword extraction,

Re: Storm Error while submitting topology Failed to get local hostname java.net.UnknownHostException: xx-xxx-xxx-xxx: xxx-xxx-xx-xx

2014-10-07 Thread Spico Florin
Hello! I have found the issue. The wrong IP was set up in the /etc/hostname. On the ubuntu OS, after changing it with command hostnamectl, the problem has gone. Hope that this help others that will face the same issue. Regards, Florin On Tue, Oct 7, 2014 at 11:17 AM, Spico Florin