RE: Dynamic Properties Revisited

2014-05-16 Thread King, Craig A.
David, Sorry... missed the Zookeeper part of your response. I will look into that. I went to the archaius wiki, and the first configuration source that it mentioned was JDBC... so I got hung up on that. I will check out the Zookeeper module. Craig From:

Re: Tuples lost in Storm 0.9.1

2014-05-16 Thread 李家宏
I am running into the same issue. Where do the lost tuples gone ? If they were queueing in the transport layer, the memory usage should keep increasing, but I didn't see any noticeable memory leaks. Does storm have the guarantee all tuples sent from task A to task B will be received by task B ?

Re: Weirdness running topology on multiple nodes

2014-05-16 Thread P. Taylor Goetz
Hi Justin, Can you share your storm.yaml config file? Do you have any firewall software running on any of the machines in your cluster? - Taylor On May 7, 2014, at 11:11 AM, Justin Workman justinjwork...@gmail.com wrote: We have spent the better part of 2 weeks now trying to get a pretty

Re: How/where to specify Workers JMX port?

2014-05-16 Thread Robert Turner
The range of worker ports is defined in the storm.yaml as follows: supervisor.slots.ports: - 6700 - 6701 - 6702 - 6703 Cheers Rob. On 8 May 2014 15:03, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hi, Where/how does one specify the JMX port range Storm should use

Nimbus dies

2014-05-16 Thread Krzysztof Sadowski
Let's imagine the following scenario: - machine with one supervisor goes down - machine with nimbus goes down Right now, because some workers go down as well, a few queues are not drained properly, what causes that these queues are continuously increasing in size. To avoid this situation

Re: Storm Scaling Issues

2014-05-16 Thread Bert Corderman
how many ackers? make sure this is set to number of workers. what do you have for max spout pending? we configured to have 5-10 seconds of messages in pending state. (divide 5-10 seconds by avg tuple processing time) Bert On Wed, May 14, 2014 at 4:35 PM, Lasantha Fernando

Re: Weirdness running topology on multiple nodes

2014-05-16 Thread Derek Dagit
That is odd. I have seen things like this happen when there are DNS configuration issues, but you have even updated /etc/hosts. * What does /etc/nsswitch.conf have for the hosts entry? This is what mine has: hosts: files dns I think that the java resolver code honors this setting, and

[VOTE] Storm Logo Contest - Round 1

2014-05-16 Thread P. Taylor Goetz
This is a call to vote on selecting the top 3 Storm logos from the 11 entries received. This is the first of two rounds of voting. In the first round the top 3 entries will be selected to move onto the second round where the winner will be selected. The entries can be viewed on the storm

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-16 Thread Brian O'Neill
#10 - 5 pts (Logo Entry No. 10 - Jennifer Lee) -brian --- Brian O'Neill Chief Technology Officer Health Market Science The Science of Better Results 2700 Horizon Drive € King of Prussia, PA € 19406 M: 215.588.6024 € @boneill42 http://www.twitter.com/boneill42 € healthmarketscience.com

RE: [VOTE] Storm Logo Contest - Round 1

2014-05-16 Thread Martin, Nick
#9 - 3 pts. #3 - 2 pts. Great work everybody! Tough to pick... -Original Message- From: P. Taylor Goetz [mailto:ptgo...@gmail.com] Sent: Thursday, May 15, 2014 12:28 PM To: d...@storm.incubator.apache.org; user@storm.incubator.apache.org Subject: [VOTE] Storm Logo Contest - Round 1

Storm: How to emit top 5 word count every 5 minutes ?

2014-05-16 Thread yogesh panchal
Hi, is it possible to emit top 5 word count every 5 minute in storm word count example ? -- Thanks Regards Yogesh Panchal

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-16 Thread Benjamin Black
#11 - 5 pts On Fri, May 16, 2014 at 7:43 AM, Brian O'Neill b...@alumni.brown.eduwrote: #10 - 5 pts (Logo Entry No. 10 - Jennifer Lee) -brian --- Brian O'Neill Chief Technology Officer Health Market Science The Science of Better Results 2700 Horizon Drive € King of Prussia, PA €

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-16 Thread Robert Turner
#6 - 5 pts Rob Turner. On 15 May 2014 17:28, P. Taylor Goetz ptgo...@gmail.com wrote: This is a call to vote on selecting the top 3 Storm logos from the 11 entries received. This is the first of two rounds of voting. In the first round the top 3 entries will be selected to move onto the

Re: Storm Scaling Issues

2014-05-16 Thread Nathan Leung
Hi, Is your logging set to debug? If you get a lot of log messages that can slow you down. How fast is your network? Do you need fields grouping on your bolt? (it looks like yes but can be worthwhile to re-evaluate whether this is the case). You can try the following: 1) run with just

[Tuple loss] in Storm-0.9.0.1

2014-05-16 Thread 李家宏
I am running storm-0.9.0.1 with zmq as transport layer, and I set zmq.hwm = 2000 to avoid significant memory leaks, Also I disableed ackers. I found from UI that some components executed much less tuples than being transferred to them. Let's say, a topology looks like this : componentA -

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-16 Thread Brian Enochson
#10 - 3 Points. #1 - 1 Point #2 - 1 Point Thanks, Brian On Thu, May 15, 2014 at 12:28 PM, P. Taylor Goetz ptgo...@gmail.com wrote: This is a call to vote on selecting the top 3 Storm logos from the 11 entries received. This is the first of two rounds of voting. In the first round the top 3

Re: Recovering From Zookeeper Failure

2014-05-16 Thread Ryan Chan
Hi Josh We are having the same issue for long time, and only solution is restart the whole storm cluster. (Actually I have asked the same question on 12 May but got no response.) In the meantime, we are currently evaluating switch to Apache Spark for streaming, you might also have a look.

unsubscribe

2014-05-16 Thread eric perler
unsubscribe

RE: Multiple Storm components getting assigned to same worker slot despite of free slots being available

2014-05-16 Thread Simon Cooper
EvenScheduler doesn't seem to do the trick. I've set the scheduler to be EvenScheduler, but the two topologies we've got are still being assigned to the same supervisor, when there's 3 possible supervisors to assign to. It's hard to tell what exactly EvenScheduler is doing, is there some

Received commit for different transaction attempt

2014-05-16 Thread Andrew Neilson
Could someone help me understand the context under which this error might occur? I'm seeing this pop up in one of our topologies running with Trident on Storm v0.9.0.1 and it is unable to recover once this happens. java.lang.RuntimeException: backtype.storm.topology.FailedException: Received

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-16 Thread Jason Jackson
#10 - 5 points. On Fri, May 16, 2014 at 1:34 PM, Brian Enochson brian.enoch...@gmail.comwrote: #10 - 3 Points. #1 - 1 Point #2 - 1 Point Thanks, Brian On Thu, May 15, 2014 at 12:28 PM, P. Taylor Goetz ptgo...@gmail.comwrote: This is a call to vote on selecting the top 3 Storm logos

Re: Kryo

2014-05-16 Thread Michael G. Noll
And to add to what Osman said, the upcoming Storm 0.9.2 version will be using Kryo 2.21. There are two main reasons: first, Kryo 2.21 fixes potential data corruption issues of prior Kryo versions; second, updating to 2.21 syncs Storm's Kryo dependency with other, nice to have libraries for data

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-16 Thread Srinath C
#10 - 5 points On Sat, May 17, 2014 at 6:18 AM, Jason Jackson jasonj...@gmail.com wrote: #10 - 5 points. On Fri, May 16, 2014 at 1:34 PM, Brian Enochson brian.enoch...@gmail.com wrote: #10 - 3 Points. #1 - 1 Point #2 - 1 Point Thanks, Brian On Thu, May 15, 2014 at

Storm IPv6 supported when using hostnames?

2014-05-16 Thread Gerrit van Doorn
Hi, The storm website states that Storm does not support IPv6 ( http://storm.incubator.apache.org/documentation/Troubleshooting.html). However, I got the impression from other sources ( https://issues.apache.org/jira/browse/STORM-192?jql=project%20%3D%20STORM%20AND%20text%20~%20ipv6 and