Getting error while building latest code.

2015-03-20 Thread Rashmikant Shah (rashshah)
Hello, I have downloaded latest code and trying to build it. I am getting following error. Is there anything I am missing? - rashmikant [ERROR] Failed to execute goal org.apache.maven.plugins:maven-plugin-plugin:3.0:descriptor (default-descriptor) on project storm-maven-plugins: Execution

Re: Storm-0.9.3.1

2015-03-20 Thread Vincent Russell
Just to jump in on this thread what I think Tony is talking about is that under "Topology Configuration:" any java maps that are inside of the storm config are not being broken out to show what's inside them, like {key: value, nested: {anotherkey: anotherValue}}. Now these maps just say: [object

Kafka-Storm: troubleshooting low R/W throughput

2015-03-20 Thread Emmanuel
Kafka on test cluster: 2 Kafka nodes, 2GB, 2CPUs3 Zookeeper nodes, 2GB, 2CPUs Storm:3 nodes, 3CPUs each, on the same Zookeeper cluster as Kafka. 1 topic, 5 partitions, replication x2 Whether I use 1 slot for the Kafka Spout or 5 slots (=#partitions), the throughput seems about the same. I can't se

Re: Need help with troubleshooting a worker not processing messages

2015-03-20 Thread Girish Joshi
Thanks Taylor for your response. In my case, I have seen that 4 of my 15 kafka executors do not process any data; I will check what the kafka # of partitions is but looks like it may be just 11 in which case I should reduce the number of kafka executors. around 50 of the 550 mapperBoltExecutors I

Re: How and where is TopologyContext built?

2015-03-20 Thread Ravali Kandur
Hi Taylor, Sure and Thanks for your reply. Currently, whenever a topology is submitted to storm, Acker Bolt is added without users knowing (when we need exactly once sort of sematics) correct? Similarly, I have a use case where I need to add new unique streams (without user knowing it) b

Re: Storm-0.9.3.1

2015-03-20 Thread Tony D
Thanks! That's good to know. In the Topology Configuration Section of the storm ui, it shows [Ojbect object] for some properties. For example, the accumulo-connection-defaults used to have a user name and a list of zookeepers. Now its been replaced with [Object object]. We have a yaml file, that c

Re: Storm-0.9.3.1

2015-03-20 Thread Mike Thomsen
If you mean the stats for 10 min, 3 hour, 1 day and all time, then that's normal (except the "all time" one) if the topology stops processing data. It can also be a sign that something has gone awry in the processing if you know you have a lot of data waiting in a kafka queue or something. On Fri,

Storm-0.9.3.1

2015-03-20 Thread Tony D
I have a question about the latest storm. I've upgraded my storm to 0.9.3.1, have put some data through my topologies and everything looks good. The question that I have is, in the Storm UI, after a little bit of time has passed, the stats from when I pushed data through, all go to 0. Is that norm