When i set TOPOLOGY_TICK_TUPLE_FREQ_SECS into my Storm config, I get Non-system tuples should never be sent to __system bolt

2014-06-19 Thread Chris Bedford
Hello, Storm experts: I'm trying to use the system 'ticks' in Storm by setting TOPOLOGY_TICK_TUPLE_FREQ_SECS and then acting on the received tick tuples. However, I find that when I set TOPOLOGY_TICK_TUPLE_FREQ_SECS into the config of even a very very simple topology (one dummy spout that just

RE: Extracting Performance Metrics

2014-06-19 Thread Dan
This post from Gil Tene sums up the Metrics package's issues with measuring latency well: https://groups.google.com/forum/#!msg/mechanical-sympathy/I4JfZQ1GYi8/LKc3MYXRGWUJ Date: Mon, 16 Jun 2014 19:00:30 -0600 Subject: RE: Extracting Performance Metrics From: mich...@fullcontact.com To:

storm clickstream capture and process

2014-06-19 Thread Troy X
Hi Experts, I'm fairly new to complex event processing, I'm trying to assess if its the right way of doing it. I would be glad if you can provide feedback I wonder if I can process user interactions on our website ( session start, page clicks / clickstreams, time spent in each section of

Re: v0.9.2-incubating and .ser files

2014-06-19 Thread P. Taylor Goetz
Hi Andrew, Thanks for pointing this out. I agree with your point about bit rot. However, we had to remove the the 0mq transport due to license incompatibilities with Apache, so any kind of release test suite would have to be maintained outside of Apache since it would likely pull in

Re: v0.9.2-incubating and .ser files

2014-06-19 Thread Andrew Montalenti
FYI, the issue happened with both zmq and netty transports. We will investigate more tomorrow. We think the issue only happens with more than one supervisor and multiple workers. On Jun 19, 2014 7:32 PM, P. Taylor Goetz ptgo...@gmail.com wrote: Hi Andrew, Thanks for pointing this out. I agree

Re: getting tuple by messageId

2014-06-19 Thread Bongyeon Kim
AFAIK, You have to fetch again by messageID. You can put tuple into your messageID, but I don’t think it’s a good way. If you want to achieve exactly-once messaging semantics, why don’t you use Trident? On Jun 19, 2014, at 2:16 PM, 이승진 sweetest...@navercorp.com wrote: Hi all, I'm using

Re: v0.9.2-incubating and .ser files

2014-06-19 Thread P. Taylor Goetz
Okay. Keep me posted. I still plan on looking at and testing your patch to storm-0mq, but probably won't get to that until early next week. -Taylor On Jun 19, 2014, at 7:43 PM, Andrew Montalenti and...@parsely.com wrote: FYI, the issue happened with both zmq and netty transports. We will

Re: How to update a running Storm Topology

2014-06-19 Thread Nishu
Thanks Nathan, it worked out.. On Wed, Jun 18, 2014 at 6:23 PM, Nathan Leung ncle...@gmail.com wrote: If you kill a topology in the ui, you will notice that sometimes it takes awhile for it to clear and go away. If you try to reload the topology during this time you will get the same