[ANNOUNCE] Apache Storm 1.0.1 Released

2016-05-06 Thread P. Taylor Goetz
The Apache Storm community is pleased to announce the release of Apache Storm version 1.0.1. Storm is a distributed, fault-tolerant, and high-performance realtime computation system that provides strong guarantees on the processing of data. You can read more about Storm on the project website:

[ANNOUNCE] Apache Storm 0.10.1 Released

2016-05-06 Thread P. Taylor Goetz
The Apache Storm community is pleased to announce the release of Apache Storm version 0.10.1. Storm is a distributed, fault-tolerant, and high-performance realtime computation system that provides strong guarantees on the processing of data. You can read more about Storm on the project

Re: Why tuples fail in spout

2016-05-06 Thread Spico Florin
hi! can you please write the hint parallesim that you are using for each sout and bolts. there is formula on what amount on data you can have unacked nd the amound of data that you can process in your bolts. there is a good book Storm applied where this formul is explained nd asloong with

Re: [DISCUSS] Would like to make collective intelligence about Metrics on Storm

2016-05-06 Thread Adam Meyerowitz (BLOOMBERG/ 731 LEX)
I recall seeing in another thread a discussion about monitoring metrics for various queues within a worker. For us this would be pretty key for each executor input and output LMAX queue as well as the worker level input and output queues. In our topologies we run one task per executor so it

Re: Re: Is it possible to install storm on embedded devices

2016-05-06 Thread applyhhj
Ok! That is great, thank you! 2016-05-06 applyhhj 发件人:Mike Keen 发送时间:2016-05-06 19:13 主题:Re: Is it possible to install storm on embedded devices 收件人:"user@storm.apache.org" 抄送: As long as the devices support Java and Python then I don't see why

Re: Is it possible to install storm on embedded devices

2016-05-06 Thread Andrew Xor
Hello, Storm depends only on java, so in theory you could run it... but I am not so sure that the performance you'd get from a mobile device would be acceptable. I have not personally installed nor tested it on portable hardware but if it was me... I would rather avoid it. Hope this helps.

Re: Is it possible to install storm on embedded devices

2016-05-06 Thread Mike Keen
As long as the devices support Java and Python then I don't see why not. - Mike On Friday, May 6, 2016, applyhhj wrote: > Hi! > Is it possible to install storm on embedded devices, such as mobile > phone or arm based devices? If not, is there any streaming processing >

Is it possible to install storm on embedded devices

2016-05-06 Thread applyhhj
Hi! Is it possible to install storm on embedded devices, such as mobile phone or arm based devices? If not, is there any streaming processing framework specially designed for embedded devices? Thank you very much! 2016-05-06 hhj

Re: Removed storm logs

2016-05-06 Thread Spico Florin
Hi! Of course yes. Try and check. Regards, Florin On Fri, May 6, 2016 at 11:10 AM, Matthew Lowe wrote: > If you delete a worker log file that is in use, will the log be recreated > the next time a log write is called? > > Best Regards

Re: If tuples come in too fast for bolts to process, does Zookeeper keep it in a queue?

2016-05-06 Thread Spico Florin
Hi! You welcome. nextTuple and the ack method are called in the same thread by the framework. So if you have heavy computation in the next tuple, your ack method will never be called and the buffers that are responsible for receiving the ack messages will not be emptied. The nextTuple acts as

Fail then ack

2016-05-06 Thread Matthew Lowe
If you fail a tuple then ack it immediately afterward, what happens? Is this bad? Can this cause problems? Best Regards

Re: If tuples come in too fast for bolts to process, does Zookeeper keep it in a queue?

2016-05-06 Thread Navin Ipe
Thanks Florin. It does indeed seem to be a memory problem. Turns out that there were no ack's happening either because I was emitting from a while loop in nextTuple() and it never left the nextTuple() function. On Fri, May 6, 2016 at 11:59 AM, Spico Florin wrote: > Hello!