Re: storm use case questions

2014-09-03 Thread Yuheng Du
Hi all, Thanks. Does anyone use Storm to deal with sensor network data? I need some use cases or research project ideas of Storm or other big data tools in sensor network field. Can I get a sense of what the advantage of adopting Storm platform? Best, On Wed, Sep 3, 2014 at 4:51 AM, Tian Guo w

Re: storm use case questions

2014-09-03 Thread Tian Guo
Hi, All Regarding the average and standard deviation of a stream from a specific sensor, these two variables can be computed incrementally and take constant time to update. So, I do not see the burden even if the implementation is trivial. And the distributed stream processing looks like redundant

Re: storm use case questions

2014-09-03 Thread Vikas Agarwal
Hi Yuheng, We are also exploring/implementing for analyzing stream of messages (twitter stream and other sources). With my short experience, one thing I came know is that a lot would depend on the parallelism of the spouts in your topology, so you can parallelize the ingestion of data using partit

storm use case questions

2014-09-02 Thread Yuheng Du
Hi guys, I have a stream of sensor data coming from rabbitmq. For each sensor message, it is of the JSON format and have the following fields: deviceId: "BOT-N3" reading0: 2.25 reading1: 3.78 readingN: -1.35 each float number of readingN represents a sensor reading on a specific field locat