Concurrent requests to DRPC

2015-04-16 Thread Douglas Alan
Hi. We want to make a Storm topology than handles DRPC requests, and we want the requests to be handled concurrently. I.e., if a DRPC request comes into the topology at time T0 that takes a long time to complete (let's say 100 seconds), we don't want this request to block another request that comes

Sample Monit config?

2015-02-27 Thread Douglas Alan
Hi. Does anyone have a sample Monit config file for running Storm under supervision. If not, does anyone know if Storms's Nimbus and Supervisors and Storm UI and Zookeeper write out PID files somewhere by default? If they don't, is there someway to make them do so? |>oug

Re: Do I need Kafka to have a reliable Storm spout?

2015-02-26 Thread Douglas Alan
read offset into zookeeper. In that way, if a spout task goes down it > will be able to read its offset from zookeeper after restarting. > Hope this help you. > > 2015-02-24 18:58 GMT+01:00 Douglas Alan : > > As I understand things, ZooKeeper will persist tuples emitted by bolt

Do I need Kafka to have a reliable Storm spout?

2015-02-24 Thread Douglas Alan
As I understand things, ZooKeeper will persist tuples emitted by bolts so if a bolt crashes (or a computer with the bolt crashes, or the entire cluster crashes), the tuple emitted by the bolt will not be lost. Once everything is restarted, the tuples will be fetched from ZooKeeper, and everything w