Re: Tuples lost in Storm 0.9.1

+08:00 李家宏 jh.li...@gmail.com: I am running into the same issue. Where do the lost tuples gone ? If they were queueing in the transport layer, the memory usage should keep increasing, but I didn't see any noticeable memory leaks. Does storm have the guarantee all tuples sent from task A to task

Re: Tuples lost in Storm 0.9.1

I am running into the same issue. Where do the lost tuples gone ? If they were queueing in the transport layer, the memory usage should keep increasing, but I didn't see any noticeable memory leaks. Does storm have the guarantee all tuples sent from task A to task B will be received by task B ?

[Tuple loss] in Storm-0.9.0.1

I am running storm-0.9.0.1 with zmq as transport layer, and I set zmq.hwm = 2000 to avoid significant memory leaks, Also I disableed ackers. I found from UI that some components executed much less tuples than being transferred to them. Let's say, a topology looks like this : componentA -

tuple loss

I am running storm-0.9.0.1 with zmq as transport layer, and I set zmq.hwm = 2000 to avoid significant memory leaks, Also I disableed ackers. I found from UI that some components executed much less tuples than being transferred to them. Let's say, a topology looks like this : componentA -

[storm-build-release]How to build storm release with maven

hi, all How to build a storm release from source code(=0.9.1) with maven ? Thansk -- == Gvain Email: jh.li...@gmail.com

Repost: [storm-netty]-too many open files exceptions

Hi, all I'm running a topology on storm cluster of 0.9.0.1 with netty as transport layer, this error occurs : Netty client failed to create a selector due to* too many open files exception*, the worker continuously halting with initialization error. I checked the ulimit -n( 13) which is much

Re: Netty Client failed to create a selector : too many open files

Also, the topology works fine on storm cluster of 0.9.0.1 with zmq as message transport layer. I guess netty must be the problem. Regards 2014-03-05 10:56 GMT+08:00 李家宏 jh.li...@gmail.com: Hi, all I'm running a topology on storm cluster of 0.9.0.1 with netty as transport layer, this error

Worker Halting: too many open files

hi, all When I submit a topology to a storm cluster of 0.9.0.1, the following error occurs: -- [INFO] Starting 2014-03-04 20:24:13 o.a.z.ZooKeeper [INFO] Initiating client

Re: Netty Errors, chain reaction, topology breaks down

Seems like We are facing the same problem : a negative timeout value exception was thrown from storm-netty-client. We are heading back to zmq. Regards 2014-03-05 9:59 GMT+08:00 Richards Peter hbkricha...@gmail.com: Thanks Drew and Ted, Richards Peter. --

Re: Kafka Spout StaticHost, ZkHosts, Partitions Per Host

/brokers stands for the path in Kafka zookeeper; Using StaticHosts u directly get information from these StaticHosts(brokers), it is not extensive as brokers may change for some reason. Using ZkHosts u can dynamicly discover information about Kafka cluster(AKA brokers) by reading ZkPath(most

Re: Large binary payloads with storm

the byte array in storm.py it throws a json error when trying to parse the tuples. I didn't have time to look into it further as I am new to storm and python. On Saturday, January 11, 2014, 李家宏 wrote: There is no need to serialize binary data, just send it as it. As by defalut storm-0.9.0 use kryo

Is storm suitable for processing tuples with some dependency

Hi, all Is storm suitable for processing tuples with some dependency ? For example, a tuple contains a request, another tuple contains corresponding response, the two tuples are depended on each other. Is that possible to take the two tuples as a complete session while stream processing. Regards

Re: Large binary payloads with storm

I come up with this problem as well. I am considering using storm with real time ip packet processing. Regards, Gvain 2014/1/10 Lochlainn Wilson lochlainn.wil...@gmail.com Hi all, I am new to Storm and have been tasked with determining whether it is feasible for us to use Apache storm in