Re: Some bolts stop processing after a while.

2016-08-20 Thread Ganesh Chandrasekaran
I have had these painful issues with multilang protocol in php. I would see php processes running on linux machine supervisors but they would stop processing with no errors. This is why nimbus would not re-assign either. I had spent several operational hours debugging with luck and t even

Re: AMQP spout gets stuck

2016-08-20 Thread Ganesh Chandrasekaran
I have experienced a similar issue with AMQP on 0.9.3 and it was related to some netty issue which were solved on 0.9.4. We upgraded to that version and it fixed the issue. I would highly recommend using 0.9.4 (or 0.9.6 which is my latest version that I am using with AMQP). It has been stable

Re: Aw: RE: Re: Re: Split Kafka JSON String

2016-05-24 Thread Ganesh Chandrasekaran
You have to access the 0th index for the string… and then perform the operations to get the values public void execute(Tuple tuple) { String tupleString = tuple.getString(0); ….. } From: Daniela S Reply-To: "user@storm.apache.org" Date:

Storm worker crash scenario

2016-01-08 Thread Ganesh Chandrasekaran
I wanted to understand how Storm works when one of its worker crashes. SO here is the situation I ran into recently. My topology is distributed across 2 workers with a total of 6 threads. Somehow 3 threads died because one worker went down. At the same time nimbus service was also down because

RE: Netty reconnect

2015-09-03 Thread Ganesh Chandrasekaran
AWS m4.xlarge instances for ZooKeeper and Nimbus * 4X AWS m4.xlarge instances for Supervisors (each one with 2 workers) Thanks, Nick 2015-09-03 8:38 GMT-04:00 Ganesh Chandrasekaran <gchandraseka...@wayfair.com<mailto:gchandraseka...@wayfair.com>>: Agreed with Jitendra. We were

RE: Netty reconnect

2015-09-03 Thread Ganesh Chandrasekaran
Agreed with Jitendra. We were using 0.9.3 version and facing the same issue of netty reconnects which was the issue 404. Upgrading to 0.9.4 fixed the issue. Thanks, Ganesh From: Jitendra Yadav [mailto:jeetuyadav200...@gmail.com] Sent: Thursday, September 03, 2015 8:20 AM To:

Single message processed by multiple threads

2015-08-27 Thread Ganesh Chandrasekaran
Hi all, I am noticing a strange behavior in one of my topology. The configuration is as follows: - Using RabbitMQ for publishing/consuming messages - Single topology with 2 workers running 4 threads each (Using multilang protocol) I log messages every time a message gets

RE: Single message processed by multiple threads

2015-08-27 Thread Ganesh Chandrasekaran
@storm.apache.org Subject: Re: Single message processed by multiple threads Is your message source thread safe? It is possible for four spout threads to read the same message from the same source if the source does not guarantee uniqueness across multiple clients. On Aug 27, 2015 9:59 AM, Ganesh Chandrasekaran

RE: What happens when a message times out?

2015-07-21 Thread Ganesh Chandrasekaran
So let’s say we have a single threaded topology with single worker. Doesn’t this mean that if a my computation gets stuck at some point all the messages in the queue get blocked too? Because the fail method will be called on the queue but there is no thread to process the next message. Is that

Multilang: message timeout and tick tuple question

2015-06-09 Thread Ganesh Chandrasekaran
Hi all, I was reading the attached email thread that was discussed here before and I have few questions about message timeouts and tick tuples. I am doing some testing using 0.9.4 version and I have my topology.message.timeout.secs = 60 I have a bolt that is written using multilang protocol