RE: Topology gets stuck

: Topology gets stuck Are you seeing any failed tuples at the spout? The replaying of the tuples seems to indicate to me that the bolts have not acked your tuples, either because of a timeout, or an exception... 2016-06-09 12:52 GMT-04:00 Nitin Gupta mailto:nitin.gu...@e-zest.in>>: Fe

RE: Topology gets stuck

. However there can be a problem in production where in the messages in the queue increases and for some reason the topology doesn’t process these messages. The topology should at least start processing from the last commit offset after restart. From: Nitin Gupta [mailto:nitin.gu...@e-zest.in

RE: Topology gets stuck

@storm.apache.org Subject: Re: Topology gets stuck Nitin, Could you check your configuration for message timeout seconds to see it's set to enough amount of time, and also check there're failing tuples at that time? Thanks, Jungtaek Lim (HeartSaVioR) 2016년 6월 9일 (목) 오후 11:05, Nitin Gupta mailt

RE: Topology gets stuck

repeating but the consumer offset in the zookeeper is not updated. I will check if it is possible to move to a new version of storm as the system is already in production. Thanks & Regards, Nitin Gupta From: Abhishek Agarwal [mailto:abhishc...@gmail.com] Sent: Thursday, June 09, 2016 7:26 PM To:

RE: Topology gets stuck

then stop for a few minutes and repeats the same process. The rate at which the messages are being written is very high . So the lag is very high . Not sure if the KafkaSpout stops processing after a specific number of messages pending to be processed. Thanks & Regards, Nitin Gupta

Topology gets stuck

facing this problem from quite few days. Any help will be highly appreciated. Thanks & Regards, Nitin Gupta

Offset not updated in Zookeeper

. Should I move to BaseRickBolt and do an explicit ack so that the offset are written back to the Zookeeper. Thanks & Regards, Nitin Gupta

RE: Storm Topology Hanging

show any messages on why the KafkaSpout has stopped picking the messages from the queue . Is there any other place when we can get more information on this. Thanks & Regards, Nitin Gupta From: Alexander T [mailto:mittspamko...@gmail.com] Sent: Thursday, April 07, 2016 1:13 PM To:

RE: Storm Topology Hanging

I checked the worker log files and found there is no specific exception. It looks the KafkaSpout just stops picking the records from kafka queue. Any pointers? From: Nitin Gupta [mailto:nitin.gu...@e-zest.in] Sent: Wednesday, April 06, 2016 1:30 PM To: user@storm.apache.org Subject: RE: Storm

RE: Storm Topology Hanging

Drive, Box,DropBox etc). I can split the work into 3 topologies. But wanted to know is latency the root cause for the hang. I will check if the worker stacktrace can be shared. Thanks ! Nitin Gupta From: Jungtaek Lim [mailto:kabh...@gmail.com] Sent: Wednesday, April 06, 2016 1:15 PM To: user

Storm Topology Hanging

ne please guide me what should the correct value in my case. Thanks & Regards, Nitin Gupta

Extending Kafka Spout

them directly. The only way is to create a package by the same name where the KafkaSpout is placed . Thanks & Regards, Nitin Gupta

RE: Storm for long processing

/2014/09/apache-storm-apache-spark/. Hope it will help. Sincerely, Fan Jiang 2015-04-06 9:24 GMT-04:00 Nitin Gupta mailto:nitin.gu...@e-zest.in>>: Hi All, We are planning to use Storm for retrieving data for users from an external system which sometimes takes 5 to 10 mins. Is it recommen

Storm for long processing

Hi All, We are planning to use Storm for retrieving data for users from an external system which sometimes takes 5 to 10 mins. Is it recommended to use Storm for such long running processes? Thanks & Regards, Nitin Gupta