Re: Storm -- Standby Datacenter for Failover

2015-08-27 Thread nitin sharma
://www.dropbox.com/s/2kcxe59zsi9nrdt/pgpsig.txt https://www.dropbox.com/s/yxvycjvlsc111bh/pgpsig.txt https://www.dropbox.com/s/ei2nqsen641daei/pgpsig.txt On Thu, Aug 27, 2015 at 9:28 PM, nitin sharma kumarsharma.ni...@gmail.com wrote: Hi All, I have been asked how can we setup a failover datacenter

Storm -- Standby Datacenter for Failover

2015-08-27 Thread nitin sharma
Hi All, I have been asked how can we setup a failover datacenter for Storm, so that if by any chance (lets say due to power outages) the complete Active datacenter becomes offline then Standby Datacenter can become alive and process the real time feeds. Does anyone have faced this kind of

Re: Too many open files exception while spinning Cassandra connections

2015-08-05 Thread nitin sharma
/installRecommendSettings.html Thanks Ajay On Tue, Jul 28, 2015 at 7:13 PM, nitin sharma kumarsharma.ni...@gmail.com wrote: HI, Has anyone worked on Storm - Cassandra setup? in my project Storm bolt will inject messages to Cassandra using Datax driver. We have observed that a single bolt executor

cassandra.remote.core.conn setting and its significance

2015-07-17 Thread nitin sharma
hi All, my topology sends messages to Cassandra... My Cassandra nodes are in different Datacenter than that of Storm.. I am not able to push more than 30 records/sec to Cassandra from Storm bolt.. I believe it is due to the limitation of cassandra.remote.core.conn cassandra.remote.max.conn

Re: is this performance number reasonable??

2015-06-05 Thread nitin sharma
Hi Fang, Can you elaborate more on what kind of testing you performed with Kafka's consumer console? Moreover, can you try creating more partitions in your kafka topics and then increase the kafka spout parallelism and see if that works? it will be great if you can paste how u are building your

How to count Tuples in each batch

2015-06-04 Thread nitin sharma
Hi All, I would like to know how many tuples are getting processed in a batch... is there a way to do so.. may be something i can code in execute() method and print in log? Regards, Nitin Kumar Sharma.

Re: STORM UI -- trident topology continuously emitting ..

2015-05-21 Thread nitin sharma
Singh nsingh.u...@yahoo.com wrote: Hi Nitin, This is normal.. there are not of control messages which are processed. Thanks Nikhil On Wednesday, May 20, 2015 2:52 PM, nitin sharma kumarsharma.ni...@gmail.com wrote: Hi Jeff, I see the counter of every bolt and spout

Re: STORM UI -- trident topology continuously emitting ..

2015-05-21 Thread nitin sharma
keep track of the metrics you need. Then you can send the metrics to that state and use drpc query or other methods to get the info you need. -Nikhil On Thursday, May 21, 2015 9:52 AM, nitin sharma kumarsharma.ni...@gmail.com wrote: Thanks Nikhil. Since Storm UI doesn't give

Re: STORM UI -- trident topology continuously emitting ..

2015-05-20 Thread nitin sharma
! + Jeff Maass maas...@gmail.com linkedin.com/in/jeffmaass stackoverflow.com/users/373418/maassql + On Wed, May 20, 2015 at 1:35 PM, nitin sharma kumarsharma.ni...@gmail.com wrote: Hi All, I am looking at STORM UI to analyze the performance of my trident topology

Storm Trident Topology -- ParallelismHint

2015-04-29 Thread nitin sharma
Hi Team, I am trying to understand ParallelismHint in Trident Topology but somehow not getting anywhere close.. It will be great if someone can help me Also, kindly explain the difference between MasterCorrdinator and SpoutCoordinator... Things that i have tried so far: a. I created a