Re: Apache Storm Graduation to a TLP

2014-09-22 Thread padma priya chitturi
Good news !!! Congrats On Tue, Sep 23, 2014 at 10:04 AM, Cheng Chen chengc0...@gmail.com wrote: great news! On Mon, Sep 22, 2014 at 9:33 PM, Vikas Agarwal vi...@infoobjects.com wrote: Great! On Tue, Sep 23, 2014 at 2:46 AM, P. Taylor Goetz ptgo...@gmail.com wrote: I’m pleased

Re: storm use case in sensor data

2014-09-05 Thread padma priya chitturi
If the data is emitted in terms of streams continuously from a sensor then Storm would be the ideal framework to process the data. Storm infact lets you process streams of data in real time. To get brief overview go through documentation over storm. https://storm.incubator.apache.org/ On Thu,

Re: Storm submit problem

2014-08-08 Thread padma priya chitturi
Have u started nimbus , supervisor and zookeeper ? On Fri, Aug 8, 2014 at 11:07 AM, ​Chandrahas Gurram chandraha...@peel.com wrote: Hi, I am trying to submit my jar to nimbus using the command storm jar pathtofile mainclassname arguments. it is throwing connection refused error. can anyone

Re: Very high memory usage in one worker process

2014-08-05 Thread padma priya chitturi
to the specific details to look for..? Vladi On Tue, Aug 5, 2014 at 8:28 AM, padma priya chitturi padmapriy...@gmail.com wrote: Can you share with us the worker logs. --Padma Ch On Tue, Aug 5, 2014 at 12:21 AM, Vladi Feigin vladi...@gmail.com wrote: Hi, Recently we observed very strange

Windowing queries on storm

2014-08-04 Thread padma priya chitturi
Hi, I wanted to process streams in wondow of size say 'n' for every 't' sec. Does storm has inbuilt API's which support such scenarios of handling streams in a window ? Regards, Padma Ch

Re: Is it possible to start a supervisor/nimbus programmatically

2014-05-22 Thread padma priya chitturi
No, thers is no API to start the daemons. Infact u can place the commands that would invoke the daemons in a separate file and could invoke it using either java or python On Thu, May 22, 2014 at 6:56 PM, Sajith sajith...@gmail.com wrote: Hi all, Is it possible to start supervisor or a nimbus

Re: Performance metrics in storm

2014-05-19 Thread padma priya chitturi
/sending-metrics-from-storm-to-graphite/ Best, Michael On 01/30/2014 01:23 PM, padma priya chitturi wrote: Hi All, I wanted to justify the performance of storm by considering various metrics/counters. What could be various tools that can give graphical representation of the metrics like

Re: Running topology from supervisor node

2014-05-07 Thread padma priya chitturi
Hi, There is no harm in submitting topology from supervisor node. It would run successfully. Verify if zookeeper and nimbus are running on the other nodes. On Tue, May 6, 2014 at 2:51 PM, Bilal Al Fartakh alfartaj.bi...@gmail.comwrote: can I run topology form a supervisor node because when

Re: Doubts on Apache Storm

2014-05-06 Thread padma priya chitturi
Hi, Below are my inline comments: Does Apache storm supports cluster environment. If yes, does it supports load balancing as well? Yes, storm can be deployed in cluster environment. It supports load balancing too by distributing the task over cluster nodes. Is there any dependancy

Re: duplicated result

2014-05-06 Thread padma priya chitturi
Hi, The issue lies with the number of tasks/executors specified for spout. Try specifying 1 spout and see if you could see duplicates. I suppose there would be no duplicates in specifying 1 spout and 1 exclamtion bolt. On Tue, May 6, 2014 at 5:23 PM, Bilal Al Fartakh

Re: Topology Suggestion Required for Batching

2014-05-05 Thread padma priya chitturi
Hi, You can define spouts and bolts in such a way that, input streams read by spouts would be grouped on specified fields and these could be processed by specific bolts. This way, you could make batches of input stream. On Tue, May 6, 2014 at 11:02 AM, Kiran Kumar

Re: Kafka Rebalance exceptions in Storm

2014-04-02 Thread padma priya chitturi
The same exception i encountered when tried to integrate storm spout with kafka high level consumer. This was resolved when i used SimpleConsumer. On Thu, Apr 3, 2014 at 8:26 AM, Kashyap Mhaisekar kashya...@gmail.comwrote: Hi, I consistently get the following exception when I submit a storm

Re: Using storm for heavy processing

2014-03-26 Thread padma priya chitturi
is working at great speed bounded only by external resources. Hope that helps. Regards Naresh On Mar 26, 2014, at 5:58 AM, padma priya chitturi padmapriy...@gmail.com wrote: Hi, When using storm to process 1GB data file (has approx 200 million tuples), the execution proceeded at first while

Storm logging details

2014-03-21 Thread padma priya chitturi
Hi, I just wanted to know how logging is performed in storm. I am currently using storm-0.9.0.1. I couldn't make out where is the directory storm/logs being used in storm python script. Running the daemons nimbus and supervisor seems to read storm/logback/cluster.xml as input. where is this xml

Topology execution with 1 GB file on windows

2014-03-11 Thread padma priya chitturi
Hi, I am executing a topology on Windows which reads lines of input from 1GB file (which has nearly 10 million records). The topology has 1 spout and 1 bolt. After the spout has emittted some 6-7 million records, i see that the worker on which spout runs is terminated and supervisor launches

Re: storm

2014-01-02 Thread padma priya chitturi
you can see the output either in storm ui or in worker logs. As you have installed storm, download storm-starter project ( https://github.com/nathanmarz/storm-starter) and run the wordcount topology using maven compiler. On Thu, Jan 2, 2014 at 3:58 PM, James Xu xumingmi...@gmail.com wrote:

Re: About Storm

2014-01-02 Thread padma priya chitturi
Please go through storm documentation ( https://github.com/nathanmarz/storm/wiki/Tutorial) before you start running topologies .. On Thu, Jan 2, 2014 at 4:07 PM, sowmiya kandasamy chk-sowm...@hotmail.comwrote: -- From: chk-sowm...@hotmail.com To: