Re: Apache Storm Graduation to a TLP

Great News! On 2014年9月23日, at 下午1:32, padma priya chitturi wrote: > Good news !!! Congrats > > On Tue, Sep 23, 2014 at 10:04 AM, Cheng Chen wrote: > great news! > > On Mon, Sep 22, 2014 at 9:33 PM, Vikas Agarwal wrote: > Great! > > On Tue, Sep 23, 2014 at 2:46 AM, P. Taylor Goetz w

Re: Apache Storm Graduation to a TLP

Good news !!! Congrats On Tue, Sep 23, 2014 at 10:04 AM, Cheng Chen wrote: > great news! > > On Mon, Sep 22, 2014 at 9:33 PM, Vikas Agarwal > wrote: > >> Great! >> >> On Tue, Sep 23, 2014 at 2:46 AM, P. Taylor Goetz >> wrote: >> >>> I’m pleased to announce that Apache Storm has graduat

Re: Apache Storm Graduation to a TLP

great news! On Mon, Sep 22, 2014 at 9:33 PM, Vikas Agarwal wrote: > Great! > > On Tue, Sep 23, 2014 at 2:46 AM, P. Taylor Goetz > wrote: > >> I’m pleased to announce that Apache Storm has graduated to a Top-Level >> Project (TLP), and I’d like to thank everyone in the Storm community fo

Re: Apache Storm Graduation to a TLP

Great! On Tue, Sep 23, 2014 at 2:46 AM, P. Taylor Goetz wrote: > I’m pleased to announce that Apache Storm has graduated to a Top-Level > Project (TLP), and I’d like to thank everyone in the Storm community for > your contributions and help in achieving this important milestone. > > As p

Re: Storm performing very slow

That is what is causing the storm to perform very slow data read and process. And I am not sure what is causing it to be that slow. -- Kushan Maskey 817.403.7500 On Mon, Sep 22, 2014 at 10:30 PM, Tom Brown wrote: > The screen shows a complete Latency of 47 seconds. That is really high. Is > the

Re: Storm performing very slow

The screen shows a complete Latency of 47 seconds. That is really high. Is there a screen that shows the performance/capacity of each bolt? --Tom On Mon, Sep 22, 2014 at 9:27 PM, Kushan Maskey < kushan.mas...@mmillerassociates.com> wrote: > Below is my Topology configuration and Topology status

Re: Storm performing very slow

Below is my Topology configuration and Topology status bases on the configuration. Can anyone help me how to optimize the storm for faster process of the 20 Million data? Topology statsWindowEmittedTransferredComplete latency (ms)AckedFailed10m 0s

Re: Storm performing very slow

Here is my storm config. storm.config.setMaxTaskParallelism=4 storm.config.setNumWorkers=20 storm.config.setMaxSpoutPending=5000 storm.config.numAckers=1000 I am guessing I need to increase the maxTaskParallelism more. IF that is the case how much would you suggest? Any help will be highly

Re: Storm performing very slow

Storm is not your bottleneck. Check your Storm code to 1) ensure you're parallelizing your writes and 2) you're batching writes to your external resources if possible. Some quick napkin math shows you only doing 110 writes/s, which seems awfully low. Michael Rose (@Xorlev

Re: Local cluster zookeeper exception

you are right, I delete the zookeeper dependency in the storm-core, the everything works! 2014-09-22 21:38 GMT-04:00 Vikas Agarwal : > I faced same exception and it turned out that it was version issue of > zookeeper. We are using maven and one of child dependency reference another > version of z

Storm performing very slow

I am trying to load 20 M records into Cassandra database through Kafka-Storm. I am able to post all the data in 5 mins into Kafka. But reading it from storm and inserting into Cassandra, Couch and Solr is kind of very slow. It has been running for past 5 hours and so far only 2 Million records. Ho

Re: Local cluster zookeeper exception

I faced same exception and it turned out that it was version issue of zookeeper. We are using maven and one of child dependency reference another version of zookeeper which caused the issue. You can check dependency hierarchy in eclipse to be sure that this is not the issue. On Tue, Sep 23, 2014 a

Local cluster zookeeper exception

Hi, Guys I am trying to run the test from my local cluster, but I get the exception java.lang.ClassNotFoundException: org.apache.zookeeper.server.NIOServerCnxnFactory I have read some articles, it seems the version of zookeeper and storm, but I am using the latest version of zookeeper(3.4.5) and l

Re: Apache Storm Graduation to a TLP

Congrats! 2014년 9월 23일 화요일, P. Taylor Goetz님이 작성한 메시지: > I’m pleased to announce that Apache Storm has graduated to a Top-Level > Project (TLP), and I’d like to thank everyone in the Storm community for > your contributions and help in achieving this important milestone. > > As part of the gradua

Re: Apache Storm Graduation to a TLP

Congrats! Regards, RIyaz On Tue, Sep 23, 2014 at 12:16 AM, P. Taylor Goetz wrote: > I’m pleased to announce that Apache Storm has graduated to a Top-Level > Project (TLP), and I’d like to thank everyone in the Storm community for > your contributions and help in achieving this important milesto

Re: Apache Storm Graduation to a TLP

Congrats! On Mon, Sep 22, 2014 at 11:41 PM, Guillaume Conte wrote: > +1 Congrats! > > From: Corey Nolet > Reply-To: "user@storm.incubator.apache.org" < > user@storm.incubator.apache.org> > Date: Monday, September 22, 2014 at 11:33 PM > To: "user@storm.incubator.apache.org" > Cc: "d...@storm

Re: Apache Storm Graduation to a TLP

+1 Congrats! From: Corey Nolet mailto:cjno...@gmail.com>> Reply-To: "user@storm.incubator.apache.org" mailto:user@storm.incubator.apache.org>> Date: Monday, September 22, 2014 at 11:33 PM To: "user@storm.incubator.apache.org

Re: Apache Storm Graduation to a TLP

Congrats! On Mon, Sep 22, 2014 at 5:16 PM, P. Taylor Goetz wrote: > I’m pleased to announce that Apache Storm has graduated to a Top-Level > Project (TLP), and I’d like to thank everyone in the Storm community for > your contributions and help in achieving this important milestone. > > As part o

Apache Storm Graduation to a TLP

I’m pleased to announce that Apache Storm has graduated to a Top-Level Project (TLP), and I’d like to thank everyone in the Storm community for your contributions and help in achieving this important milestone. As part of the graduation process, a number of infrastructure changes have taken pla

Re: metrics consumer logging stormUI data

Here is what I see in the metrics.log 2014-09-22 09:44:31,321 731751411404271 localhost:6703 19:split __transfer-count {default=2680} 2014-09-22 09:44:31,321 731751411404271 localhost:6703 19:split __execute-latency {spout:default=0.0} 2014-09-22 09:44:31,321 73175

Re: metrics consumer logging stormUI data

Hi Harsha, Did you have to bind the metrics consumer to the default StormUI metrics at all? Or do those automagically get included ? Thanks! On Mon, Sep 22, 2014 at 10:33 AM, Otis Gospodnetic < otis.gospodne...@gmail.com> wrote: > Hi Gezim, > > On Fri, Sep 19, 2014 at 7:27 PM, Gezim Musliaj wro

Re: metrics consumer logging stormUI data

Hi Gezim, On Fri, Sep 19, 2014 at 7:27 PM, Gezim Musliaj wrote: > Hey Otis, I was just registered at sematext and I can say that this is > what I have been looking for.I have just one question, what about the > delays between the SPM and the Storm Cluster (if they do exist), whats the > worst ca

Re: metrics consumer logging stormUI data

Hi Raphael, I tested it with wordcounttopology under examples. conf.registerMetricsConsumer(LoggingMetricsConsumer.class, 2); I do see the metrics added to the logs/metrics.log. metrics.log should be present by default under storm/logs dir. -Harsha On Mon, Sep 22, 2014, at

Re: metrics consumer logging stormUI data

Thanks Harsha and Otis for your prompt responses. I'm looking to somehow log these metrics to use for an in-house monitoring system. I don't want to get user provided metrics just yet. >From what I've gathered from the big data cookbook is that I just want to create a metrics consumer to read thes