Can Storm Bolts Remember Previous Input?

2014-09-24 Thread Stephen Hartzell
All, I am interested in doing image processing on frames. The algorithms I'm using require that the bolt 'remember' the previous frame. Is this possible, or is the only information available to the bolt the input it just received from the previous bolt/spout? -Thanks, Stephen

Re: How Do Workers Connect To Nimbus

2014-09-09 Thread Stephen Hartzell
; Even in this mail thread, I also learned and you contributed too. You > shared the detailed steps to run the storm cluster. :) > > > On Tue, Sep 9, 2014 at 6:28 PM, Stephen Hartzell < > hartzell.step...@gmail.com> wrote: > >> HA HA HA HA Vikas, you crazy genius!!

Re: How Do Workers Connect To Nimbus

2014-09-09 Thread Stephen Hartzell
> second instance within same security group. > > > On Tue, Sep 9, 2014 at 5:46 PM, Stephen Hartzell < > hartzell.step...@gmail.com> wrote: > >> My apologies, I run "bin/storm supervisor &" at the end. That was a bad >> copy and paste. >> &

Re: How Do Workers Connect To Nimbus

2014-09-09 Thread Stephen Hartzell
ome extent but still not fully functional. I am still testing its linear > scalability. > > > On Tue, Sep 9, 2014 at 5:15 PM, Stephen Hartzell < > hartzell.step...@gmail.com> wrote: > >> Vikas, >> >> >> I've tried to use the HortonWorks distribution, b

Re: How Do Workers Connect To Nimbus

2014-09-09 Thread Stephen Hartzell
poutWaitStrategy" > > topology.sleep.spout.wait.strategy.time.ms: 1 > > topology.error.throttle.interval.secs: 10 > > topology.max.error.report.per.interval: 5 > > topology.kryo.factory: "backtype.storm.serialization.DefaultKryoFactory" > > topology.tuple

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
work, so these machines are only for testing. Perhaps someone could tell me what the storm.yaml file should look like for this setup? -Thanks, Stephne On Mon, Sep 8, 2014 at 7:41 PM, Stephen Hartzell wrote: > I'm getting kind of confused by the storm.yaml file. Should I be using the &

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
look like on my worker and nimbus machine? Will the storm.yaml be the same on my worker and nimbus machine? I am not trying to do anything fancy, I am just trying to get a very basic cluster up and running. -Thanks, Stephen On Mon, Sep 8, 2014 at 7:00 PM, Stephen Hartzell wrote: > All Thanks

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
0.0.1. > > "No, I cannot ping my host which has a public ip address of 54.68.149.181" > you are not able to reach this ip form worker node but able to access the > UI using it? > -Harsha > > On Mon, Sep 8, 2014, at 03:34 PM, Stephen Hartzell wrote: > > Harsha, &

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
I am accesing http://54.68.149.181:8080/ using chrome. But somehow ping doesn't work says "could not find host http://54.68.149.181:8080/"; On Mon, Sep 8, 2014 at 6:49 PM, Stephen Hartzell wrote: > I'll go ahead and implement your suggestion for the .yaml. > >

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
are not able to reach this ip form worker node but able to access the > UI using it? > -Harsha > > On Mon, Sep 8, 2014, at 03:34 PM, Stephen Hartzell wrote: > > Harsha, > > The storm.yaml on the host machine looks like this: > > storm.zookeeper.servers: >

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
Also, to answer Harsha's question. I have no errors in any of my logs on the nimbus or worker machines. On Mon, Sep 8, 2014 at 6:39 PM, Stephen Hartzell wrote: > I opened up port 8080 so that I could access the UI page. Do I need to > open up something beyond that? > > On Mon,

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
gt; > > http://docs.aws.amazon.com/gettingstarted/latest/computebasics/getting-started-security-group.html > > If you can not ping the host I am guessing this might be one of the things > that you need to setup correctly. > > On Sep 8, 2014, at 3:34 PM, Stephen Hartzell > wrote: > > cann

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
nks, Stephen On Mon, Sep 8, 2014 at 6:28 PM, Harsha wrote: > There aren't any errors in worker machine supervisor logs. Are you using > the same storm.yaml for both the machines and also are you able to ping > your nimbus host or connect to zookeeper on nimbus host. > -Harsha

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
where the zookeeper machine is! The tutorial doesn't seem to explain that part. On Mon, Sep 8, 2014 at 6:24 PM, Stephen Hartzell wrote: > Harsha, > > Thanks so much for getting back with me. I will check the logs, but I > don't seem to get any error messages. I have a n

Re: How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
ookeeper cluster. > Check your logs under storm_inst/logs/ for any errors when you try to > start nimbus or supervisors. > If you are installing it manually try following these steps if you are not > already done. > http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/ &g

How Do Workers Connect To Nimbus

2014-09-08 Thread Stephen Hartzell
All, I would greatly appreciate any help that anyone would afford. I've been trying to setup a storm cluster on AWS for a few weeks now on centOS EC2 machines. So far, I haven't been able to get a cluster built. I can get a supervisor and nimbus to run on a single machine, but I can't figure out h