NotAliveException via Storm UI

2014-07-23 Thread Vincent Russell
I'm using Storm 0.9.0.1 and I'm getting a NotAliveException via the Storm UI: NotAliveException(msg:Ingest-33-1406154838) at backtype.storm.generated.Nimbus$getTopologyInfo_result.read(Nimbus.java:11330) at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:78)

Re: NotAliveException via Storm UI

2014-07-23 Thread Vincent Russell
I solved my own issue I think. There is a space in my topology name. So I believe the storm UI is not escaping the link. On Wed, Jul 23, 2014 at 6:49 PM, Vincent Russell wrote: > I'm using Storm 0.9.0.1 and I'm getting a NotAliveException via the Storm > UI: > &g

Re: Good way to test when topology in local cluster is "fully active"

2014-08-04 Thread Vincent Russell
Corey, Have you tried using the integration testing framework that comes with storm? Testing.withSimulatedTimeLocalCluster(mkClusterParam, new TestJob() { @Override public void run(ILocalCluster cluster) throws Exception { CompleteTopologyParam completeTopologyParam = new CompleteTopologyParam

Re: Good way to test when topology in local cluster is "fully active"

2014-08-04 Thread Vincent Russell
d yet, other than Netty. >> >> >> On Mon, Aug 4, 2014 at 10:40 PM, Vincent Russell < >> vincent.russ...@gmail.com> wrote: >> >>> Corey, >>> >>> Have you tried using the integration testing framework that comes with >>> storm? >&

Re: Location of last error details seen in storm UI

2014-08-25 Thread Vincent Russell
Click on the link of the bolt/spout that is all the way on the left side. On Sun, Aug 24, 2014 at 11:19 PM, Jason Kania wrote: > Hello, > > I am trying to get more detail on an error that is being displayed in the > Storm UI under the Last Error column but unfortunately, I am not seeing it > ca

Storm performance testing

2014-08-29 Thread Vincent Russell
Hello, Are there any preferred methods for performance testing storm in a real cluster. Is there a way to tell when the last bolt in a topology is "done" processing tuples in order to tell how long that processing took? Thanks in advance, Vincent

Re: Storm performance testing

2014-09-06 Thread Vincent Russell
a high rate since spout is operating with one thread. > > thanks, > Amila. > > [1] > https://github.com/yahoo/storm-perf-test/blob/master/src/main/java/com/yahoo/storm/perftest/Main.java > [2] https://github.com/amilaSuriarachchi/storm-samples > > On Fri, Aug 29, 2014 at 5

storm bolts receiving tuples with null values

2014-09-17 Thread Vincent Russell
All, When I change my topology workers from 1 to 2 my topology starts sending tuples with null values. Is there a reason why this might happen? The tuple isn't null, but when I call getValueByField I get a null value. Is there a size limit for a tuple that I might be crossing? I'm using storm

Re: storm bolts receiving tuples with null values

2014-09-19 Thread Vincent Russell
iated. Thanks, On Wed, Sep 17, 2014 at 9:48 PM, Vincent Russell wrote: > > All, > > When I change my topology workers from 1 to 2 my topology starts sending > tuples with null values. Is there a reason why this might happen? The > tuple isn't null, but when I call getVal

Re: storm bolts receiving tuples with null values

2014-09-19 Thread Vincent Russell
would > take a look at those first. > > On Fri, Sep 19, 2014 at 1:23 PM, Vincent Russell < > vincent.russ...@gmail.com> wrote: > >> >> Just to add additional information to this tread. >> >> >>- I am using custom kryo serializers that I have regi

Re: storm bolts receiving tuples with null values

2014-09-19 Thread Vincent Russell
Nathan, That is exactly what was happening. Thanks, On Fri, Sep 19, 2014 at 2:11 PM, Vincent Russell wrote: > Thank you Nathan. I just looked at the serializer and there is one case > where it can return null. I am going to add more debugging and retry. > > Thanks, > > On

Storm Integration tests dying on Centos

2014-09-20 Thread Vincent Russell
My storm integration tests work fine on mac, but die on Centos with the following error: 2014-09-20 21:09:50,499 [Thread-40-enrich] INFO backtype.storm.daemon.task - Emitting: enrich __ack_ack [-4259171058236784757 5253908046962264078] 2014-09-20 21:09:50,500 [Thread-40-enrich] ERROR backtype.sto