Hey guys -
Our topology writes data into both HBase and HDFS. Because of that - it has to
find the location of the Hadoop/HBase masters in the hadoop-site.xml and
hbase-site.xml configuration files.
For non-storm applications that we run - we simply make sure to load those
files from the
That’s exactly the problem – our IRichBolts are quite complex, and keep hold of
multiple tuples waiting for other ‘trigger’ tuples before acking several at
once. With many thousands of tuples flying around the topology, it’s very hard
to debug issues when one tuple randomly fails – which bolt
Hello folks,
I have been trying to monitor Storm programatically, first using the
Thrift interface, and recently using the MetricsConsumer.
I have run the Exclamation Topology, with a 10ms delay between each two
consecutive emissions. Each component runs on a separate worker, with
one
Hi,
Let me explain my use case in brief:
Kakfa spout A picks up messages from Kakfa topic topic-A and creates
Queries via Esper in Storm bolt B.
This is done only once as soon as topology is deployed
Another Kafka spout C picks up realtime messages from Kafka topic -C which
will be processed by
yes, that's what I've done.
thank you.
From: Nathan Leung
Date: 2014-10-20 21:28
To: user
Subject: Re: Re: how can I send a heartbeat to supervisor manually?
Why not break up nextTuple into several iterations so the task has a chance to
send its heartbeat?
On Mon, Oct 20, 2014 at 5:13 AM,
Hi Vladi,
I recently had to install jzmq on a new ubuntu box these are steps
get
https://s3.amazonaws.com/cdn.michael-noll.com/rpms/jzmq-2.1.0.el6.x86_64.rpm
sudo dpkg -i jzmq-2.1.0.el6.x86_64.rpm
sudo apt-get install alien dpkg-dev debhelper build-essential
sudo alien -k --scripts
Thanks Samit! I'll try it and let you know if it works.
On 21/10/14 03:37, Samit Sasan wrote:
Place the config files in storm/conf folder and it would be on your typology
classpath when your topology runs. Catch is that the config had to be deployed
to all your supervisor machines.
-Samit
Hey Paul -
I'm not familiar with this parameter, on which config file does it go?
Instead, we tried setting the java.library.path parameter file in
storm.yaml to point to /etc/hadoop/conf and /etc/hbase/conf (the location
of the local Hadoop/HBase config files), but it didn't work...
Noam
On
Hi Tyson,
This implementation with ISpout.fail() stack trace is possible only if a
topology runs with acks mode , isn't it?
Vladi
On Mon, Oct 20, 2014 at 7:35 PM, Tyson Norris tnor...@adobe.com wrote:
We had the same problem - failures, but no explanation.
Ignoring the root cause for a
