Thank you very much. Using a small number of MaxSpoutPending setting
solved our problem.
I love this community!
Regards,
Sai
On Wed, Nov 26, 2014 at 11:43 PM, Nathan Leung ncle...@gmail.com wrote:
The max spout pending dictates how many tuples can be in flight from a
spout task at any given
which version of storm are you using? . In storm 0.9.3 we added jsonp
support https://issues.apache.org/jira/browse/STORM-361 you can pass
callback query param to the REST Api.
-Harsha
On Mon, Dec 1, 2014, at 07:51 AM, Jose Juan Martinez wrote:
Hello,
I need to get data from Storm Rest UI,
KafkaSpout will read last committed offset from zookeeper. If there is
no offset in the zookeeper than only it will use configured
startOffsetTime. Can you check in your worker logs after restarting your
topology for this message No partition information found, using
configuration to determine
The conversion typically takes between several minutes and a few hours.
the variability here doesn't lend its self well to Storm. Generally, your
work units will need to be roughly equal otherwise tuning and reliability
tracking will be difficult.
Michael Rose (@Xorlev https://twitter.com/xorlev)
Is it possible to start a topology without using the storm jar command, and if
so, how do I prep each node (where do I put my jar) and what command would I
execute on each of the nodes?
Thanks
--
This message, and any
Hi All,
We use Storm 0.82. Our throughput is 400K messages per sec.
From Storm UI we calculate that the total latency of all spouts and bolts =
~3.5 min to process 10 min of data. But in reality it takes 13 min!
Obviously it creates huge backlogs.
We don't have time-out failures at all. We don't
I believe that an acker tracks an entire tuple tree which might make this
non-trivial. Maybe it could be used as an optimization if your topology
was entirely local or shuffle, but I'm not sure how common that is.
Also I thought 0mq will automatically do micro batches on it's own which
allows it
Strictly, I think the answer is yes but not the way you are thinking. I
use some code based on StormSubmitter to start a topology without using
storm jar. In my case I create 2 artifacts...the fatjar and another one
that is used to read existing configs, create the topology and submit the
Hello,
Could any one help me on above mail query?
Regards,
Rajesh
On Sat, Nov 29, 2014 at 10:30 PM, Madabhattula Rajesh Kumar
mrajaf...@gmail.com wrote:
Hello,
I'm new to Storm and Kafka. I have tried Strom-Kafka integration example
program. Now I'm able to send message from Kafka and
Does your printer bolt ack the messages it received from KafkaSpout.
On Mon, Dec 1, 2014, at 06:38 PM, Madabhattula Rajesh Kumar wrote:
Hello,
Could any one help me on above mail query?
Regards, Rajesh
On Sat, Nov 29, 2014 at 10:30 PM, Madabhattula Rajesh Kumar
mrajaf...@gmail.com
Thank you Harsha for your response.
I'm just printing the messages in printer bolt.
Please find below printer blot code
*public class PrintBolt extends BaseRichBolt {private static final
long serialVersionUID = 1L;public void execute(Tuple tuple)
{
Thank you very much Harsha
Regards,
Rajesh
On Tue, Dec 2, 2014 at 8:50 AM, Harsha st...@harsha.io wrote:
Ok from the earlier logs it looks like your tuples are being timed out
and getting replayed.
In your PrintBolt.execute do collector.ack(tuple)
public class PrintBolt extends
Acking is 1 message per tuple, which is at most a 50% throughput drop.
However, messages sent for acking are quite small so it is not likely to be
nearly that much of a drop. In addition, the acker bolt is highly efficient
and uses very little CPU.
Local acking does not really make sense. If
thanks for comment.
even though I restart topology and obviously there exists offset information in
zookeeper, No partition information found, using configuration to determine
offset happens.
I'm using spoutConfig.forceFromStart = true; is this option has something to do
with that? what
14 matches
Mail list logo
