Hi,
I have encountered the similar problem couple of days back. I have fixed it
with below changes.
1) if your using, Core storm then setMaxSpoutPending always a low number.
2) if your using Trident storm then it must be 1 always.
3) Increase number of workers and one acker per worker.
4) One spo
Try reducing the Spout pending and then increase gradually. May be start
with 100.
Can send a screen capture of Storm UI.
Thanks and Regards,
Devang
On May 19, 2016 10:14 PM, "Alexandre Wilhelm"
wrote:
> Hi,
>
> I have one kafka partition and one spout and this spout is written in go,
> not su
Hi,
I have one kafka partition and one spout and this spout is written in go, not
sure if it’s related to the java process.
--
Alexandre Wilhelm
On May 19, 2016 at 5:15:09 AM, Devang Shah (devangsha...@gmail.com) wrote:
How many Kafka partitions exist on the topic ?
How many Kafka Spout inst
How many Kafka partitions exist on the topic ?
How many Kafka Spout instances within the topology?
Play around with number of consumers subscribing to the Kafka topic.
Observe the latency, throughput and cpu usage by changing these parameters.
Thanks and Regards,
Devang
On May 19, 2016 3:09 AM,
Hi John,
The results sent used a default configuration of storm, the max spout spending
was not set to 1 million. I can try with different configurations of you want,
what would be good number ?
Thanks
Alexandre
> On May 16, 2016, at 03:58, John Yost wrote:
>
> Hi Alexandre,
>
> The max.spo
Hi Alexandre,
The max.spout.pending is at 1 million, which is the highest I've ever seen!
:) This means you have a whole bunch of messages within the system at any
given time and your topology spends most of it's time in the LMAX disruptor
layer caching messages as they come in from Netty and bef
Hi, I recommend profiling with jvisualvm to see which methods are using the
most CPU time. This should provide insight into which methods are causing CPU
usage to go up.
--John
Sent from my iPhone
> On May 14, 2016, at 2:42 PM, Alexandre Wilhelm
> wrote:
>
> Hi guys,
>
> I’m a new user of
Hi guys,
I’m a new user of storm and I need help for an issue I have with storm.
At a glance, I have a topology with three spouts and bolts ;
- Spout -> get messages from Kafka
- Bolt -> transform the message from Kafka to a well formed son
- Bolt -> send the JSON to a kairosDB server
All of
