k
On Fri, Nov 30, 2018 at 1:33 PM Ethan Li wrote:
>
> Hi Junguk,
>
> Please set "storm.scheduler”
> (https://github.com/apache/storm/blob/master/storm-server/src/main/java/org/apache/storm/DaemonConfig.java#L96)
> to change scheduler
>
>
> - Ethan
>
> On Nov
Hi,
I am trying to use "Evenscheduler" in Storm 2.0.
I configured scheduler like this.
topology.scheduler.strategy: "org.apache.storm.scheduler.EvenScheduler"
However, when I ran Nimbus, it said
Exception in thread "main" java.lang.IllegalArgumentException: Field
VALIDATE_TOPOLOGY_SCHEDULER_STRAT
Hi,
I have two questions.
1. I would like measure end-to-end latency (spout -> last bolt).
Based on "ThroughputvsLatency" example, it uses acker to measure latency.
If I do not use "acker" meaning "at most", what is the best to measure
latency?
I am planning to use similar approach with "Through
So the spout will emit as fast
> as it can, which is faster than the bolts in the topology can process them.
>
> Try reducing the sleep time to something smaller like 5.
>
> -Taylor
>
> > On Oct 25, 2016, at 10:51 PM, Junguk Cho wrote:
> >
> > Hi, All.
&
Hi, All.
I evaluate Storm performance with WordCount example.
In spout, I removed "Utils.sleep(100)" in RandomSentenceSpout.java.
So, it emitted sentences very fast.
Whenever I run WordCountTopology, "split" bolt dead with below messages and
It is re-launched.
2016-10-25 20:37:39.395 STDERR [INF
Hi, All.
I used Storm 1.0.1 version and tested WordCountTopology.java application in
examples dir.
However, the spout often stops emitting the tuples after some times among
several tests.
After this situation happened, I only showed "Emitting: spout __metrics ~~"
in spout's log.
It seemed it is r
t; A: Yes -- quite a few actually, the storm issue tracker
> <https://issues.apache.org/jira/browse/STORM> is full of them.
>
> H
> ope this helps...
>
> Warm regards,
>
> A.
>
>
> On Thu, Oct 20, 2016 at 7:54 PM, Junguk Cho wrote:
>
>> H
Hi,
I would like to know Storm master branch.
So far, I have used Storm v1.0.1 and I plan to use Storm master branch
which removes many clojure core parts.
Is current master branch ok to run storm application?
Is there significant issues to use current master branch?
Thanks,
Junguk
Hi,
When I ran a topology, it always created a process called "LogWriter" per
worker.
LogWriter seemed to write log into file when worker call
"system.out.println" or "LOG." based on configuration in log4j2.
To send log info from a worker to a LogWriter, it seemed to use UDP.
Is it right?
Is
n assigned more than
> 10 task. because the rebalacing is based on the task to do more workers. If
> you did not assigne 10 tasks(at least) to the topology explicitly, the
> rebalancing can not work out as you want.
>
>
> ----------
>
>
>
>
> *From:*
based on input
parameter for rebalancing.
What is the condition to decide this?
Thanks,
Junguk
2016-08-11 17:33 GMT-04:00 Junguk Cho :
> Hi.
>
> Thank you for replies.
> Now, it worked.
>
> 2. second, you should make sure your topology has been assigned more than
> 10 task. b
Hi, All.
I tried to use STORM rebalance (
http://storm.apache.org/releases/1.0.1/Command-line-client.html).
I used Storm 1.0.1 version.
I first ran 3 workers (one spout, one split and one count.) for WordCount
example.
After running it, In commandline, I typed
./storm rebalance WordCount -w 10 -
Hi,
Is there an example to show how to use worker level metric?
There is a document (
http://storm.apache.org/releases/2.0.0-SNAPSHOT/Metrics.html), but I am not
clear how to use it.
Thanks,
Junguk
Hi.
I explored "directGrouping".
I have some questions.
So, based on this webpage for "Direct grouping" (
http://storm.apache.org/releases/current/Concepts.html), we can use direct
grouping by using API like *.directGrouping("input executor","streamId");*
After that, we can use "emitDirect".
So,
quot;fail" from Count bolt forward to spout?
>>
>> 1) Count bolt sends "fail" to previous bolt (split) and then split bolt
>> sends it to "spout"
>> 2) Count bolt directly sends "fail" to "spout"
>>
>>
>> You can
Hi.
I have two questions.
First, it is about "Partial Key grouping" & "Fields Grouping".
In my examples, I used employee class which has "name", "phonenumber",
"salary" as tuple to send next worker.
I only used "name" as key for groupings.
Fields Grouping works as what I expected.
Based on "Fie
mcc = (MyCountingClass) tuple.getValue(1);//secondValue
>
> I agree the storm tutorials are a bit confusing that way. Please see if
> the tutorial I wrote is clearer:
> http://nrecursions.blogspot.in/2016/04/a-simple-apache-storm-tutorial.html
>
>
>
>
>
>
> On Sat, Ju
ce so it should be disabled ("false" by default) for
> production environment.
>
> Hope this helps.
>
> Thanks,
> Jungtaek Lim (HeartSaVioR)
>
>
> 2016년 6월 11일 (토) 오전 3:27, Junguk Cho 님이 작성:
>
>> Hi, I have some basic questions.
>>
>> 1. Abo
Hi, I have some basic questions.
1. About Tuple.
We declare tuple in declareOutputFields.
For example, declarer.declare(new Fields("word", "count"));
Are "word" and "count" forwarded to next node with actual data?
What are the roles of "word" and "count" here internally?
2. About rebalancing (
noll.com/blog/2012/10/16/understanding-the-parallelism-of-a-storm-topology/
>>
>> Some config parameters may have been deprecated since 2013.
>>
>> oliv/
>>
>> On Wed, May 25, 2016 at 9:41 AM, Junguk Cho wrote:
>>>
>>> Hi, all.
>>>
>>&g
Hi, all.
I am new to Storm and have a question about messaging passing in storm.
Within one workers, each task use disruptor queue in strom.
In one node, if there are two workers, does they use Netty for
inter-process communication?
Thanks,
Junguk
21 matches
Mail list logo
