Hi,
I am collecting some metrics via registering through "Metrics Consumer".Most
user-defined and system metrics like queues, _receiver-iconnection are
available. However, I am also interested in Send (Netty Client) metric, called
__send-iconnection. But I could not fined it reported among
Dear All,
My concern is about on which queue Storm relies to for back-pressure.
I did simple test for back-pressure supported by Storm.Each instance (executor)
maintains incoming(receive) Q and outgoing(transfer) Q, and according to min
and max threshold on these queues, a back-pressure works to
Hi all,
I was wondering if someone helps on how to set/modify executor id ? thanks
RegardsWald
Hi Everyone,
I have some concerns with using a central bolt for collecting some statistics
of interest from running topology.I tried to use IMetricConsumer, thus I
employed storm-metrics-statsd from endgameinc/storm-metrics-statsd, for my
topology, and configured it as:
## Metrics Consumers
Hello everyone,
Assume a topology of 4 operators, 1 executor / operator. Any possible way to
assign executors to the worker nodes in the cluster ?!
Thank you--
Walid
Hi everyone,
Could anyone has an experience to explain the factors affecting sending rate in
Storm?
Thank you--RegardsWA
Dear Dominik,
Thank you for details.
Regards,--Walid
From: Dominik Safaric <dominiksafa...@gmail.com>
To: Walid Aljoby <walid_alj...@yahoo.com>
Cc: "u...@storm.apache.org" <u...@storm.apache.org>; "dev@storm.apache.org"
<dev@storm.apache.org
3f8eaf61e2
Best Regards,Walid
From: Dominik Safaric <dominiksafa...@gmail.com>
To: Walid Aljoby <walid_alj...@yahoo.com>
Cc: "u...@storm.apache.org" <u...@storm.apache.org>; "dev@storm.apache.org"
<dev@storm.apache.org>
Sent: Friday, November 4
Hi Dominik,
Many thanks for details. Actually I am looking for a set typologies for my test.
Thank you again,--RegardsWalid
From: Dominik Safaric <dominiksafa...@gmail.com>
To: u...@storm.apache.org; Walid Aljoby <walid_alj...@yahoo.com>
Cc: "dev@storm.apache.org"
Hi Everyone,
Anyone please could tell what are the common benchmarks for testing Storm
performance?
Thank you,--Regards
WA
Hi Everyone,
I have a question about the performance of Storm:
I hope if someone can explain the impact of executors queue size on the overall
throughput and latency.What will be happen in case the queues are built up?
Many thanks :)--Walid
Hi everyone,
Anybody please can help/guide about tasks addressing the in Storm? For
example:When a tuple is received by specific worker process, it extracts the
destination task id to determine to which destination executor thread should
forward the tuple?So I can not realize where the worker
Hi everyone,
Anybody please can help/guide about tasks addressing the in Storm? For
example:When a tuple is received by specific worker process, it extracts the
destination task id to determine to which destination executor thread should
forward the tuple?So I can not realize where the worker
Hi all
It works fine. I just restart the cluster..
RegardsWA
From: Walid Aljoby <walid_alj...@yahoo.com.INVALID>
To: User <u...@storm.apache.org>; "dev@storm.apache.org"
<dev@storm.apache.org>
Sent: Thursday, September 8, 2016 12:40 AM
Subject: max Topology
Hi Everyone,
I have topology consists of one spout and three bolts. supervisor slots set to
4 , topology.workers set to 8, but only four workers are shown in the UI?In
other words, I want to run the topology over all slots (6700-6703), but only
6700 and 6701 are used!
Anyone can help
Hi everyone,
In batch processing, as an example Mapreduce running in datacenters serves more
than job and there are a lot of research about the optimization as how to speed
up or jobs finishing time, ..etc?
The question:Is the real-time engines (like storm) designed to run more than
job
le ? Topologies do not share slots
in storm.
Manu
On Tue, Sep 6, 2016 at 5:50 PM Walid Aljoby <walid_alj...@yahoo.com.invalid>
wrote:
Hi Manu,
Number of workers is only two per topology.
Thanks--WA From: Manu Zhang <owenzhang1...@gmail.com>
To: Walid Aljoby <walid_alj...@yahoo
Hi Manu,
Number of workers is only two per topology.
Thanks--WA From: Manu Zhang <owenzhang1...@gmail.com>
To: Walid Aljoby <walid_alj...@yahoo.com>; User <u...@storm.apache.org>;
"dev@storm.apache.org" <dev@storm.apache.org>
Sent: Tuesday, September
Hi Everyone,
I have a question please about the maximum typologies that can be processed by
Apache storm production cluster?
Although the number of slots per supervisor is four(6700,6701,6702,6703), but
when I submitted four typologies, I noted only three were running in parallel,
while one of
Hi everyone,
Is it easier to specify in which tcp port the tasks (threads) will be
assigned?Any API can help to do that?
Thank You--Regards
Hi everyone,
Is there any other factors affect the spout transfer other than max spout
pending?
Are the queues of the workers and executors effect on the total spout
throughput?
What is the definition of throughout in Storm? Is it the accumulated
acknowledged tuples over time ? or the tuple
Hi Everyone,
I try to capture the relationship between throughput and latency across
production cluster of two worker machines. So the I submitted the topology
multiple times with different spouts and bolts. So I noticed the following not
clear results to me:
1- For the same number of spouts
Hi Everyone,
I got this error:
Exception in thread "main" java.lang.RuntimeException: Found multiple
defaults.yaml resources. You're probably bundling the Storm jars with your
topology jar!!
What I understand that Storm jars mean the dependencies stated in pom.xml
file, while topology jar
Hi Everyone,
I got confused which interface to implement when coding bolts and spots classes
because I find that some people extend BaseRichBolt as an example while others
extend BaseBasicBolt, others implement IRichBolt..
So: Anyone please can show the differences between BaseRichBolt
Many thanks Manu. Is the implementation available online?
--RegardsWalid
From: Manu Zhang <owenzhang1...@gmail.com>
To: dev@storm.apache.org; Walid Aljoby <walid_alj...@yahoo.com>; User
<u...@storm.apache.org>
Sent: Thursday, July 21, 2016 9:21 AM
Subject: Re: P
Thank you Jungtaek. Do you know how can I get the implementation of
microbenchmarking?Is it available online?
Thank you
--WA From: Jungtaek Lim <kabh...@gmail.com>
To: dev@storm.apache.org; Walid Aljoby <walid_alj...@yahoo.com>; User
<u...@storm.apache.org>
Sent: Thurs
Hi Everyone,
Anyone can please recommend common communication metrics like (latency and
throughput), which can be work with storm version 1.0.1?
Thank you..
--RegardsWA
Hi everyone,
I am trying to run WordCountTopology from Intellij, I faced the following
run-time error:Anyone please can see how can it can be fixed out?
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/storm/topology/IRichSpout at java.lang.Class.forName0(Native Method)
Thank you Anshu.
I tried that but it doesn't work. Same error: Exception in thread "main"
java.lang.NoClassDefFoundError: backtype/storm/generated/AlreadyAliveException.
Regards
WA
From: anshu shukla <anshushuk...@gmail.com>
To: u...@storm.apache.org
Cc: Walid A
the implementation of the Benchmarks shown here: Microbenchmarking
Apache Storm 1.0 Performance - Hortonworks ? and How is it relative to your own
metrics?
Sorry for all these questions,
Thank you--RegardsWalid
From: Manu Zhang <owenzhang1...@gmail.com>
To: Walid Aljoby <
Thank you.
You mean that it could not be run with new version of Apache storm?
Regards
Walid
From: darion.yaphet <fly...@163.com>
To: dev@storm.apache.org; Walid Aljoby <walid_alj...@yahoo.com>
Cc: User <u...@storm.apache.org>
Sent: Monday, July 18, 2016 6:35 PM
Hi Everyone,
Anyone used to run Storm Benchmarks in this site:
https://github.com/roshannaik/storm-benchmark-sol ?The compilation was
successful, but I got into error through run time?
.0.1/bin/storm -jar ./target/storm-benchmark-0.1.0-jar-with-dependencies.jar
-conf ./conf/sol.yaml -c
Hi Everyone,
Anyone can please list the available network and application metrics in storm?
It is good if there is specific topology uses these matrices, as an example!
Many thanks
--Regards
WA
Hi Everyone,
I have fundamental questions about processing guarantee in Apache Storm. So
Anyone please can help for the following:
1- Animation or clear tutorial with example show the anchoring mechanism..2-
Any topology code already implemented the guarantee processing function.
Many thanks,
Only three files are shown in conf dir: storm.yaml, storm_env.ini, and
storm-env.sh.
ThanksWA
From: Satish Duggana <satish.dugg...@gmail.com>
To: dev@storm.apache.org; Walid Aljoby <walid_alj...@yahoo.com>
Cc: User <u...@storm.apache.org>
Sent: Tuesday, July 12, 201
Hi all,
In the previous releases of storm, I see that default configuration file is
called defaults.yaml.
For new release, like Storm 1.0.1, Anyone can help where can look for default
configuration as defaults.yaml, rather than storm.yaml?
Thank you
--Regards
WA
Hi all,
I am running topology over production cluster of two nodes: one as Nimbus and
ZkServer, the other one as supervisor. Everything is running fine, but I got
confused: Why are there two hosts in UI's Nuimbus summary: one is listed as IP
address and its status offline, the other one is by
Hi,
Supervisors have already connected with zookeeper, that is in the same machine
with nimbus.
Thanks
From: Abhishek Agarwal <abhishc...@gmail.com>
To: u...@storm.apache.org; Walid Aljoby <walid_alj...@yahoo.com>
Cc: "dev@storm.apache.org" <dev@storm.apache.or
|
| Hi all,
Please see that,
I have a topology that runs well on a Local cluster.But when I try to run it on
a production cluster the following things happens:
- The nimbus is up
- The storm UI is up
- The two workers I use are up
- Zookeper is up
- I run storm withstorm
Hi all,
I want to run more than one supervisor. I just created two process: storm
supervisor, but what I can see in the UI only one supervisor!So Anyone can tell
how can we specify the number supervisors?
The second question: from supervisor machines when I access UI by the IP
address of
Hi all,
I have an issue when start running storm nimbus. It runs only for short time
then disappear.
Also no reply for this command: echo stat | nc zkserver1 2181
This is snapshot from nimbus log file:
java.lang.RuntimeException:
he host name wf-ubuntun is properly configured in /etc/hosts
on the nodes.
Hope this helps.
Li
Sent from my iPhone
> On 5 Jul 2016, at 5:27 AM, Walid Aljoby <walid_alj...@yahoo.com.INVALID>
> wrote:
>
> Hi all,
> I am running Apache Storm 1.0.1 over clusters of two nod
Hi all,
I am running Apache Storm 1.0.1 over clusters of two nodes (one is called
Master which runs zookeeper and nimbus, the other one runs supervisor).I just
configured the storm.zookeeper.servers: and nimbus.seeds: to be the IP
address of Master node for both two machines.
However, when I
Hi All,
I have setup storm on a single-node and everything was fine.
Now I am trying to setup it over cluster of nodes (three machines), So:Could
anyone help me find clear instructions to do that?
Thank you in advance
--Regards
WA
enj...@gmail.com>
To: u...@storm.apache.org; Walid Aljoby <walid_alj...@yahoo.com>
Cc: "dev@storm.apache.org" <dev@storm.apache.org>
Sent: Thursday, June 23, 2016 8:48 PM
Subject: Re: Storm UI
you need a supervisor node running, the node you currently are running
i
Hi all,
I have submitted ExclamationTopology into single-node cluster Storm 1.0.1, as
following: storm jar target/storm-starter-*.jar
org.apache.storm.starter.ExclamationTopology
I have three basic questions:1- In sotrm UI, http://localhost:8080/index.html ,
the running topology and the number
46 matches
Mail list logo
