Thanks Aljoscha,Thats why I am wondering about this. I dont see send/receive
columns change at all....just 0's all the time.The only thing that changes is
time stamp.Is this an indication that the nodes in the cluster are not
participating in execution of the data?Thanks again.Amir-
From: Aljoscha Krettek <[email protected]>
To: amir bahmanyari <[email protected]>; User <[email protected]>
Sent: Thursday, September 22, 2016 5:01 AM
Subject: Re: How can I prove ....
Hi,depending on the data source you might not be able to stress CPU/MEM because
the source might be to slow. As long as you see the numbers increasing in the
Flink Dashboard for all operators you should be good.
Cheers,Aljoscha
On Thu, 22 Sep 2016 at 00:26 amir bahmanyari <[email protected]> wrote:
That all nodes in a Flink Cluster are involved simultaneously in processing the
data?Programmatically, graphically...I need to stress CPU , MEM and all
resources to their max.How can I guarantee this is happening in Flink
Cluster?Out of 4 nodes, this is the highest resource usage I see from
"top"...Everything else is not even close...top - 22:22:45 up 41 days, 2:39,
1 user, load average: 1.76, 1.55, 1.28Tasks: 344 total, 1 running, 343
sleeping, 0 stopped, 0 zombie%Cpu(s): 5.4 us, 1.0 sy, 0.0 ni, 93.5 id,
0.1 wa, 0.0 hi, 0.0 si, 0.0 stKiB Mem: 11551564+total, 65702020 used,
49813632 free, 115072 buffersKiB Swap: 0 total, 0 used,
0 free. 3148420 cached Mem
I am pretty sure I can push FlinkRunner to way more extent than this....And
thats where true realistic perf numbers start showing up.Thanks+regards,Amir-
