RE: Please help: How to print --reporting-interval in the perf metrics?
Hello Experts,
Any thought on this?
From: Sunil CHAUDHARI
Sent: Tuesday, March 3, 2020 5:46 PM
To: users@kafka.apache.org
Subject: Please help: How to print --reporting-interval in the perf metrics?
Hi,
I want to test consumer perf using kafka-consumer-perf-test.sh
I am running below command:
./kafka-consumer-perf-test.sh --broker-list localhost:9092 --topic MB3P3R
--messages 65495 --num-fetch-threads 9 --print-metrics --reporting-interval
5000 --show-detailed-stats > MB3P3R-consumer-Perf2.log
I am getting metrics output as below: Its not printing anything under the
highlighted columns.
Another question: Whatevere number of partitions and replicas my topic has, it
always giving approx value "2159" for records-consumed-rate
time, threadId, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec,
rebalance.time.ms, fetch.time.ms, fetch.MB.sec, fetch.nMsg.sec
Metric Name
Value
consumer-coordinator-metrics:assigned-partitions:{client-id=consumer-1}
: 2.000
consumer-coordinator-metrics:commit-latency-avg:{client-id=consumer-1}
: 6.000
consumer-coordinator-metrics:commit-latency-max:{client-id=consumer-1}
: 6.000
consumer-coordinator-metrics:commit-rate:{client-id=consumer-1}
: 0.033
consumer-coordinator-metrics:commit-total:{client-id=consumer-1}
: 1.000
consumer-coordinator-metrics:heartbeat-rate:{client-id=consumer-1}
: 0.000
consumer-coordinator-metrics:heartbeat-response-time-max:{client-id=consumer-1}
: NaN
consumer-coordinator-metrics:heartbeat-total:{client-id=consumer-1}
: 0.000
consumer-coordinator-metrics:join-rate:{client-id=consumer-1}
: 0.033
And so on...
CONFIDENTIAL NOTE:
The information contained in this email is intended only for the use of the
individual or entity named above and may contain information that is
privileged, confidential and exempt from disclosure under applicable law. If
the reader of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying of this communication
is strictly prohibited. If you have received this message in error, please
immediately notify the sender and delete the mail. Thank you.
Please help: How to print --reporting-interval in the perf metrics?
Hi,
I want to test consumer perf using kafka-consumer-perf-test.sh
I am running below command:
./kafka-consumer-perf-test.sh --broker-list localhost:9092 --topic MB3P3R
--messages 65495 --num-fetch-threads 9 --print-metrics --reporting-interval
5000 --show-detailed-stats > MB3P3R-consumer-Perf2.log
I am getting metrics output as below: Its not printing anything under the
highlighted columns.
Another question: Whatevere number of partitions and replicas my topic has, it
always giving approx value "2159" for records-consumed-rate
time, threadId, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec,
rebalance.time.ms, fetch.time.ms, fetch.MB.sec, fetch.nMsg.sec
Metric Name
Value
consumer-coordinator-metrics:assigned-partitions:{client-id=consumer-1}
: 2.000
consumer-coordinator-metrics:commit-latency-avg:{client-id=consumer-1}
: 6.000
consumer-coordinator-metrics:commit-latency-max:{client-id=consumer-1}
: 6.000
consumer-coordinator-metrics:commit-rate:{client-id=consumer-1}
: 0.033
consumer-coordinator-metrics:commit-total:{client-id=consumer-1}
: 1.000
consumer-coordinator-metrics:heartbeat-rate:{client-id=consumer-1}
: 0.000
consumer-coordinator-metrics:heartbeat-response-time-max:{client-id=consumer-1}
: NaN
consumer-coordinator-metrics:heartbeat-total:{client-id=consumer-1}
: 0.000
consumer-coordinator-metrics:join-rate:{client-id=consumer-1}
: 0.033
And so on...
CONFIDENTIAL NOTE:
The information contained in this email is intended only for the use of the
individual or entity named above and may contain information that is
privileged, confidential and exempt from disclosure under applicable law. If
the reader of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying of this communication
is strictly prohibited. If you have received this message in error, please
immediately notify the sender and delete the mail. Thank you.
