lidesheng created FLINK-13813:
---------------------------------
Summary: metrics is different between overview ui and metric
response
Key: FLINK-13813
URL: https://issues.apache.org/jira/browse/FLINK-13813
Project: Flink
Issue Type: Bug
Environment: Flink 1.8.1 with hdfs
Reporter: lidesheng
Attachments: metrics.png, overview.png
After a flink task is over, I get metrics by http request. The record count in
response is different with job overview.After a flink task is over, I get
metrics by http request. The record count in response is different with job
overview.
get http://x.x.x.x:8081/jobs/57969f3978edf3115354fab1a72fd0c8 returns:
{ "jid": "57969f3978edf3115354fab1a72fd0c8", "name": "3349_cjrw_1566177018152",
"isStoppable": false, "state": "FINISHED", ... "vertices": [ \{ "id":
"d1cdde18b91ef6ce7c6a1cfdfa9e968d", "name": "CHAIN DataSource
(3349_cjrw_1566177018152/SOURCE/0) -> Map (3349_cjrw_1566177018152/AUDIT/0)",
"parallelism": 1, "status": "FINISHED", ... "metrics": { "read-bytes": 0,
"read-bytes-complete": true, "write-bytes": 555941888, "write-bytes-complete":
true, "read-records": 0, "read-records-complete": true, "write-records":
5000000, "write-records-complete": true } ... } ... ] }}
But, the metrics by
http://x.x.x.x:8081/jobs/57969f3978edf3115354fab1a72fd0c8/vertices/d1cdde18b91ef6ce7c6a1cfdfa9e968d/metrics?get=0.numRecordsOut
returns
[\{"id":"0.numRecordsOut","value":"4084803"}]
The overview record count is different with task metrics, please view the
apppendix.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
