Hi,
I am using flink 1.12.1 version and trying to explore latency metrics with
Prometheus. I have enabled latency metrics by adding "metrics.latency.interval:
1" in flink-conf.yaml.
I have submitted a flink streaming job which has Source->flatmap->process->sink
which is chained into single task. And I can see below latency metrics in
Prometheus.
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency_count
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency
Prometheus output :
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency_count
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency_count{app="met-flink-taskmanager",
host="", instance=" ", job="kubernetes-pods-insecure",
job_id="3ad0b4c814836aea92c48f6baf44b8bb", job_name=" ",
kubernetes_pod_name="met-flink-taskmanager-5b58cdf557-l24tc", namespace="",
operator_id="3d05135cf7d8f1375d8f655ba9d20255", operator_subtask_index="0",
pod_template_hash="5b58cdf557", source_id="cbc357ccb763df2852fee8c4fc7d55f2",
tm_id=" "}
27804583
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency_count{app="met-flink-taskmanager",
host="", instance=" ", job="kubernetes-pods-insecure",
job_id="3ad0b4c814836aea92c48f6baf44b8bb", job_name=" ",
kubernetes_pod_name="met-flink-taskmanager-5b58cdf557-l24tc", namespace=" ",
operator_id="570f707193e0fe32f4d86d067aba243b", operator_subtask_index="0",
pod_template_hash="5b58cdf557", source_id="cbc357ccb763df2852fee8c4fc7d55f2",
tm_id=" "}
27804583
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency_count{app="met-flink-taskmanager",
host="", instance=" ", job="kubernetes-pods-insecure",
job_id="3ad0b4c814836aea92c48f6baf44b8bb", job_name=" ",
kubernetes_pod_name="met-flink-taskmanager-5b58cdf557-l24tc", namespace=" ",
operator_id="ba40499bacce995f15693b1735928377", operator_subtask_index="0",
pod_template_hash="5b58cdf557", source_id="cbc357ccb763df2852fee8c4fc7d55f2",
tm_id=" "}
27804583
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency{app="met-flink-taskmanager",
host="", instance=" ", job="kubernetes-pods-insecure",
job_id="3ad0b4c814836aea92c48f6baf44b8bb", job_name=" ",
kubernetes_pod_name="met-flink-taskmanager-5b58cdf557-l24tc", namespace=" ",
operator_id="3d05135cf7d8f1375d8f655ba9d20255", operator_subtask_index="0",
pod_template_hash="5b58cdf557", quantile="0.95",
source_id="cbc357ccb763df2852fee8c4fc7d55f2", tm_id=" "}
0
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency{app="met-flink-taskmanager",
host="", instance=" ", job="kubernetes-pods-insecure",
job_id="3ad0b4c814836aea92c48f6baf44b8bb", job_name=" ",
kubernetes_pod_name="met-flink-taskmanager-5b58cdf557-l24tc", namespace=" ",
operator_id="3d05135cf7d8f1375d8f655ba9d20255", operator_subtask_index="0",
pod_template_hash="5b58cdf557", quantile="0.98",
source_id="cbc357ccb763df2852fee8c4fc7d55f2", tm_id=" "}
0.4200000000000017
flink_taskmanager_job_latency_source_id_operator_id_operator_subtask_index_latency{app="met-flink-taskmanager",
host="", instance=" ", job="kubernetes-pods-insecure",
job_id="3ad0b4c814836aea92c48f6baf44b8bb", job_name=" ",
kubernetes_pod_name="met-flink-taskmanager-5b58cdf557-l24tc", namespace=" ",
operator_id="3d05135cf7d8f1375d8f655ba9d20255", operator_subtask_index="0",
pod_template_hash="5b58cdf557", quantile="0.99",
source_id="cbc357ccb763df2852fee8c4fc7d55f2", tm_id=" "}
1
Could someone please explain what is the values reported here for these metrics.
Thanks
Suchithra
