Hi All, I'm trying to plot the flink application metrics using grafana backed by influxdb. I need to plot/monitor the 'numRecordsIn' & 'numRecordsOut' for each operator/operation. I'm finding it hard to generate the influxdb query in grafana which can help me make this plot.
I am able to plot the 'numRecordsIn' & 'numRecordsOut' for each subtask(parallelism set to 50) of the operator but not the operator as a whole. If somebody has knowledge or has successfully implemented this kind of a plot on grafana backed by influxdb, please share with me the process/query to achieve the same. Below is the query which I have to monitor the 'numRecordsIn' & 'numRecordsOut' for each subtask SELECT derivative(sum("count"), 10s) FROM "numRecordsOut" WHERE "task_name" = 'Source: Reading from Kafka' AND "subtask_index" =~ /^$subtask$/ AND $timeFilter GROUP BY time(10s), "task_name" PS: $subtask is the templating variable that I'm using in order to have multiple subtask values. I have tried the 'All' option for this templating variable- This give me an incorrect plot showing me negative values while the individual selection of subtask values when selected from the templating variable drop down yields correct result. Thank you! Regards, Anchit