Hi, I'm using Flink 1.2.1 and FlinkKafkaConsumer09 to read data from Kafka Server (0.10.1.0). My consumer is able to read and everything works fine. But when I use the kafka_consumer_groups.sh command to find the lag metrics it does not return the lag. Upon reading online I found that Flink Kafka Consumer uses the low level API and manages the assignment of partition itself. http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-kafka-group-question-td8185.html
What is the best way to monitor my flink kafka consumer's lag? Does Flink expose the lag metrics per partition somewhere? ~ Karthik