Hi, you can get the offsets (current and committed offsets) in Flink 1.1 using the Flink metrics. In Flink 1.0, we expose the Kafka internal metrics via the accumulator system (so you can access them from the web interface as well). IIRC, Kafka exposes a metric for the lag as well.
On Mon, Aug 8, 2016 at 8:15 PM, vpra...@gmail.com <vpra...@gmail.com> wrote: > From the code in Kafka09Fetcher.java > > // if checkpointing is enabled, we are not automatically > committing to > Kafka. > kafkaProperties.setProperty(ConsumerConfig.ENABLE_AUTO_ > COMMIT_CONFIG, > Boolean.toString(!runtimeContext.isCheckpointingEnabled())); > > > If flink checkpointing is enabled, the auto commit in kafka is disabled, I > am still trying to find out how to get a external view from the kafka > offset > utilities in this scenario. > > Thanks, > Prabhu > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Flink-kafka- > group-question-tp8185p8374.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >
