I think you are looking for https://issues.apache.org/jira/browse/BEAM-3310
On Sat, May 9, 2020 at 6:23 PM Talat Uyarer <tuya...@paloaltonetworks.com> wrote: > Hi, > > I want to get Kafka's backlog metrics. In apache beam code I saw beam is > collecting that metrics in here[1] as Source Metrics. However I can not see > those metrics on Dataflow's metrics explorer. Do you know is there > anyway to get those metrics ? > > Also I saw there is MetricsSink. But based on beam documentation it is not > supported by Dataflow. Is there any ticket to give support MetrcisSink > support to Dataflow Runner ? > > Thanks > > [1] > https://github.com/apache/beam/blob/d309c1b7c39ba78aa0cbd5cad9cc7a256e3caa9f/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaUnboundedReader.java#L673 > >
