Is your job a Dataflow Template job?
The error is caused by
https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/util/DataflowTemplateJob.java#L55
.
So basically DataflowTemplateJob does not support metrics.
On Wed, Jun
Hi Users,
In Google Cloud monitoring there is a limit of 100 metrics and when we are
using KafkaIO, the library publishes a bunch of metrics per topic. With our
use we will easily run out of 100 metric limit.
We want to stop KafkaIO from publishing metrics and I do not see this is
configurable.
