Hi Phil,
Thanks for using MetricsPusher and Beam in general !
- MetricsHttpSink works that way: it filters out committed metrics from the
json output when committed metrics are not
supported. I checked, Flink runner still does not support committed metrics.
So there should be no committed metrics
values in the output json.There might be a bug. I'll open a ticket: thx for
pointing out ! You tested on flink and spark
right? and both output committed metrics values right?
- there is no default mechanism to fallback committed metrics values on
attempted ones
- Apache Flink does no make flink Accumulators available in detached mode, so
indeed, metrics are not available in this
mode.
CCing dev list.
Etienne
Le lundi 26 novembre 2018 à 15:57 -0600, Phil Franklin a écrit :
> All of the discussion I’ve seen says that Flink and Spark only provided
> attempted metric values, but when I use
> MetricsHttpSink and look at the JSON it has both attempted and committed
> values (albeit, both the same for my simple
> testing). Has the metrics processing been updated recently, and I’m just
> missing the change updates? Or are the
> committed values being defaulted to the attempted values?
>
> Also, I’ve seen it mentioned that Flink doesn’t report metrics when in
> detached mode. Is this still the case?
>
>
> Thanks for your help!