Flink - Metric are not reported

2018-11-27 Thread bastien dine
Hello everyone, Once again I require your help ! I am trying to report custom metric (see my code below) Yet, I do not see them anywhere.. nor in the metric tab from my tasks, nor in the rest API, nor in the declared slf4j reporter.. Can someone help me to debug this .. Here is my RichMap functio

Re: Flink - Metric are not reported

2018-11-27 Thread Chesnay Schepler
Please enable WARN logging and check for warnings by the SLF4JReporter and/or MetricQueryService. On 27.11.2018 17:00, bastien dine wrote: Hello everyone, Once again I require your help ! I am trying to report custom metric (see my code below) Yet, I do not see them anywhere.. nor in the metri

Re: Flink - Metric are not reported

2018-11-28 Thread bastien dine
Hello Chesnay, Thanks for your response ! I have logs enable (info), slf4jReporter is working, I can see : 15:16:00.112 [Flink-MetricRegistry-thread-1] INFO org.apache.flink.metrics.slf4j.Slf4jReporter - === Starting metrics report === -- Counters

Re: Flink - Metric are not reported

2018-11-28 Thread Chesnay Schepler
How quick does job batch terminate? Metrics are unregistered once the job ends; if the job duration is shorter than the report interval they may never be exposed. On 28.11.2018 15:18, bastien dine wrote: Hello Chesnay, Thanks for your response ! I have logs enable (info), slf4jReporter is wor

Re: Flink - Metric are not reported

2018-11-28 Thread bastien dine
Yea, that was I was thinking.. Batch can be quick Can I report metric on "added" action ? (i should override the notifyOnAddedMetric to report ?) -- Bastien DINE Data Architect / Software Engineer / Sysadmin bastiendine.io Le mer. 28 nov. 2018 à 15:54, Chesnay Schepler a écrit

Re: Flink - Metric are not reported

2018-11-28 Thread Chesnay Schepler
Yes, you can override notifyOnAddedMetric/notifyOnRemovedMetric to ensure that a metric is logged at least once. On 28.11.2018 16:01, bastien dine wrote: Yea, that was I was thinking.. Batch can be quick Can I report metric on "added" action ? (i should override the notifyOnAddedMetric to repo