Re: streaming file sink OUT metrics not populating

2021-06-09 Thread Arvid Heise
For reference, the respective FLIP shows the ideas [1]. It's on our agenda for 1.14. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-33%3A+Standardize+Connector+Metrics On Thu, Jun 3, 2021 at 6:41 PM Chesnay Schepler wrote: > This is a known issue, and cannot be fixed on the user

Re: streaming file sink OUT metrics not populating

2021-06-03 Thread Chesnay Schepler
This is a known issue, and cannot be fixed on the user side. The underlying problem is that this needs to be implemented separately for each source/sink and we haven't gotten around to doing that yet, but some progress is being made for 1.14 to that end. On 6/3/2021 6:06 PM, Vijayendra Yadav

streaming file sink OUT metrics not populating

2021-06-03 Thread Vijayendra Yadav
Hi Team, I am using streaming file sink and sinking data to s3. Also, using Graphite exporter for metrics. I can see correct counters for Source, Map, Filter functions. But for SINK, only* numRecordsIn* is populating, I am looking to get *numRecordsOut *counts also, but it's always staying 0