Hello,

We are working on a Flink project which uses FileSource to discover and
read Parquet Files from GCS. ( using Flink 1.14)

As part of this, we wanted to implement some health metrics around the
code.
I wanted to know whether Flink gathers some metrics by itself around
FileSource, e;g, number of files discovered by the SplitEnumerator, number
of files added back to SplitAssigner, time taken to process per split, etc ?

I checked in the official documentation
<https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/filesystem/>
but there doesn't appear to be. Is the solution then to implement
custom metrics like this
<https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/ops/metrics/>
?


*Regards,*
*Meghajit*

Reply via email to