[ 
https://issues.apache.org/jira/browse/FLINK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17649362#comment-17649362
 ] 

Martijn Visser commented on FLINK-30450:
----------------------------------------

With regards to this request, are you looking at FileSource / FileSink (to read 
and/or write files) or also looking at this from a checkpoint/savepointing 
perspective?

If the first, it would be a duplicate of FLINK-28021 / FLINK-28117 imho. 

Exposing the Presto / Hadoop metrics might not be trivial given that these are 
loaded via the Flink plugin mechanism 
https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/filesystems/plugins/
It would probably require a FLIP and a discussion the Dev mailing list

> FileSystem supports exporting client-side metrics
> -------------------------------------------------
>
>                 Key: FLINK-30450
>                 URL: https://issues.apache.org/jira/browse/FLINK-30450
>             Project: Flink
>          Issue Type: New Feature
>          Components: FileSystems
>            Reporter: Hangxiang Yu
>            Priority: Major
>
> Client-side metrics, or job level metrics for filesystem could help us to 
> monitor filesystem more precisely.
> Some metrics (like request rate , throughput, latency, retry count, etc) are 
> useful to monitor the network or client problem of checkpointing or other 
> access cases for a job.  
> Some filesystems like s3, s3-presto, gs have supported enabling some metrics, 
> these could be exported in the filesystem.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to