[jira] [Commented] (FLINK-25646) Document buffer debloating issues with high parallelism

[ https://issues.apache.org/jira/browse/FLINK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865737#comment-17865737 ] Jufang He commented on FLINK-25646: --- After investigating, I found two possible causes

[jira] [Commented] (FLINK-25646) Document buffer debloating issues with high parallelism

[ https://issues.apache.org/jira/browse/FLINK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856683#comment-17856683 ] Jufang He commented on FLINK-25646: --- Hi [~pnowojski]  {quote}does it mean for buffer d

[jira] [Comment Edited] (FLINK-25646) Document buffer debloating issues with high parallelism

[ https://issues.apache.org/jira/browse/FLINK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856252#comment-17856252 ] Jufang He edited comment on FLINK-25646 at 6/19/24 11:56 AM: -

[jira] [Commented] (FLINK-25646) Document buffer debloating issues with high parallelism

[ https://issues.apache.org/jira/browse/FLINK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856252#comment-17856252 ] Jufang He commented on FLINK-25646: --- [~pnowojski] I would like to ask if there is any

[jira] [Comment Edited] (FLINK-25646) Document buffer debloating issues with high parallelism

[ https://issues.apache.org/jira/browse/FLINK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856252#comment-17856252 ] Jufang He edited comment on FLINK-25646 at 6/19/24 11:55 AM: -

[jira] [Created] (FLINK-34558) Add RocksDB key/value size metrics

Jufang He created FLINK-34558: - Summary: Add RocksDB key/value size metrics Key: FLINK-34558 URL: https://issues.apache.org/jira/browse/FLINK-34558 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822107#comment-17822107 ] Jufang He commented on FLINK-33856: --- [~martijnvisser] Thank you for your reply. The de

[jira] [Commented] (FLINK-34334) Add sub-task level RocksDB file count metric

[ https://issues.apache.org/jira/browse/FLINK-34334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818233#comment-17818233 ] Jufang He commented on FLINK-34334: --- cc [~pnowojski]  > Add sub-task level RocksDB fi

[jira] [Commented] (FLINK-34334) Add sub-task level RocksDB file count metric

[ https://issues.apache.org/jira/browse/FLINK-34334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814771#comment-17814771 ] Jufang He commented on FLINK-34334: --- [~masteryhx] Thanks for your advice, I intend to

[jira] [Updated] (FLINK-34386) Add RocksDB bloom filter metrics

[ https://issues.apache.org/jira/browse/FLINK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jufang He updated FLINK-34386: -- Description: In our production environment, with RocksDB bloom filter enabled, the performance optimi

[jira] [Commented] (FLINK-34386) Add RocksDB bloom filter metrics

[ https://issues.apache.org/jira/browse/FLINK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814681#comment-17814681 ] Jufang He commented on FLINK-34386: --- [~pnowojski] could you take a look at this?  > A

[jira] [Updated] (FLINK-34386) Add RocksDB bloom filter metrics

[ https://issues.apache.org/jira/browse/FLINK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jufang He updated FLINK-34386: -- Description: In our production environment, with RocksDB bloom filter enabled, the performance optimi

[jira] [Created] (FLINK-34386) Add RocksDB bloom filter metrics

Jufang He created FLINK-34386: - Summary: Add RocksDB bloom filter metrics Key: FLINK-34386 URL: https://issues.apache.org/jira/browse/FLINK-34386 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-34334) Add sub-task level RocksDB file count metric

[ https://issues.apache.org/jira/browse/FLINK-34334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814152#comment-17814152 ] Jufang He commented on FLINK-34334: --- [~masteryhx] could you take a look at this?  > A

[jira] [Created] (FLINK-34334) Add sub-task level RocksDB file count metric

Jufang He created FLINK-34334: - Summary: Add sub-task level RocksDB file count metric Key: FLINK-34334 URL: https://issues.apache.org/jira/browse/FLINK-34334 Project: Flink Issue Type: Improvemen

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810877#comment-17810877 ] Jufang He commented on FLINK-33856: --- [~martijnvisser] I tried to signup for confluenc

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810783#comment-17810783 ] Jufang He commented on FLINK-33856: --- [~pnowojski] I wrote a draft of a flip, but found

[jira] [Comment Edited] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807019#comment-17807019 ] Jufang He edited comment on FLINK-33856 at 1/16/24 3:51 AM:

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807019#comment-17807019 ] Jufang He commented on FLINK-33856: --- ok, I'll get to work on it. > Add metrics to mon

[jira] [Comment Edited] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17803459#comment-17803459 ] Jufang He edited comment on FLINK-33856 at 1/5/24 8:39 AM: --- [~

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17803459#comment-17803459 ] Jufang He commented on FLINK-33856: --- [~pnowojski] Thanks for your advice. It seems th

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802147#comment-17802147 ] Jufang He commented on FLINK-33856: --- [~pnowojski] It seems reasonable to use TraceRepo

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800412#comment-17800412 ] Jufang He commented on FLINK-33856: --- [~masteryhx] [~Weijie Guo]  I have created a PR f

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17799247#comment-17799247 ] Jufang He commented on FLINK-33856: --- [~Jiang Xin] Yes, this metrics optimization has b

[jira] [Created] (FLINK-33868) Add checkpoint metrics: the latency to write the file

Jufang He created FLINK-33868: - Summary: Add checkpoint metrics: the latency to write the file Key: FLINK-33868 URL: https://issues.apache.org/jira/browse/FLINK-33868 Project: Flink Issue Type: S

[jira] [Created] (FLINK-33869) Add checkpoint metrics: the latency to close the file

Jufang He created FLINK-33869: - Summary: Add checkpoint metrics: the latency to close the file Key: FLINK-33869 URL: https://issues.apache.org/jira/browse/FLINK-33869 Project: Flink Issue Type: S

[jira] [Created] (FLINK-33867) Add checkpoint metrics: the rate of file write

Jufang He created FLINK-33867: - Summary: Add checkpoint metrics: the rate of file write Key: FLINK-33867 URL: https://issues.apache.org/jira/browse/FLINK-33867 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jufang He updated FLINK-33856: -- Description: When Flink makes a checkpoint, the interaction performance with the external file system

[jira] [Updated] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jufang He updated FLINK-33856: -- Description: When Flink makes a Checkpoint, the interaction performance with the external file system

[jira] [Created] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

Jufang He created FLINK-33856: - Summary: Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making Key: FLINK-33856 URL: https://issues.apache.org/

[jira] [Commented] (FLINK-32863) Improve Flink UI's time precision from second level to millisecond level

[ https://issues.apache.org/jira/browse/FLINK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764464#comment-17764464 ] Jufang He commented on FLINK-32863: --- Hi [~guoyangze], I have created a PR([https://gi