[jira] [Closed] (HUDI-1326) Publishing metrics from hudi-test-suite after each job
[ https://issues.apache.org/jira/browse/HUDI-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1326. Resolution: Fixed > Publishing metrics from hudi-test-suite after each job > -- > > Key: HUDI-1326 > URL: https://issues.apache.org/jira/browse/HUDI-1326 > Project: Apache Hudi > Issue Type: Improvement >Reporter: Prashant Wason >Assignee: Prashant Wason >Priority: Minor > Labels: pull-request-available > Fix For: 0.7.0 > > > HUDI metrics are published at two stages: > 1. When an action completed (e.g. HoodieMetrics.updateCommitMetrics) > 2. When the JVM is shutdown (Metrics.java addShutdownHook) > hudi-test-suite includes multiple jobs each of which is an action on the > table. All these jobs are run in a single JVM. Hence, currently some metrics > are not published till the entire hudi-test-suite run is over. > Enhancement: > 1. Allow metrics to be published after each job > 2. Flush metrics so redundant metrics (from the last job) are not published > again. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (HUDI-1326) Publishing metrics from hudi-test-suite after each job
[ https://issues.apache.org/jira/browse/HUDI-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason closed HUDI-1326. Resolution: Fixed > Publishing metrics from hudi-test-suite after each job > -- > > Key: HUDI-1326 > URL: https://issues.apache.org/jira/browse/HUDI-1326 > Project: Apache Hudi > Issue Type: Improvement >Reporter: Prashant Wason >Assignee: Prashant Wason >Priority: Minor > Labels: pull-request-available > > HUDI metrics are published at two stages: > 1. When an action completed (e.g. HoodieMetrics.updateCommitMetrics) > 2. When the JVM is shutdown (Metrics.java addShutdownHook) > hudi-test-suite includes multiple jobs each of which is an action on the > table. All these jobs are run in a single JVM. Hence, currently some metrics > are not published till the entire hudi-test-suite run is over. > Enhancement: > 1. Allow metrics to be published after each job > 2. Flush metrics so redundant metrics (from the last job) are not published > again. -- This message was sent by Atlassian Jira (v8.3.4#803005)
