[ https://issues.apache.org/jira/browse/NIFI-10167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561098#comment-17561098 ]
ASF subversion and git services commented on NIFI-10167: -------------------------------------------------------- Commit 5e83bda9e9986001a060171df1bca609b4c9aad1 in nifi's branch refs/heads/main from Mark Payne [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=5e83bda9e9 ] NIFI-10167: Added advanced timing metrics for processors, such as CPU Usage, time reading/writing content repo, process session commit time, etc. Exposed via nifi.sh diagnostics and made configurable via nifi.properties This closes #6156 Signed-off-by: David Handermann <exceptionfact...@apache.org> > Allow tracking of detailed metrics such as CPU Usage by processors > ------------------------------------------------------------------ > > Key: NIFI-10167 > URL: https://issues.apache.org/jira/browse/NIFI-10167 > Project: Apache NiFi > Issue Type: New Feature > Components: Core Framework > Reporter: Mark Payne > Assignee: Mark Payne > Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > > NiFi offers a great deal of detail on the canvas about how much data was > read/written in the past 5 minutes, number of tasks run, and how much time > that took. > However, a question we are often asked is "which processors are using up all > of my CPU?" From looking at tools like {{top}} we can see that NiFi is using > a lot of CPU. And we can guess, based on the fact that Processor A spent 50 > minutes of Processing time over the past 5 minutes that Processor A is likely > using a lot of resources. But we cannot really know for sure how much CPU it > is using vs. disk/socket I/O waits, etc. > This task will introduce more detailed metrics such as how many seconds of > CPU time a processor has consumed, how much time it has spent reading/writing > to the content repo, etc. These metrics should be exposed via the {{nifi.sh > diagnostics}} command. > We should make clear both how much of a Processor's time is spent using CPU, > as well as what percentage of the total CPU used by NiFi was spent for a > given Processor. This will significantly help understand the resource usage > characteristics of a given component. > However, tracking this may be expensive. So we should provide the ability to > turn this feature on/off and ideally also allow for sampling of metrics and > extrapolating out those numbers so that we can monitor these things only for > a percentage of invocations and then give reasonable estimations based on > that. -- This message was sent by Atlassian Jira (v8.20.10#820010)