what does the utilization metric in SamzaContainerMetrics show?

Hi, I was wondering what does this utilization metric in the SamzaContainerMetrics show? I am asking this sine in the code it is calculated as below: while (!shutdownNow) { val loopStartTime = clock(); process window commit val totalMs = clock() - loopStartTime metrics.utilization.se

Re: what does the utilization metric in SamzaContainerMetrics show?

Hi Shadi, Thanks for asking. This metric tracks the utilization of the event loop within a samza container, which uses a single thread, that is in charge of reading and writing messages, flushing metrics, checkpointing, an

Re: what does the utilization metric in SamzaContainerMetrics show?

Thanks for your prompt reply. I just don’t see when will there be an idle time that is not added to the activeMs but is counted in the totalMs. Because as far as I can tell, if one of the process,window, or commit takes more time it will be reflected in the activeMs value as well. On 6/25/15, 7

Re: what does the utilization metric in SamzaContainerMetrics show?

Shadi, you are absolutely right. I created a diff ( https://reviews.apache.org/r/36274/) to properly calculate activeMs. Feel free to leave any comments there. Thanks for pointing this out :) ᐧ On Fri, Jun 26, 2015 at 9:40 AM, Shadi Noghabi < snogh...@linkedin.com.invalid> wrote: > > Thanks for y