Re: DUCC services statistics
Hi, As you may see, the default DUCC pinger for UIMA-AS services scraps JMX stats from the service broker to report the number of producers and consumers, the queue depth and a few other things. This pinger also does stat reset operations on each call to the pinger, I think every 2 minutes. A custom pinger can easily be created that does not do the reset, or even the getMeta call if desired. The string that pingers return to DUCC are displayed as hover text over the entries in the "State" column, for example over "Available". Eddie On Thu, Jul 19, 2018 at 7:31 AM, Daniel Baumartz < bauma...@stud.uni-frankfurt.de> wrote: > Hi, > > we have a DUCC installation with different services that are being used by > jobs and external clients. We want to collect some statistics for a > monitoring tool that are not included in the DUCC dashboard, e.g. how often > and when a service/queue has been used, which services are used by which > client at the moment... > > It looks like I could get these information by monitoring the ActiveMQ > messages with an external program, or by using a custom Pinger? What would > be the best way to handle this? > > Thanks, > Daniel >
Re: High CPU Load on Job Driver
Hi Rohit, What is the collection reader running in the job driver doing? Look at the memory use (RSS) value for the job driver on the job details page. If nothing is logged (be sure to check ducc.log file) my guess would be that the JD ran out of RAM in its cgroup and was killed. The JD cgroup size can be increased dynamically for future jobs without DUCC restart by editing ducc.properties (ducc.jd.share.quantum) The default Xmx for JD is specified by ducc.driver.jvm.args. Eddie On Wed, Jul 18, 2018 at 9:12 AM, Rohit yadav wrote: > Hi, > > I am running a job on DUCC along with CR,AE and CC.But while running Job > Driver ,CPU consumption of JD increases to 600%. > I wanted to know is it normal to have high CPU consumption in Job Driver. > Also after running for 1-2 hours the DUCC stops. > And after i restart the DUCC and check the logs of JD there is nothing > mentioned why DUCC stopped. > Also, my DUCC is running on 3 nodes. > The JD is configured at the head node. > -- > Best, > *Rohit Yadav* >
Re: DUCC services statistics
Daniel, you can monitor AMQ to discover client connections and also monitor queue activity. Jerry On Thu, Jul 19, 2018 at 7:31 AM Daniel Baumartz < bauma...@stud.uni-frankfurt.de> wrote: > Hi, > > we have a DUCC installation with different services that are being used > by jobs and external clients. We want to collect some statistics for a > monitoring tool that are not included in the DUCC dashboard, e.g. how > often and when a service/queue has been used, which services are used by > which client at the moment... > > It looks like I could get these information by monitoring the ActiveMQ > messages with an external program, or by using a custom Pinger? What > would be the best way to handle this? > > Thanks, > Daniel >
DUCC services statistics
Hi, we have a DUCC installation with different services that are being used by jobs and external clients. We want to collect some statistics for a monitoring tool that are not included in the DUCC dashboard, e.g. how often and when a service/queue has been used, which services are used by which client at the moment... It looks like I could get these information by monitoring the ActiveMQ messages with an external program, or by using a custom Pinger? What would be the best way to handle this? Thanks, Daniel
