Bryan, Thanks, that is indeed helpful to see, to be clear about which kind of threads are causing the problem.
-- Peter On Jan 13, 2012, at 9:52 AM, Bryan Thompson wrote: > Peter, > > There is very little information in there. Basically a whole lot of "DGC > Lease Checker" threads all sleeping in Thread.run(). > > The stacks below are from a capture in yourkit that I had on hand from when I > was investigating this problem. The workload had been removed from the > service but the leases had not yet expired. > > Thanks, > Bryan > > Stacks at 09:16:02 AM (uptime 1:48:56) > > > (JSK) ConnectionManager.Reaper [SLEEPING] CPU time: 0:00 > java.lang.Thread.sleep(long) > net.jini.jeri.connection.ConnectionManager$Reaper.run() > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Threa > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:00 > java.lang.Thread.run() > > > > (JSK) DGC Lease Checker [SLEEPING] CPU time: 0:hread.run() > > > > com.bigdata.journal.ConcurrencyManager.writeService48 [WAITING] CPU time: 0:00 > java.lang.Thread.run() > > > > com.bigdata.journal.ConcurrencyManager.writeService49 [WAITING] CPU time: 0:00 > java.lang.Thread.run() > > > > com.bigdata.journal.ConcurrencyManager.writeService5 [WAITING] CPU time: 0:00 > java.lang.Thread.run() > > > >> -----Original Message----- >> From: Peter Jones [mailto:p...@roundroom.net] >> Sent: Friday, January 13, 2012 9:31 AM >> To: u...@river.apache.org >> Cc: dev@river.apache.org >> Subject: Re: DGC threads issue >> >> Bryan, >> >> I meant that it might help for the list to "see" the specific >> threads in question, as they appear in a JVM thread dump >> (name, stack frames, etc.), just to be sure that we're >> talking about the same thing. There is more than one kind of >> thread related to DGC, and it seems that the implementation >> has changed recently. But I gather that Peter F. may have >> identified the root cause. >> >> Cheers, >> >> -- Peter >> >> > <DGCThreadDump.txt>