Hello All,
Thank you for the suggestions.
We noted that we have these errors in the logs -
SEVERE: The web application [/rel] registered the JBDC driver
[oracle.jdbc.OracleDriver] but failed to unregister it when the web
application was stopped. To prevent a memory leak, the JDBC Driver has been
forcibly unregistered.
Dec 21, 2010 1:41:48 AM org.apache.catalina.loader.WebappClassLoader
clearReferencesThreads
SEVERE: The web application [/rel] appears to have started a thread named
[Thread-7] but has failed to stop it. This is very likely to create a memory
leak.
Dec 21, 2010 1:41:48 AM org.apache.catalina.loader.WebappClassLoader
clearThreadLocalMap
SEVERE: The web application [/rel] created a ThreadLocal with key of type
[org.apache.commons.lang.builder.ReflectionToStringBuilder$1] (value
[org.apache.commons.lang.builder.reflectiontostringbuilde...@29fb93]) and a
value of type [java.util.HashSet] (value [[]]) but failed to remove it when
the web application was stopped. This is very likely to create a memory
leak.
The thread dump has been attached with this mail.
Hope these help.
We are now trying to replicate this issue by running tomcat on port 80
(switching off apache httpd).
I'll post the observations here after we do this.
Thanks again
Sreekumar
On Sun, Dec 19, 2010 at 10:57 PM, Konstantin Kolinko <[email protected]
> wrote:
> 2010/12/17 K J.Sreekumar <[email protected]>:
> > The logs does not show any error.
>
> Do they show anything at all?
>
> > There are only a total of 50-60 threads in the thread dump, mostly in
> WAIT
> > state. Also, it does not show any BLOCKING or LOCKED threads.
>
> It would be interesting to look at the thread dump.
>
> If it is too long for the e-mail, you may post it somewhere else, e.g.
> to a pastebin site.
>
> Your telnet test,
>
> > HTTP/1.1 400 Bad Request
> > Server: Apache-Coyote/1.1
> > Transfer-Encoding: chunked
> > Date: Sat, 18 Dec 2010 09:57:04 GMT
> > Connection: close
>
> shows that Tomcat processes incoming connections (and correctly
> identifies your HTTP/1.1 request as an invalid one). So maybe it is
> only your webapp that fails.
>
> > Memory utilization was 400MB only
> > TOMCAT restart does not fix the problem. The machine needs to be
> restarted
> > to resume normal operation.
>
> 1. Are you sure that restart was successful? I.e., that "stop" part of
> it has actually stopped Tomcat and freed resources.
>
> 2. Maybe there are some external resources (database? exhausting free
> space on a hard drive?) I wonder what can it be that can be exhausted
> and is not freed by Tomcat shutdown. It is easy to exhaust database
> connections or open file handles, if you do not close them properly,
> but all they should be freed when a Windows application shuts down.
>
> 3. Maybe there is anything in the system Events log.
>
> 4. If you stop and start Tomcat after the failure, are all the usual
> startup time messages present in the logs? Maybe there are some
> messages, like the webapp failing to start.
>
> 5. You may deploy the manager webapp, accessible as
> http://<server>:<port>/manager/html
> It will show you the status of your webapps and the requests that are
> currently being processed.
>
> > Netstat did not reveal any extraneous connections
> >
> > We are running Tomcat 6.0.29 on the following platform -
> > OS: Windows server 2003 R2 Enterprise Edition SP2
> > Hardware: Intel Xeon L5520 2.27 GHz (16 CPU threads )
> > The server.xml we are using has been attached with this mail.
> >
>
> Best regards,
> Konstantin Kolinko
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>
>
Console CTRL+BREAK event signaled
2010-12-18 04:00:04
Full thread dump Java HotSpot(TM) Server VM (17.0-b17 mixed mode):
"File Reaper"
daemon
prio=10 tid=0x60e52800
nid=0x868
in Object.wait()
[0x6551f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x27c28b70>
(a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x27c28b70>
(a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at org.apache.commons.io.FileCleaner$1.run(FileCleaner.java:62)
"File Reaper"
daemon
prio=10 tid=0x64798400
nid=0x9a0
in Object.wait()
[0x6523f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x27c28b90>
(a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x27c28b90>
(a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at org.apache.commons.io.FileCleaner$1.run(FileCleaner.java:62)
"http-8080-6"
daemon
prio=6 tid=0x63ce8400
nid=0x854
in Object.wait()
[0x668ff000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x20d226d0>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.await(AprEndpoint.java:1540)
- locked <0x20d226d0>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1565)
at java.lang.Thread.run(Thread.java:619)
"http-8080-5"
daemon
prio=6 tid=0x6372d800
nid=0x1200
in Object.wait()
[0x66a0f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x196f41b0>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.await(AprEndpoint.java:1540)
- locked <0x196f41b0>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1565)
at java.lang.Thread.run(Thread.java:619)
"http-8080-4"
daemon
prio=6 tid=0x63531400
nid=0x1400
in Object.wait()
[0x669bf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x196f43f8>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.await(AprEndpoint.java:1540)
- locked <0x196f43f8>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1565)
at java.lang.Thread.run(Thread.java:619)
"http-8080-3"
daemon
prio=6 tid=0x622bf800
nid=0x1740
in Object.wait()
[0x6696f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x19734260>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.await(AprEndpoint.java:1540)
- locked <0x19734260>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1565)
at java.lang.Thread.run(Thread.java:619)
"http-8080-2"
daemon
prio=6 tid=0x6377b800
nid=0x143c
in Object.wait()
[0x6685f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x197347b8>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.await(AprEndpoint.java:1540)
- locked <0x197347b8>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1565)
at java.lang.Thread.run(Thread.java:619)
"http-8080-1"
daemon
prio=6 tid=0x60e94400
nid=0x5f8
in Object.wait()
[0x6680f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x188b1150>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.await(AprEndpoint.java:1540)
- locked <0x188b1150>
(a org.apache.tomcat.util.net.AprEndpoint$Worker)
at
org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1565)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-Acceptor-0"
daemon
prio=6 tid=0x62adc400
nid=0x1348
runnable
[0x667bf000]
java.lang.Thread.State: RUNNABLE
at org.apache.tomcat.jni.Socket.accept(Native Method)
at
org.apache.tomcat.util.net.AprEndpoint$Acceptor.run(AprEndpoint.java:1169)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-CometPoller-7"
daemon
prio=6 tid=0x615fd400
nid=0x1360
in Object.wait()
[0x6676f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x189b4920>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x189b4920>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-CometPoller-6"
daemon
prio=6 tid=0x62411400
nid=0x174c
in Object.wait()
[0x6671f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x189b4ab0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x189b4ab0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-CometPoller-5"
daemon
prio=6 tid=0x62357400
nid=0x14bc
in Object.wait()
[0x666cf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x189b4c40>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x189b4c40>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-CometPoller-4"
daemon
prio=6 tid=0x62891400
nid=0x56c
in Object.wait()
[0x6667f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x189b4dd0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x189b4dd0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-CometPoller-3"
daemon
prio=6 tid=0x616c8800
nid=0x1138
in Object.wait()
[0x6662f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x189b4f60>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x189b4f60>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-CometPoller-2"
daemon
prio=6 tid=0x612f5400
nid=0xad0
in Object.wait()
[0x665df000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x189b50f0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x189b50f0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-CometPoller-1"
daemon
prio=6 tid=0x62b3fc00
nid=0x13bc
in Object.wait()
[0x6658f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18391080>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18391080>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-CometPoller-0"
daemon
prio=6 tid=0x62434400
nid=0x1414
in Object.wait()
[0x6653f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x189b5280>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x189b5280>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-Poller-7"
daemon
prio=6 tid=0x61426800
nid=0x12dc
in Object.wait()
[0x664ef000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a604e8>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a604e8>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-Poller-6"
daemon
prio=6 tid=0x636ec400
nid=0x15a4
in Object.wait()
[0x6649f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18391210>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18391210>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-Poller-5"
daemon
prio=6 tid=0x62498800
nid=0x16d4
in Object.wait()
[0x6644f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a60670>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a60670>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-Poller-4"
daemon
prio=6 tid=0x63108c00
nid=0x1354
in Object.wait()
[0x65fff000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a7b0e0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a7b0e0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-Poller-3"
daemon
prio=6 tid=0x6141a800
nid=0x121c
in Object.wait()
[0x65faf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a607f8>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a607f8>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-Poller-2"
daemon
prio=6 tid=0x619b8400
nid=0x17f0
in Object.wait()
[0x65f5f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a7b268>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a7b268>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-Poller-1"
daemon
prio=6 tid=0x63900400
nid=0x16dc
in Object.wait()
[0x65f0f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a7b3f0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a7b3f0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ajp-8009-Poller-0"
daemon
prio=6 tid=0x61bd1800
nid=0x1198
in Object.wait()
[0x65ebf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a60980>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a60980>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Acceptor-0"
daemon
prio=6 tid=0x6233d400
nid=0xf18
runnable
[0x65e6f000]
java.lang.Thread.State: RUNNABLE
at org.apache.tomcat.jni.Socket.accept(Native Method)
at
org.apache.tomcat.util.net.AprEndpoint$Acceptor.run(AprEndpoint.java:1169)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Sendfile-0"
daemon
prio=6 tid=0x625a0800
nid=0x12f0
in Object.wait()
[0x65e1f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a7b6b8>
(a org.apache.tomcat.util.net.AprEndpoint$Sendfile)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Sendfile.run(AprEndpoint.java:1805)
- locked <0x18a7b6b8>
(a org.apache.tomcat.util.net.AprEndpoint$Sendfile)
at java.lang.Thread.run(Thread.java:619)
"http-8080-CometPoller-7"
daemon
prio=6 tid=0x62762400
nid=0xb00
in Object.wait()
[0x65dcf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a60b08>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a60b08>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-CometPoller-6"
daemon
prio=6 tid=0x627ed400
nid=0x14c8
in Object.wait()
[0x65d7f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a7b8c0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a7b8c0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-CometPoller-5"
daemon
prio=6 tid=0x62c28400
nid=0x1374
in Object.wait()
[0x65d2f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a60ca0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a60ca0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-CometPoller-4"
daemon
prio=6 tid=0x625a6400
nid=0xadc
in Object.wait()
[0x65cdf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a7ba58>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a7ba58>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-CometPoller-3"
daemon
prio=6 tid=0x6298b400
nid=0x17c8
in Object.wait()
[0x65c8f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a60e38>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a60e38>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-CometPoller-2"
daemon
prio=6 tid=0x62754400
nid=0x10e0
in Object.wait()
[0x65c3f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a7bbf0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a7bbf0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-CometPoller-1"
daemon
prio=6 tid=0x60e59400
nid=0x1768
in Object.wait()
[0x65bef000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a7bd88>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a7bd88>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-CometPoller-0"
daemon
prio=6 tid=0x613c3c00
nid=0x16f0
in Object.wait()
[0x65b9f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a60fd0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a60fd0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Poller-7"
daemon
prio=6 tid=0x61463400
nid=0x290
in Object.wait()
[0x65b4f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a7bf20>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a7bf20>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Poller-6"
daemon
prio=6 tid=0x61dd4400
nid=0xa94
in Object.wait()
[0x65aff000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a61168>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a61168>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Poller-5"
daemon
prio=6 tid=0x6145b400
nid=0x16c8
in Object.wait()
[0x658af000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18a612f0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18a612f0>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Poller-4"
daemon
prio=6 tid=0x61649400
nid=0x126c
in Object.wait()
[0x6585f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18b41d30>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18b41d30>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Poller-3"
daemon
prio=6 tid=0x6198e400
nid=0x1480
in Object.wait()
[0x6580f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18b4cd50>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18b4cd50>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Poller-2"
daemon
prio=6 tid=0x63143400
nid=0x1684
in Object.wait()
[0x657bf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18b41eb8>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18b41eb8>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Poller-1"
daemon
prio=6 tid=0x633aac00
nid=0x768
in Object.wait()
[0x6576f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18b4ced8>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18b4ced8>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"http-8080-Poller-0"
daemon
prio=6 tid=0x61976400
nid=0x1588
in Object.wait()
[0x6571f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x18b42040>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Object.wait(Object.java:485)
at
org.apache.tomcat.util.net.AprEndpoint$Poller.run(AprEndpoint.java:1336)
- locked <0x18b42040>
(a org.apache.tomcat.util.net.AprEndpoint$Poller)
at java.lang.Thread.run(Thread.java:619)
"ContainerBackgroundProcessor[StandardEngine[Catalina]]"
daemon
prio=6 tid=0x637e5400
nid=0x14fc
waiting on condition
[0x6560f000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1579)
at java.lang.Thread.run(Thread.java:619)
"Thread-7"
prio=6 tid=0x637c5400
nid=0xf7c
waiting on condition
[0x655bf000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at
com.pearson.rel.webapp.servlets.bosh.Janitor.run(Janitor.java:57)
at java.lang.Thread.run(Thread.java:619)
"Store userCache Spool Thread"
daemon
prio=6 tid=0x61966400
nid=0x628
waiting on condition
[0x656cf000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at
net.sf.ehcache.store.DiskStore.spoolAndExpiryThreadMain(DiskStore.java:669)
at net.sf.ehcache.store.DiskStore.access$900(DiskStore.java:74)
at
net.sf.ehcache.store.DiskStore$SpoolAndExpiryThread.run(DiskStore.java:1170)
"net.sf.ehcache.cachemana...@17ee3e5"
daemon
prio=6 tid=0x62295c00
nid=0xaa8
in Object.wait()
[0x6556f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x17ff7930>
(a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x17ff7930>
(a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Timer-0"
daemon
prio=6 tid=0x635cdc00
nid=0x13d8
in Object.wait()
[0x6567f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x17fbfc28>
(a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x17fbfc28>
(a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Thread-3"
daemon
prio=6 tid=0x62b3f400
nid=0x15e0
waiting on condition
[0x653cf000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at
org.apache.commons.pool.impl.GenericObjectPool$Evictor.run(GenericObjectPool.java:1080)
at java.lang.Thread.run(Thread.java:619)
"GC Daemon"
daemon
prio=2 tid=0x61957800
nid=0x13a8
in Object.wait()
[0x620ff000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x13d54028>
(a sun.misc.GC$LatencyLock)
at sun.misc.GC$Daemon.run(GC.java:100)
- locked <0x13d54028>
(a sun.misc.GC$LatencyLock)
"Thread-2"
prio=6 tid=0x60e33000
nid=0xbec
runnable
[0x6128f000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)
- locked <0x18a211c0>
(a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at
org.apache.catalina.core.StandardServer.await(StandardServer.java:389)
at org.apache.catalina.startup.Catalina.await(Catalina.java:662)
at org.apache.catalina.startup.Catalina.start(Catalina.java:614)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
at
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
"Low Memory Detector"
daemon
prio=6 tid=0x60df4400
nid=0xb44
runnable
[0x00000000]
java.lang.Thread.State: RUNNABLE
"CompilerThread1"
daemon
prio=10 tid=0x60df1c00
nid=0x660
waiting on condition
[0x00000000]
java.lang.Thread.State: RUNNABLE
"CompilerThread0"
daemon
prio=10 tid=0x60debc00
nid=0x1424
waiting on condition
[0x00000000]
java.lang.Thread.State: RUNNABLE
"Attach Listener"
daemon
prio=10 tid=0x60dea400
nid=0x10c0
runnable
[0x00000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher"
daemon
prio=10 tid=0x60de9400
nid=0x1648
waiting on condition
[0x00000000]
java.lang.Thread.State: RUNNABLE
"Finalizer"
daemon
prio=8 tid=0x60a46400
nid=0xf5c
in Object.wait()
[0x6105f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x13d5ffc0>
(a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x13d5ffc0>
(a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler"
daemon
prio=10 tid=0x60a45000
nid=0x2b8
in Object.wait()
[0x6100f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x13d54018>
(a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x13d54018>
(a java.lang.ref.Reference$Lock)
"main"
prio=6 tid=0x00616800
nid=0x14c4
runnable
[0x00000000]
java.lang.Thread.State: RUNNABLE
"VM Thread"
prio=10 tid=0x60a42400
nid=0x1274
runnable
"GC task thread#0 (ParallelGC)"
prio=6 tid=0x0061e000
nid=0x11c4
runnable
"GC task thread#1 (ParallelGC)"
prio=6 tid=0x0061f400
nid=0x17e4
runnable
"GC task thread#2 (ParallelGC)"
prio=6 tid=0x60950800
nid=0x14b8
runnable
"GC task thread#3 (ParallelGC)"
prio=6 tid=0x60951c00
nid=0x15c4
runnable
"GC task thread#4 (ParallelGC)"
prio=6 tid=0x60953000
nid=0x16b4
runnable
"GC task thread#5 (ParallelGC)"
prio=6 tid=0x60954400
nid=0x4cc
runnable
"GC task thread#6 (ParallelGC)"
prio=6 tid=0x60955c00
nid=0xd80
runnable
"GC task thread#7 (ParallelGC)"
prio=6 tid=0x60957000
nid=0x1748
runnable
"GC task thread#8 (ParallelGC)"
prio=6 tid=0x60958400
nid=0x1624
runnable
"GC task thread#9 (ParallelGC)"
prio=6 tid=0x60959800
nid=0x258
runnable
"GC task thread#10 (ParallelGC)"
prio=6 tid=0x6095ac00
nid=0x10dc
runnable
"GC task thread#11 (ParallelGC)"
prio=6 tid=0x6095c000
nid=0x139c
runnable
"GC task thread#12 (ParallelGC)"
prio=6 tid=0x6095d400
nid=0x1784
runnable
"VM Periodic Task Thread"
prio=10 tid=0x60dfe400
nid=0x13d4
waiting on condition
JNI global references: 1801
Heap
PSYoungGen
total 300544K, used 58496K
[0x47000000, 0x5c550000, 0x60950000)
eden
space 250816K, 22% used
[0x47000000,0x4a817c90,0x564f0000)
from
space 49728K, 2% used
[0x594c0000,0x595c8530,0x5c550000)
to
space 48960K, 0% used
[0x564f0000,0x564f0000,0x594c0000)
PSOldGen
total 699072K, used 327254K
[0x13d50000, 0x3e800000, 0x47000000)
object
space 699072K, 46% used
[0x13d50000,0x27ce5938,0x3e800000)
PSPermGen
total 130176K, used 62003K
[0x03d50000, 0x0bc70000, 0x13d50000)
object
space 130176K, 47% used
[0x03d50000,0x079dcec8,0x0bc70000)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
