Enviroment
Windows 2008 R2 Tomcat 8.0.11 Java 1.8.0_20-b26 Sysco HTTPS Firewall (They have to authenticate through it first) HTTPS only Memory Pool=3072MB Thread Stack Size=384 Problem We recently moved to a new Windows server, I installed the exact same software on the new server as the old. The problem is that on the new server Tomcat has a JVM crash two to four times a week almost at the exact same time 11:30PM. This happens to be during the time we have our greatest number of active sessions but not the heaviest use. I have looked into "localhost_access_log" but the last logged requests don't seem to be the problem. I fear it's not being logged. I have nothing to go on other than the error log which doesn't appear to show a cause other than the blocked threads. I have submitted the report to Oracle but they have failed to comment. Today I increased Tomcat logging to Fine and am monitoring the Threads using JConsole. Can anyone point out a tip or clue I may be missing in this report? Thanks, Chad Error Log # # A fatal error has been detected by the Java Runtime Environment: # # Internal Error (sharedRuntime.cpp:833), pid=68716, tid=32568 # fatal error: exception happened outside interpreter, nmethods and vtable stubs at pc 0x0000000001613eb0 # # JRE version: Java(TM) SE Runtime Environment (8.0_20-b26) (build 1.8.0_20-b26) # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.20-b23 mixed mode windows-amd64 compressed oops) # Core dump written. Default location: C:\Program Files\Apache Software Foundation\Tomcat 8.0\hs_err_pid68716.mdmp # # If you would like to submit a bug report, please visit: # http://bugreport.sun.com/bugreport/crash.jsp # --------------- T H R E A D --------------- Current thread (0x0000000024456000): JavaThread "http-nio-443-exec-5" daemon [_thread_in_Java, id=32568, stack(0x0000000029460000,0x00000000294c0000)] Stack: [0x0000000029460000,0x00000000294c0000] Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [jvm.dll+0x3152fa] V [jvm.dll+0x265d03] V [jvm.dll+0x266943] V [jvm.dll+0x25e1e6] V [jvm.dll+0x21247e] V [jvm.dll+0x283070] V [jvm.dll+0x315188] C [ntdll.dll+0x29d0d] C [ntdll.dll+0x191af] C [ntdll.dll+0x51278] C 0x0000000001613eb0 --------------- P R O C E S S --------------- Java Threads: ( => current thread ) 0x000000001ebca800 JavaThread "http-apr-80-exec-10" daemon [_thread_blocked, id=69608, stack(0x000000002a4e0000,0x000000002a540000)] 0x000000001ebca000 JavaThread "http-apr-80-exec-9" daemon [_thread_blocked, id=13816, stack(0x000000002a480000,0x000000002a4e0000)] 0x000000001ebc9000 JavaThread "http-apr-80-exec-8" daemon [_thread_blocked, id=69592, stack(0x000000002a420000,0x000000002a480000)] 0x000000001ebc8800 JavaThread "http-apr-80-exec-7" daemon [_thread_blocked, id=65052, stack(0x000000002a3c0000,0x000000002a420000)] 0x000000001ebc7800 JavaThread "http-apr-80-exec-6" daemon [_thread_blocked, id=54788, stack(0x0000000029d60000,0x0000000029dc0000)] 0x000000001ebc7000 JavaThread "http-apr-80-exec-5" daemon [_thread_blocked, id=70816, stack(0x0000000029d00000,0x0000000029d60000)] 0x000000002445e800 JavaThread "http-apr-80-exec-4" daemon [_thread_blocked, id=15108, stack(0x000000002a260000,0x000000002a2c0000)] 0x000000002445d800 JavaThread "http-apr-80-exec-3" daemon [_thread_blocked, id=59684, stack(0x000000002a200000,0x000000002a260000)] 0x000000002445d000 JavaThread "http-apr-80-exec-2" daemon [_thread_blocked, id=55740, stack(0x0000000020ab0000,0x0000000020b10000)] 0x000000002445b800 JavaThread "http-apr-80-exec-1" daemon [_thread_blocked, id=59352, stack(0x0000000020a50000,0x0000000020ab0000)] 0x000000002445a800 JavaThread "Abandoned connection cleanup thread" daemon [_thread_blocked, id=68752, stack(0x00000000298a0000,0x0000000029900000)] 0x000000002445a000 JavaThread "http-nio-443-exec-10" daemon [_thread_blocked, id=68020, stack(0x0000000029640000,0x00000000296a0000)] 0x0000000024459000 JavaThread "http-nio-443-exec-9" daemon [_thread_blocked, id=63660, stack(0x00000000295e0000,0x0000000029640000)] 0x0000000024458800 JavaThread "http-nio-443-exec-8" daemon [_thread_blocked, id=66844, stack(0x0000000029580000,0x00000000295e0000)] 0x0000000024457800 JavaThread "http-nio-443-exec-7" daemon [_thread_blocked, id=16468, stack(0x0000000029520000,0x0000000029580000)] 0x0000000024457000 JavaThread "http-nio-443-exec-6" daemon [_thread_blocked, id=63612, stack(0x00000000294c0000,0x0000000029520000)] =>0x0000000024456000 JavaThread "http-nio-443-exec-5" daemon [_thread_in_Java, id=32568, stack(0x0000000029460000,0x00000000294c0000)] 0x0000000024455800 JavaThread "http-nio-443-exec-4" daemon [_thread_blocked, id=61776, stack(0x0000000029400000,0x0000000029460000)] 0x0000000024454800 JavaThread "http-nio-443-exec-3" daemon [_thread_blocked, id=55560, stack(0x0000000029270000,0x00000000292d0000)] 0x0000000024454000 JavaThread "http-nio-443-exec-1" daemon [_thread_blocked, id=56992, stack(0x0000000029210000,0x0000000029270000)] 0x0000000024453000 JavaThread "http-nio-443-exec-2" daemon [_thread_blocked, id=60028, stack(0x00000000291b0000,0x0000000029210000)] 0x0000000024452800 JavaThread "ajp-apr-8009-AsyncTimeout" daemon [_thread_blocked, id=63668, stack(0x0000000029150000,0x00000000291b0000)] 0x0000000024451800 JavaThread "ajp-apr-8009-Acceptor-0" daemon [_thread_in_native, id=10844, stack(0x00000000290f0000,0x0000000029150000)] 0x0000000024451000 JavaThread "ajp-apr-8009-Poller" daemon [_thread_blocked, id=11068, stack(0x0000000029090000,0x00000000290f0000)] 0x0000000024450000 JavaThread "http-nio-443-Acceptor-0" daemon [_thread_in_native, id=35680, stack(0x0000000029030000,0x0000000029090000)] 0x000000002444f800 JavaThread "http-nio-443-ClientPoller-1" daemon [_thread_blocked, id=69048, stack(0x0000000028fd0000,0x0000000029030000)] 0x000000001ec78800 JavaThread "http-nio-443-ClientPoller-0" daemon [_thread_blocked, id=12564, stack(0x0000000028f70000,0x0000000028fd0000)] 0x000000001f29c800 JavaThread "http-apr-80-AsyncTimeout" daemon [_thread_blocked, id=6412, stack(0x0000000028f10000,0x0000000028f70000)] 0x000000001f5ef800 JavaThread "http-apr-80-Acceptor-0" daemon [_thread_in_native, id=65120, stack(0x0000000028eb0000,0x0000000028f10000)] 0x000000001ec8a800 JavaThread "http-apr-80-Sendfile" daemon [_thread_blocked, id=51468, stack(0x0000000028e50000,0x0000000028eb0000)] 0x000000001eb24000 JavaThread "http-apr-80-Poller" daemon [_thread_blocked, id=60984, stack(0x0000000028df0000,0x0000000028e50000)] 0x000000001e79f800 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=61280, stack(0x0000000028b90000,0x0000000028bf0000)] 0x000000001edc2800 JavaThread "NioBlockingSelector.BlockPoller-1" daemon [_thread_blocked, id=36068, stack(0x00000000205d0000,0x0000000020630000)] 0x000000001efcd000 JavaThread "GC Daemon" daemon [_thread_blocked, id=64888, stack(0x0000000020040000,0x00000000200a0000)] 0x000000001b670800 JavaThread "AsyncFileHandlerWriter-723074861" daemon [_thread_blocked, id=54820, stack(0x000000001e640000,0x000000001e6a0000)] 0x000000001b5d7800 JavaThread "Service Thread" daemon [_thread_blocked, id=69088, stack(0x000000001e4e0000,0x000000001e540000)] 0x000000001b5bd800 JavaThread "C1 CompilerThread11" daemon [_thread_blocked, id=69816, stack(0x000000001e3e0000,0x000000001e4e0000)] 0x000000001b5b5000 JavaThread "C1 CompilerThread10" daemon [_thread_blocked, id=53776, stack(0x000000001e2e0000,0x000000001e3e0000)] 0x000000001b59a800 JavaThread "C1 CompilerThread9" daemon [_thread_blocked, id=66612, stack(0x000000001e0e0000,0x000000001e1e0000)] 0x000000001b592000 JavaThread "C1 CompilerThread8" daemon [_thread_blocked, id=54560, stack(0x000000001dfe0000,0x000000001e0e0000)] 0x000000001b589000 JavaThread "C2 CompilerThread7" daemon [_thread_blocked, id=55928, stack(0x000000001dee0000,0x000000001dfe0000)] 0x000000001b580800 JavaThread "C2 CompilerThread6" daemon [_thread_blocked, id=57820, stack(0x000000001dde0000,0x000000001dee0000)] 0x000000001b577800 JavaThread "C2 CompilerThread5" daemon [_thread_blocked, id=67852, stack(0x000000001dce0000,0x000000001dde0000)] 0x000000001b565000 JavaThread "C2 CompilerThread4" daemon [_thread_blocked, id=65888, stack(0x000000001dbe0000,0x000000001dce0000)] 0x000000001b54c000 JavaThread "C2 CompilerThread3" daemon [_thread_blocked, id=67640, stack(0x000000001dae0000,0x000000001dbe0000)] 0x000000001b521000 JavaThread "C2 CompilerThread2" daemon [_thread_blocked, id=38860, stack(0x000000001d9e0000,0x000000001dae0000)] 0x000000001b518000 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=59724, stack(0x000000001d8e0000,0x000000001d9e0000)] 0x000000001b506800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=52616, stack(0x000000001d7e0000,0x000000001d8e0000)] 0x000000001b504000 JavaThread "Attach Listener" daemon [_thread_blocked, id=32300, stack(0x000000001d780000,0x000000001d7e0000)] 0x000000001b503000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=55680, stack(0x000000001d720000,0x000000001d780000)] 0x000000001b4bb000 JavaThread "Finalizer" daemon [_thread_blocked, id=9772, stack(0x00000000012d0000,0x0000000001330000)] 0x000000001b4b4800 JavaThread "Reference Handler" daemon [_thread_blocked, id=53388, stack(0x0000000000af0000,0x0000000000b50000)] 0x00000000012ce800 JavaThread "main" [_thread_in_native, id=46784, stack(0x00000000013c0000,0x00000000014c0000)] Other Threads: 0x0000000019575800 VMThread [stack: 0x000000001d620000,0x000000001d720000] [id=63484] 0x000000001b5da000 WatcherThread [stack: 0x000000001e540000,0x000000001e640000] [id=32112] VM state:synchronizing (normal execution) VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event]) [0x00000000014c08b0] Safepoint_lock - owner thread: 0x0000000019575800 [0x00000000014c0930] Threads_lock - owner thread: 0x0000000019575800 Heap: PSYoungGen total 922624K, used 126666K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 803840K, 9% used [0x0000000780000000,0x0000000784ceae08,0x00000007b1100000) from space 118784K, 40% used [0x00000007b1100000,0x00000007b3fc7c50,0x00000007b8500000) to space 112128K, 0% used [0x00000007b9280000,0x00000007b9280000,0x00000007c0000000) ParOldGen total 2097152K, used 58074K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b6b10,0x0000000780000000) Metaspace used 50209K, capacity 55438K, committed 55680K, reserved 1099776K class space used 4841K, capacity 5656K, committed 5760K, reserved 1048576K Card table byte_map: [0x0000000010980000,0x0000000010f90000] byte_map_base: 0x000000000d180000 Marking Bits: (ParMarkBitMap*) 0x000000006f29b460 Begin Bits: [0x0000000012590000, 0x0000000015590000) End Bits: [0x0000000015590000, 0x0000000018590000) Polling page: 0x0000000000210000 CodeCache: size=245760Kb used=45741Kb max_used=45821Kb free=200018Kb bounds [0x00000000015c0000, 0x00000000042e0000, 0x00000000105c0000] total_blobs=11774 nmethods=11191 adapters=493 compilation: enabled Compilation events (10 events): Event: 46687.892 Thread 0x000000001b59a800 14425 ! 3 sun.reflect.GeneratedMethodAccessor1250::invoke (68 bytes) Event: 46687.892 Thread 0x000000001b5bd800 14427 ! 3 sun.reflect.GeneratedMethodAccessor1252::invoke (68 bytes) Event: 46687.892 Thread 0x000000001b5b5000 14426 ! 3 sun.reflect.GeneratedMethodAccessor1251::invoke (61 bytes) Event: 46687.892 Thread 0x000000001b59a800 nmethod 14425 0x00000000042c9790 code [0x00000000042c9980, 0x00000000042ca108] Event: 46687.892 Thread 0x000000001b5b5000 nmethod 14426 0x0000000003196090 code [0x0000000003196260, 0x0000000003196868] Event: 46687.892 Thread 0x000000001b5bd800 nmethod 14427 0x000000000230a510 code [0x000000000230a700, 0x000000000230ae88] Event: 46739.264 Thread 0x000000001b589000 14428 4 java.net.AbstractPlainSocketImpl::<init> (72 bytes) Event: 46739.266 Thread 0x000000001b589000 nmethod 14428 0x00000000031a2150 code [0x00000000031a22a0, 0x00000000031a2458] Event: 46753.276 Thread 0x000000001b521000 14429 4 org.apache.catalina.connector.Request$1::set (9 bytes) Event: 46753.277 Thread 0x000000001b521000 nmethod 14429 0x00000000042c9490 code [0x00000000042c95e0, 0x00000000042c9698] GC Heap History (10 events): Event: 43068.818 GC heap before {Heap before GC invocations=37 (full 6): PSYoungGen total 883712K, used 827684K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 744448K, 100% used [0x0000000780000000,0x00000007ad700000,0x00000007ad700000) from space 139264K, 59% used [0x00000007b7800000,0x00000007bc949328,0x00000007c0000000) to space 152064K, 0% used [0x00000007ad700000,0x00000007ad700000,0x00000007b6b80000) ParOldGen total 2097152K, used 58042K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038aeb10,0x0000000780000000) Metaspace used 49396K, capacity 54468K, committed 54784K, reserved 1097728K class space used 4785K, capacity 5571K, committed 5632K, reserved 1048576K Event: 43068.838 GC heap after Heap after GC invocations=37 (full 6): PSYoungGen total 896512K, used 47125K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 744448K, 0% used [0x0000000780000000,0x0000000780000000,0x00000007ad700000) from space 152064K, 30% used [0x00000007ad700000,0x00000007b0505750,0x00000007b6b80000) to space 142336K, 0% used [0x00000007b7500000,0x00000007b7500000,0x00000007c0000000) ParOldGen total 2097152K, used 58050K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b0b10,0x0000000780000000) Metaspace used 49396K, capacity 54468K, committed 54784K, reserved 1097728K class space used 4785K, capacity 5571K, committed 5632K, reserved 1048576K } Event: 43427.660 GC heap before {Heap before GC invocations=38 (full 6): PSYoungGen total 896512K, used 791573K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 744448K, 100% used [0x0000000780000000,0x00000007ad700000,0x00000007ad700000) from space 152064K, 30% used [0x00000007ad700000,0x00000007b0505750,0x00000007b6b80000) to space 142336K, 0% used [0x00000007b7500000,0x00000007b7500000,0x00000007c0000000) ParOldGen total 2097152K, used 58050K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b0b10,0x0000000780000000) Metaspace used 49436K, capacity 54488K, committed 54784K, reserved 1097728K class space used 4787K, capacity 5574K, committed 5632K, reserved 1048576K Event: 43427.681 GC heap after Heap after GC invocations=38 (full 6): PSYoungGen total 914944K, used 46314K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 772608K, 0% used [0x0000000780000000,0x0000000780000000,0x00000007af280000) from space 142336K, 32% used [0x00000007b7500000,0x00000007ba23aa90,0x00000007c0000000) to space 133632K, 0% used [0x00000007af280000,0x00000007af280000,0x00000007b7500000) ParOldGen total 2097152K, used 58050K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b0b10,0x0000000780000000) Metaspace used 49436K, capacity 54488K, committed 54784K, reserved 1097728K class space used 4787K, capacity 5574K, committed 5632K, reserved 1048576K } Event: 43847.027 GC heap before {Heap before GC invocations=39 (full 6): PSYoungGen total 914944K, used 818922K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 772608K, 100% used [0x0000000780000000,0x00000007af280000,0x00000007af280000) from space 142336K, 32% used [0x00000007b7500000,0x00000007ba23aa90,0x00000007c0000000) to space 133632K, 0% used [0x00000007af280000,0x00000007af280000,0x00000007b7500000) ParOldGen total 2097152K, used 58050K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b0b10,0x0000000780000000) Metaspace used 49719K, capacity 54824K, committed 55040K, reserved 1099776K class space used 4807K, capacity 5610K, committed 5632K, reserved 1048576K Event: 43847.060 GC heap after Heap after GC invocations=39 (full 6): PSYoungGen total 906240K, used 51849K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 772608K, 0% used [0x0000000780000000,0x0000000780000000,0x00000007af280000) from space 133632K, 38% used [0x00000007af280000,0x00000007b2522750,0x00000007b7500000) to space 125952K, 0% used [0x00000007b8500000,0x00000007b8500000,0x00000007c0000000) ParOldGen total 2097152K, used 58058K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b2b10,0x0000000780000000) Metaspace used 49719K, capacity 54824K, committed 55040K, reserved 1099776K class space used 4807K, capacity 5610K, committed 5632K, reserved 1048576K } Event: 45123.043 GC heap before {Heap before GC invocations=40 (full 6): PSYoungGen total 906240K, used 824457K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 772608K, 100% used [0x0000000780000000,0x00000007af280000,0x00000007af280000) from space 133632K, 38% used [0x00000007af280000,0x00000007b2522750,0x00000007b7500000) to space 125952K, 0% used [0x00000007b8500000,0x00000007b8500000,0x00000007c0000000) ParOldGen total 2097152K, used 58058K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b2b10,0x0000000780000000) Metaspace used 49858K, capacity 54932K, committed 55040K, reserved 1099776K class space used 4813K, capacity 5617K, committed 5632K, reserved 1048576K Event: 45123.063 GC heap after Heap after GC invocations=40 (full 6): PSYoungGen total 929792K, used 48767K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 803840K, 0% used [0x0000000780000000,0x0000000780000000,0x00000007b1100000) from space 125952K, 38% used [0x00000007b8500000,0x00000007bb49fd30,0x00000007c0000000) to space 118784K, 0% used [0x00000007b1100000,0x00000007b1100000,0x00000007b8500000) ParOldGen total 2097152K, used 58066K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b4b10,0x0000000780000000) Metaspace used 49858K, capacity 54932K, committed 55040K, reserved 1099776K class space used 4813K, capacity 5617K, committed 5632K, reserved 1048576K } Event: 46534.039 GC heap before {Heap before GC invocations=41 (full 6): PSYoungGen total 929792K, used 852607K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 803840K, 100% used [0x0000000780000000,0x00000007b1100000,0x00000007b1100000) from space 125952K, 38% used [0x00000007b8500000,0x00000007bb49fd30,0x00000007c0000000) to space 118784K, 0% used [0x00000007b1100000,0x00000007b1100000,0x00000007b8500000) ParOldGen total 2097152K, used 58066K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b4b10,0x0000000780000000) Metaspace used 50178K, capacity 55426K, committed 55680K, reserved 1099776K class space used 4840K, capacity 5654K, committed 5760K, reserved 1048576K Event: 46534.069 GC heap after Heap after GC invocations=41 (full 6): PSYoungGen total 922624K, used 47903K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000) eden space 803840K, 0% used [0x0000000780000000,0x0000000780000000,0x00000007b1100000) from space 118784K, 40% used [0x00000007b1100000,0x00000007b3fc7c50,0x00000007b8500000) to space 112128K, 0% used [0x00000007b9280000,0x00000007b9280000,0x00000007c0000000) ParOldGen total 2097152K, used 58074K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000) object space 2097152K, 2% used [0x0000000700000000,0x00000007038b6b10,0x0000000780000000) Metaspace used 50178K, capacity 55426K, committed 55680K, reserved 1099776K class space used 4840K, capacity 5654K, committed 5760K, reserved 1048576K } Deoptimization events (10 events): Event: 42144.821 Thread 0x0000000024458800 Uncommon trap: reason=unreached action=reinterpret pc=0x0000000001e231b8 method=java.lang.String.valueOf(Ljava/lang/Object;)Ljava/lang/String; @ 1 Event: 42238.024 Thread 0x0000000024456000 Uncommon trap: reason=unreached action=reinterpret pc=0x00000000019a75b0 method=org.apache.jasper.runtime.JspWriterImpl.print(Ljava/lang/String;)V @ 1 Event: 43764.466 Thread 0x000000002445a000 Uncommon trap: reason=predicate action=maybe_recompile pc=0x000000000296e934 method=java.text.DecimalFormat.append(Ljava/lang/StringBuffer;Ljava/lang/String;Ljava/text/Format$FieldDelegate;[Ljava/text/FieldPosition;Ljava/text/Format$Field;)V @ 34 Event: 44143.908 Thread 0x0000000024455800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000003005080 method=com.util.util.StringLineBuffer.append(Ljava/lang/Object;)V @ 5 Event: 44143.908 Thread 0x0000000024455800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000003005080 method=com.util.util.StringLineBuffer.append(Ljava/lang/Object;)V @ 5 Event: 44143.908 Thread 0x0000000024455800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000003005080 method=com.util.util.StringLineBuffer.append(Ljava/lang/Object;)V @ 5 Event: 44143.908 Thread 0x0000000024455800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000003005080 method=com.util.util.StringLineBuffer.append(Ljava/lang/Object;)V @ 5 Event: 44207.274 Thread 0x0000000024453000 Uncommon trap: reason=unreached action=reinterpret pc=0x0000000003686e0c method=java.text.DecimalFormat.append(Ljava/lang/StringBuffer;Ljava/lang/String;Ljava/text/Format$FieldDelegate;[Ljava/text/FieldPosition;Ljava/text/Format$Field;)V @ 53 Event: 44990.435 Thread 0x0000000024456000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00000000028f6a5c method=sun.misc.FloatingDecimal.toJavaFormatString(D)Ljava/lang/String; @ 4 Event: 45331.430 Thread 0x0000000024454000 Uncommon trap: reason=unreached action=reinterpret pc=0x0000000001c0b62c method=com.util.util.StringUtil.isInArray(Ljava/lang/String;[Ljava/lang/String;)Z @ 1 Internal exceptions (10 events): Event: 46744.455 Thread 0x0000000024459000 Exception <a 'java/security/PrivilegedActionException'> (0x0000000783e5a790) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Event: 46744.844 Thread 0x0000000024454000 Exception <a 'java/security/PrivilegedActionException'> (0x0000000781a55ed0) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Event: 46744.844 Thread 0x0000000024454000 Exception <a 'java/security/PrivilegedActionException'> (0x0000000781a56b08) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Event: 46744.844 Thread 0x0000000024454000 Exception <a 'java/security/PrivilegedActionException'> (0x0000000781a5b340) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Event: 46746.986 Thread 0x0000000024454800 Exception <a 'java/security/PrivilegedActionException'> (0x0000000781f24488) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Event: 46746.986 Thread 0x0000000024454800 Exception <a 'java/security/PrivilegedActionException'> (0x0000000781f24f90) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Event: 46746.986 Thread 0x0000000024454800 Exception <a 'java/security/PrivilegedActionException'> (0x0000000781f28b48) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Event: 46751.247 Thread 0x0000000024453000 Exception <a 'java/security/PrivilegedActionException'> (0x0000000783db6b08) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Event: 46751.247 Thread 0x0000000024453000 Exception <a 'java/security/PrivilegedActionException'> (0x0000000783db7740) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Event: 46751.247 Thread 0x0000000024453000 Exception <a 'java/security/PrivilegedActionException'> (0x0000000783dbbf78) thrown at [D:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u20\1074\hotspot\src\share\vm\prims\jvm.cpp, line 1275] Events (10 events): Event: 46744.649 Executing VM operation: RevokeBias Event: 46744.649 Executing VM operation: RevokeBias done Event: 46744.649 Executing VM operation: RevokeBias Event: 46744.649 Executing VM operation: RevokeBias done Event: 46744.844 loading class com/mtg/mtg/controller/event/modules/incidenttracker/ViewIncidentReport Event: 46744.844 loading class com/mtg/mtg/controller/event/modules/incidenttracker/ViewIncidentReport done Event: 46746.986 loading class com/mtg/mtg/controller/event/modules/core/UploadFile Event: 46746.986 loading class com/mtg/mtg/controller/event/modules/core/UploadFile done Event: 46751.247 loading class com/mtg/mtg/controller/event/modules/incidenttracker/ViewIncidentReport Event: 46751.247 loading class com/mtg/mtg/controller/event/modules/incidenttracker/ViewIncidentReport done Dynamic libraries: 0x0000000140000000 - 0x000000014001e000 C:\Program Files\Apache Software Foundation\Tomcat 8.0\bin\Tomcat8.exe 0x0000000077c00000 - 0x0000000077da9000 C:\Windows\SYSTEM32\ntdll.dll 0x00000000779e0000 - 0x0000000077aff000 C:\Windows\system32\kernel32.dll 0x000007fefdc40000 - 0x000007fefdcab000 C:\Windows\system32\KERNELBASE.dll 0x000007feff890000 - 0x000007feff96b000 C:\Windows\system32\ADVAPI32.dll 0x000007feff970000 - 0x000007feffa0f000 C:\Windows\system32\msvcrt.dll 0x000007feffd50000 - 0x000007feffd6f000 C:\Windows\SYSTEM32\sechost.dll 0x000007feffb20000 - 0x000007feffc4d000 C:\Windows\system32\RPCRT4.dll 0x000007fefe0f0000 - 0x000007fefee78000 C:\Windows\system32\SHELL32.dll 0x000007feff480000 - 0x000007feff4f1000 C:\Windows\system32\SHLWAPI.dll 0x000007feff7c0000 - 0x000007feff827000 C:\Windows\system32\GDI32.dll 0x0000000077b00000 - 0x0000000077bfa000 C:\Windows\system32\USER32.dll 0x000007feff210000 - 0x000007feff21e000 C:\Windows\system32\LPK.dll 0x000007feffd80000 - 0x000007feffe49000 C:\Windows\system32\USP10.dll 0x000007feffc50000 - 0x000007feffc7e000 C:\Windows\system32\IMM32.DLL 0x000007feffa10000 - 0x000007feffb19000 C:\Windows\system32\MSCTF.dll 0x000000006eac0000 - 0x000000006f318000 C:\Program Files\Java\jre1.8.0_20\bin\server\jvm.dll 0x000007fefa490000 - 0x000007fefa499000 C:\Windows\system32\WSOCK32.dll 0x000007feffd00000 - 0x000007feffd4d000 C:\Windows\system32\WS2_32.dll 0x000007feffd70000 - 0x000007feffd78000 C:\Windows\system32\NSI.dll 0x000007fef7ba0000 - 0x000007fef7bdb000 C:\Windows\system32\WINMM.dll 0x0000000077dd0000 - 0x0000000077dd7000 C:\Windows\system32\PSAPI.DLL 0x000000005d8f0000 - 0x000000005d9c2000 C:\Program Files\Java\jdk1.8.0_05\bin\MSVCR100.dll 0x000000006c810000 - 0x000000006c81f000 C:\Program Files\Java\jre1.8.0_20\bin\verify.dll 0x0000000060740000 - 0x0000000060768000 C:\Program Files\Java\jre1.8.0_20\bin\java.dll 0x000000006c7f0000 - 0x000000006c806000 C:\Program Files\Java\jre1.8.0_20\bin\zip.dll 0x000007fefee80000 - 0x000007feff083000 C:\Windows\system32\ole32.dll 0x000007fefdb50000 - 0x000007fefdb5f000 C:\Windows\system32\profapi.dll 0x0000000066990000 - 0x000000006699d000 C:\Program Files\Java\jre1.8.0_20\bin\management.dll 0x000000006b440000 - 0x000000006b45a000 C:\Program Files\Java\jre1.8.0_20\bin\net.dll 0x000007fefd2f0000 - 0x000007fefd345000 C:\Windows\system32\mswsock.dll 0x000007fefd4c0000 - 0x000007fefd4c7000 C:\Windows\System32\wship6.dll 0x00000000667d0000 - 0x00000000667e1000 C:\Program Files\Java\jre1.8.0_20\bin\nio.dll 0x0000000180000000 - 0x000000018018c000 C:\Program Files\Apache Software Foundation\Tomcat 8.0\bin\tcnative-1.dll 0x000007fefd5c0000 - 0x000007fefd5d7000 C:\Windows\system32\CRYPTSP.dll 0x000007fefd0b0000 - 0x000007fefd0f7000 C:\Windows\system32\rsaenh.dll 0x000007fefda40000 - 0x000007fefda4f000 C:\Windows\system32\CRYPTBASE.dll 0x000000005d820000 - 0x000000005d844000 C:\Program Files\Java\jre1.8.0_20\bin\sunec.dll 0x000000006e440000 - 0x000000006e44b000 C:\Program Files\Java\jre1.8.0_20\bin\sunmscapi.dll 0x000007fefdcb0000 - 0x000007fefde17000 C:\Windows\system32\CRYPT32.dll 0x000007fefdbf0000 - 0x000007fefdbff000 C:\Windows\system32\MSASN1.dll 0x000007fefcd20000 - 0x000007fefcd27000 C:\Windows\System32\wshtcpip.dll 0x000007fefbfa0000 - 0x000007fefbfc7000 C:\Windows\system32\IPHLPAPI.DLL 0x000007fefbf10000 - 0x000007fefbf1b000 C:\Windows\system32\WINNSI.DLL 0x000007fefbc00000 - 0x000007fefbc11000 C:\Windows\system32\dhcpcsvc6.DLL 0x000007fefbbe0000 - 0x000007fefbbf8000 C:\Windows\system32\dhcpcsvc.DLL 0x000007fefc6b0000 - 0x000007fefc6c5000 C:\Windows\system32\NLAapi.dll 0x000007fefb410000 - 0x000007fefb425000 C:\Windows\system32\napinsp.dll 0x000007fefd180000 - 0x000007fefd1db000 C:\Windows\system32\DNSAPI.dll 0x000007fefb440000 - 0x000007fefb44b000 C:\Windows\System32\winrnr.dll 0x000007fefb530000 - 0x000007fefb538000 C:\Windows\system32\rasadhlp.dll 0x000007fefbe00000 - 0x000007fefbe53000 C:\Windows\System32\fwpuclnt.dll 0x000000005c590000 - 0x000000005c728000 C:\Program Files\Java\jre1.8.0_20\bin\awt.dll 0x000007feff500000 - 0x000007feff5d7000 C:\Windows\system32\OLEAUT32.dll 0x000007fefb2a0000 - 0x000007fefb3c5000 C:\Windows\system32\DBGHELP.DLL VM Arguments: jvm_args: -Dcatalina.home=C:\Program Files\Apache Software Foundation\Tomcat 8.0 -Dcatalina.base=C:\Program Files\Apache Software Foundation\Tomcat 8.0 -Djava.endorsed.dirs=C:\Program Files\Apache Software Foundation\Tomcat 8.0\endorsed -Djava.io.tmpdir=C:\Program Files\Apache Software Foundation\Tomcat 8.0\temp -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=C:\Program Files\Apache Software Foundation\Tomcat 8.0\conf\logging.properties -Duser.timezone=CST -XX:PermSize=512m -XX:MaxPermSize=512m exit -Xms3072m -Xmx3072m -Xss384k java_command: <unknown> java_class_path (initial): C:\Program Files\Apache Software Foundation\Tomcat 8.0\bin\bootstrap.jar;C:\Program Files\Apache Software Foundation\Tomcat 8.0\bin\tomcat-juli.jar Launcher Type: generic Environment Variables: PATH=C:\ProgramData\Oracle\Java\javapath;C:\Program Files (x86)\Windows Resource Kits\Tools\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\MySQL\MySQL Utilities 1.3.6\;C:\Program Files\MySQL\MySQL Server 5.6\bin;c:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;c:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;c:\Program Files\Microsoft SQL Server\100\Tools\Binn\;c:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;C:\Program Files\Java\jdk1.8.0_05\bin\; USERNAME=MTGWEB1$ OS=Windows_NT PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 44 Stepping 2, GenuineIntel --------------- S Y S T E M --------------- OS: Windows Server 2008 R2 , 64 bit Build 7601 Service Pack 1 CPU:total 24 (6 cores per cpu, 2 threads per core) family 6 model 44 stepping 2, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, aes, clmul, ht, tsc, tscinvbit, tscinv Memory: 4k page, physical 8388608k(8388608k free), swap 134189436k(89525300k free) vm_info: Java HotSpot(TM) 64-Bit Server VM (25.20-b23) for windows-amd64 JRE (1.8.0_20-b26), built on Jul 30 2014 13:51:23 by "java_re" with MS VC++ 10.0 (VS2010) time: Thu Sep 18 10:35:00 2014 elapsed time: 46757 seconds (0d 12h 59m 17s)
