Greetings! We are currently experiencing a very vague problem with our Tomcat 10.1 instance, where the JVM will crash almost instantly after Tomcat is done starting up. The problem happens somewhat regularly, and only happens within the first minute after starting Tomcat. The solution is always to just attempt to restart Tomcat and this usually only take 1 attempt.
Tomcat is running a single web application, that sees traffic over both Websocket (several 100 clients) and Https (maybe 20-40 users during peak + a few API clients) Our setup is a somewhat old VM. Windows Server 2016 Standard 1607, buil 14343.6351 Intel Xeon E5-2680 v4 @ 2.40 GHz 4 x Cores 8 GB Memory JRE version: OpenJDK Runtime Environment Temurin-17.0.8.1+1 (17.0.8.1+1) (build 17.0.8.1+1) Java VM: OpenJDK 64-Bit Server VM Temurin-17.0.8.1+1 (17.0.8.1+1, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, windows-amd64) Tomcat version is 10.1.15 64 bit The company we rent our VM servers from has installed Sentinel One that connects to the JVM through an agent. I have very little knowledge of what if anything this can do. Since this is the only thing out of the ordinary running on this setup, my fear is that this might be causing the crashes. I include a partial example of the exception log here, some data may have been removed for privacy reasons. Please let med know if I should include the full file, since I've removed parts of it due to pure length. # # A fatal error has been detected by the Java Runtime Environment: # # EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000001131b169, pid=2084, tid=5160 # # JRE version: OpenJDK Runtime Environment Temurin-17.0.8.1+1 (17.0.8.1+1) (build 17.0.8.1+1) # Java VM: OpenJDK 64-Bit Server VM Temurin-17.0.8.1+1 (17.0.8.1+1, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, windows-amd64) # Problematic frame: # j jakarta.servlet.http.HttpServletRequestWrapper.getDateHeader(Ljava/lang/String;)J+1 # # Core dump will be written. Default location: E:\tomcat10\hs_err_pid2084.mdmp # # If you would like to submit a bug report, please visit: # https://github.com/adoptium/adoptium-support/issues # --------------- S U M M A R Y ------------ Command Line: -Dcatalina.home=E:\tomcat10 -Dcatalina.base=E:\tomcat10 -Dignore.endorsed.dirs=E:\tomcat10\endorsed -Djava.io.tmpdir=E:\tomcat10\temp -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=E:\tomcat10\conf\logging.properties -Djava.locale.providers=COMPAT --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED exit abort -Xms768m -Xmx5090m -agentpath:C:\Program Files\SentinelOne\Sentinel Agent 22.3.4.612\SentinelJava64.dll Host: Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz, 4 cores, 7G, Windows Server 2016 , 64 bit Build 14393 (10.0.14393.5786) Time: Sat Nov 11 18:18:30 2023 W. Europe Standard Time elapsed time: 153.828934 seconds (0d 0h 2m 33s) --------------- T H R E A D --------------- Current thread (0x000000002e6a9bd0): JavaThread "https-openssl-nio-0.0.0.0-443-exec-180" daemon [_thread_in_Java, id=5160, stack(0x00000000403a0000,0x00000000404a0000)] Stack: [0x00000000403a0000,0x00000000404a0000], sp=0x000000004049c1f8, free space=1008k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) C 0x000000001131b169 siginfo: EXCEPTION_ACCESS_VIOLATION (0xc0000005), reading address 0xffffffffffffffff ... Stack slot to memory mapping: stack at sp + 0 slots: 0x0000000011309657 is at code_begin+1463 in an Interpreter codelet return entry points [0x00000000113090a0, 0x0000000011309ba0] 2816 bytes stack at sp + 1 slots: 0x0061006200650077 is an unknown value stack at sp + 2 slots: 0x000000004049c208 is pointing into the stack for thread: 0x000000002e6a9bd0 stack at sp + 3 slots: 0x000000002a938ae1 is pointing into metadata stack at sp + 4 slots: 0x000000004049c268 is pointing into the stack for thread: 0x000000002e6a9bd0 stack at sp + 5 slots: 0x000000002a93e930 is pointing into metadata stack at sp + 6 slots: 0x0 is NULL stack at sp + 7 slots: 0x00000006c5fd67d0 is an oop: java.lang.Class {0x00000006c5fd67d0} - klass: 'java/lang/Class' - ---- fields (total size 14 words): - private volatile transient 'classRedefinedCount' 'I' @12 0 - private volatile transient 'cachedConstructor' 'Ljava/lang/reflect/Constructor;' @40 NULL (0) - private transient 'name' 'Ljava/lang/String;' @44 "jakarta.servlet.http.HttpServletRequestWrapper"{0x00000006c5fd6840} (d8bfad08) - private transient 'module' 'Ljava/lang/Module;' @48 a 'java/lang/Module'{0x00000006c1d03100} (d83a0620) - private final 'classLoader' 'Ljava/lang/ClassLoader;' @52 a 'java/net/URLClassLoader'{0x00000006c1c01418} (d8380283) - private transient 'classData' 'Ljava/lang/Object;' @56 NULL (0) - private transient 'packageName' 'Ljava/lang/String;' @60 "jakarta.servlet.http"{0x00000006c20d6fb0} (d841adf6) - private final 'componentType' 'Ljava/lang/Class;' @64 NULL (0) - private volatile transient 'reflectionData' 'Ljava/lang/ref/SoftReference;' @68 NULL (0) - private volatile transient 'genericInfo' 'Lsun/reflect/generics/repository/ClassRepository;' @72 NULL (0) - private volatile transient 'enumConstants' '[Ljava/lang/Object;' @76 NULL (0) - private volatile transient 'enumConstantDirectory' 'Ljava/util/Map;' @80 NULL (0) - private volatile transient 'annotationData' 'Ljava/lang/Class$AnnotationData;' @84 NULL (0) - private volatile transient 'annotationType' 'Lsun/reflect/annotation/AnnotationType;' @88 NULL (0) - transient 'classValueMap' 'Ljava/lang/ClassValue$ClassValueMap;' @92 NULL (0) - signature: Ljakarta/servlet/http/HttpServletRequestWrapper; - fake entry for mirror: 'jakarta/servlet/http/HttpServletRequestWrapper' - fake entry for array: NULL - fake entry for oop_size: 14 - fake entry for static_oop_field_count: 0 Regards, Øyvind Flatval --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org