lhotari opened a new issue, #19307: URL: https://github.com/apache/pulsar/issues/19307
### Search before asking - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar. ### Version 9e698b62 ### Minimal reproduce step none, this happens with pulsar-metadata tests. Perhaps related to #19250 ### What did you expect to see? No JVM crashes ### What did you see instead? The JVM crashed and caused the build to fail ``` Error: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M3:test (default-test) on project pulsar-metadata: There are test failures. Error: Error: Please refer to /home/runner/work/pulsar/pulsar/pulsar-metadata/target/surefire-reports for the individual test results. Error: Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream. Error: ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called? Error: Command was /bin/sh -c cd /home/runner/work/pulsar/pulsar/pulsar-metadata && /usr/lib/jvm/temurin-17-jdk-amd64/bin/java '-javaagent:/home/runner/.m2/repository/org/jacoco/org.jacoco.agent/0.8.8/org.jacoco.agent-0.8.8-runtime.jar=destfile=/home/runner/work/pulsar/pulsar/pulsar-metadata/target/jacoco_2023-01-23T10:19:37Z_4.exec,append=true,includes=org.apache.pulsar.*:org.apache.bookkeeper.mledger.*,excludes=*.proto.*:*.shade.*:*.shaded.*' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp -XX:+ExitOnOutOfMemoryError -Xmx1G -XX:+UseZGC -Dpulsar.allocator.pooled=true -Dpulsar.allocator.leak_detection=Advanced -Dpulsar.allocator.exit_on_oom=false -Dpulsar.allocator.out_of_memory_policy=FallbackToHeap -Dio.netty.tryReflectionSetAccessible=true --add-opens java.base/jdk.internal.loader=ALL-UNNAMED --add-opens java.base/java.lang=ALL-UNNAMED --add-opens java.base/java.io=ALL-UNNAMED --add-opens java.base/java.util=ALL-UNNAMED --add-opens java.base/sun.net=ALL-UNNAMED --add-o pens java.management/sun.management=ALL-UNNAMED --add-opens jdk.management/com.sun.management.internal=ALL-UNNAMED -jar /home/runner/work/pulsar/pulsar/pulsar-metadata/target/surefire/surefirebooter4173021429455748452.jar /home/runner/work/pulsar/pulsar/pulsar-metadata/target/surefire 2023-01-23T10-20-05_807-jvmRun4 surefire348412133721025140tmp surefire_710936654358495701668tmp Error: Error occurred in starting fork, check output in log Error: Process Exit Code: 134 Error: Crashed tests: Error: org.apache.pulsar.metadata.bookkeeper.LedgerManagerIteratorTest Error: org.apache.maven.surefire.booter.SurefireBooterForkException: ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called? Error: Command was /bin/sh -c cd /home/runner/work/pulsar/pulsar/pulsar-metadata && /usr/lib/jvm/temurin-17-jdk-amd64/bin/java '-javaagent:/home/runner/.m2/repository/org/jacoco/org.jacoco.agent/0.8.8/org.jacoco.agent-0.8.8-runtime.jar=destfile=/home/runner/work/pulsar/pulsar/pulsar-metadata/target/jacoco_2023-01-23T10:19:37Z_4.exec,append=true,includes=org.apache.pulsar.*:org.apache.bookkeeper.mledger.*,excludes=*.proto.*:*.shade.*:*.shaded.*' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp -XX:+ExitOnOutOfMemoryError -Xmx1G -XX:+UseZGC -Dpulsar.allocator.pooled=true -Dpulsar.allocator.leak_detection=Advanced -Dpulsar.allocator.exit_on_oom=false -Dpulsar.allocator.out_of_memory_policy=FallbackToHeap -Dio.netty.tryReflectionSetAccessible=true --add-opens java.base/jdk.internal.loader=ALL-UNNAMED --add-opens java.base/java.lang=ALL-UNNAMED --add-opens java.base/java.io=ALL-UNNAMED --add-opens java.base/java.util=ALL-UNNAMED --add-opens java.base/sun.net=ALL-UNNAMED --add-o pens java.management/sun.management=ALL-UNNAMED --add-opens jdk.management/com.sun.management.internal=ALL-UNNAMED -jar /home/runner/work/pulsar/pulsar/pulsar-metadata/target/surefire/surefirebooter4173021429455748452.jar /home/runner/work/pulsar/pulsar/pulsar-metadata/target/surefire 2023-01-23T10-20-05_807-jvmRun4 surefire348412133721025140tmp surefire_710936654358495701668tmp Error: Error occurred in starting fork, check output in log Error: Process Exit Code: 134 Error: Crashed tests: Error: org.apache.pulsar.metadata.bookkeeper.LedgerManagerIteratorTest Error: at org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:511) Error: at org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkOnceMultiple(ForkStarter.java:383) Error: at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298) Error: at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:247) Error: at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1161) Error: at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1002) Error: at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:848) Error: at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:137) Error: at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2(MojoExecutor.java:370) Error: at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute(MojoExecutor.java:351) Error: at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:215) Error: at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:171) Error: at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:163) Error: at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117) Error: at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81) Error: at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:56) Error: at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) Error: at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:298) Error: at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:192) Error: at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:105) Error: at org.apache.maven.cli.MavenCli.execute(MavenCli.java:960) Error: at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:293) Error: at org.apache.maven.cli.MavenCli.main(MavenCli.java:196) Error: at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Error: at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) Error: at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Error: at java.base/java.lang.reflect.Method.invoke(Method.java:568) Error: at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:282) Error: at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:225) Error: at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:406) Error: at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:347) Error: Caused by: org.apache.maven.surefire.booter.SurefireBooterForkException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? Error: Command was /bin/sh -c cd /home/runner/work/pulsar/pulsar/pulsar-metadata && /usr/lib/jvm/temurin-17-jdk-amd64/bin/java '-javaagent:/home/runner/.m2/repository/org/jacoco/org.jacoco.agent/0.8.8/org.jacoco.agent-0.8.8-runtime.jar=destfile=/home/runner/work/pulsar/pulsar/pulsar-metadata/target/jacoco_2023-01-23T10:19:37Z_4.exec,append=true,includes=org.apache.pulsar.*:org.apache.bookkeeper.mledger.*,excludes=*.proto.*:*.shade.*:*.shaded.*' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp -XX:+ExitOnOutOfMemoryError -Xmx1G -XX:+UseZGC -Dpulsar.allocator.pooled=true -Dpulsar.allocator.leak_detection=Advanced -Dpulsar.allocator.exit_on_oom=false -Dpulsar.allocator.out_of_memory_policy=FallbackToHeap -Dio.netty.tryReflectionSetAccessible=true --add-opens java.base/jdk.internal.loader=ALL-UNNAMED --add-opens java.base/java.lang=ALL-UNNAMED --add-opens java.base/java.io=ALL-UNNAMED --add-opens java.base/java.util=ALL-UNNAMED --add-opens java.base/sun.net=ALL-UNNAMED --add-o pens java.management/sun.management=ALL-UNNAMED --add-opens jdk.management/com.sun.management.internal=ALL-UNNAMED -jar /home/runner/work/pulsar/pulsar/pulsar-metadata/target/surefire/surefirebooter4173021429455748452.jar /home/runner/work/pulsar/pulsar/pulsar-metadata/target/surefire 2023-01-23T10-20-05_807-jvmRun4 surefire348412133721025140tmp surefire_71093665435849570[1668](https://github.com/lhotari/pulsar/actions/runs/3985274820/jobs/6832729920#step:11:1669)tmp Error: Error occurred in starting fork, check output in log Error: Process Exit Code: 134 Error: Crashed tests: Error: org.apache.pulsar.metadata.bookkeeper.LedgerManagerIteratorTest Error: at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:670) Error: at org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:116) Error: at org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:372) Error: at org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:348) Error: at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) Error: at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) Error: at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) Error: at java.base/java.lang.Thread.run(Thread.java:833) Error: -> [Help 1] ``` The hs err file contains: ``` Current CompileTask: C2: 66042 10534 4 org.apache.pulsar.metadata.bookkeeper.LongHierarchicalLedgerRangeIterator$InnerIterator::advance (204 bytes) Stack: [0x00007f65b5279000,0x00007f65b537a000], sp=0x00007f65b5374dd0, free space=1007k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0xacda43] PhaseIdealLoop::build_loop_late_post_work(Node*, bool)+0x153 V [libjvm.so+0xace400] PhaseIdealLoop::build_loop_late(VectorSet&, Node_List&, Node_Stack&)+0x180 V [libjvm.so+0xaced7e] PhaseIdealLoop::build_and_optimize()+0x7ae V [libjvm.so+0x5d237f] PhaseIdealLoop::optimize(PhaseIterGVN&, LoopOptsMode)+0x16f V [libjvm.so+0x5d0216] Compile::Optimize()+0xdc6 V [libjvm.so+0x5d1bd5] Compile::Compile(ciEnv*, ciMethod*, int, bool, bool, bool, bool, bool, DirectiveSet*)+0xe65 V [libjvm.so+0x510cb9] C2Compiler::compile_method(ciEnv*, ciMethod*, int, bool, DirectiveSet*)+0xe9 V [libjvm.so+0x5dab62] CompileBroker::invoke_compiler_on_method(CompileTask*)+0xef2 V [libjvm.so+0x5db808] CompileBroker::compiler_thread_loop()+0x508 V [libjvm.so+0xe59f04] JavaThread::thread_main_inner()+0x184 V [libjvm.so+0xe5d5b0] Thread::call_run()+0xc0 V [libjvm.so+0xc17381] thread_native_entry(Thread*)+0xe1 ``` ### Anything else? Full hs err file: https://gist.github.com/lhotari/4948f347a8f70f6a1051212139fcf551 another one: https://gist.github.com/lhotari/f3892d3577e285edc469141577215261 Failed build: https://github.com/lhotari/pulsar/actions/runs/3985274820/jobs/6832729920#step:11:1655 ### Are you willing to submit a PR? - [ ] I'm willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
