[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405546#comment-17405546
]
Yun Gao commented on FLINK-23829:
-
Since the fix is merged onto master as
475d9cace988fc7a8b163df64b19bbd84c360bfc, I'll first close this issue, and we
could reopen it if it re-occur.
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Yun Gao
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402095#comment-17402095
]
Yun Gao commented on FLINK-23829:
-
I opened a PR for this issue: https://github.com/apache/flink/pull/16905
To avoid the case might have other causes, I opened a new issue to track the
above fix~
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Yun Gao
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Aug 16 16:26:11 [ERROR] at
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401442#comment-17401442
]
Yun Gao commented on FLINK-23829:
-
Ok, I changed the status~
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Yun Gao
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401438#comment-17401438
]
Xintong Song commented on FLINK-23829:
--
Thanks, [~gaoyunhaii].
BTW, could you please move the ticket to in-progress?
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Yun Gao
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401072#comment-17401072
]
Yun Gao commented on FLINK-23829:
-
Very thanks [~trohrmann]! I should have found the reason, this should be caused
by the concurrency problem between _triggerStopWithSavepointWithDrainAsync_ in
the akka thread and the main thread. I'll open a PR for this issue~
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Yun Gao
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401004#comment-17401004
]
Till Rohrmann commented on FLINK-23829:
---
Great, thanks [~gaoyunhaii]. I've assigned you to this ticket.
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Yun Gao
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400972#comment-17400972
]
Yun Gao commented on FLINK-23829:
-
Very thanks for reporting and checking this issue! I'll have a look~
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400917#comment-17400917
]
Till Rohrmann commented on FLINK-23829:
---
Here is another instance of this problem
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22276=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5240.
{code}
3:24:33,647 [flink-akka.actor.default-dispatcher-9] ERROR
org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread
'flink-akka.actor.default-dispatcher-9' produced an uncaught exception.
Stopping the process...
java.util.concurrent.CompletionException:
org.apache.flink.util.WrappingRuntimeException:
java.util.concurrent.CompletionException:
java.util.concurrent.RejectedExecutionException:
org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailbox$MailboxClosedException:
Mailbox is in state CLOSED, but is required to be in state OPEN for put
operations.
at
java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:888)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.uniExceptionallyStage(CompletableFuture.java:898)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.exceptionally(CompletableFuture.java:2209)
~[?:1.8.0_292]
at
org.apache.flink.streaming.runtime.tasks.StreamTask.assertTriggeringCheckpointExceptions(StreamTask.java:1211)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask.triggerStopWithSavepointWithDrainAsync(SourceOperatorStreamTask.java:130)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask.triggerCheckpointAsync(SourceOperatorStreamTask.java:118)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.runtime.taskmanager.Task.triggerCheckpointBarrier(Task.java:1309)
~[flink-runtime-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.runtime.taskexecutor.TaskExecutor.triggerCheckpoint(TaskExecutor.java:956)
~[flink-runtime-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_292]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_292]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_292]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_292]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:316)
~[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at
org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
~[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:314)
~[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
~[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
~[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
[flink-rpc-akka_d4ae6041-5c32-4e8b-8526-4885241e5468.jar:1.14-SNAPSHOT]
at
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400799#comment-17400799
]
Xintong Song commented on FLINK-23829:
--
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22415=logs=2c3cbe13-dee0-5837-cf47-3053da9a8a78=b78d9d30-509a-5cea-1fef-db7abaa325ae=5108
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Priority: Major
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400197#comment-17400197
]
Chesnay Schepler commented on FLINK-23829:
--
{code}
16:02:44,161 [flink-akka.actor.default-dispatcher-6] ERROR
org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread
'flink-akka.actor.default-dispatcher-6' produced an uncaught exception.
Stopping the process...
java.util.concurrent.CompletionException:
org.apache.flink.util.WrappingRuntimeException:
java.util.concurrent.CompletionException:
java.util.concurrent.RejectedExecutionException:
org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailbox$MailboxClosedException:
Mailbox is in state QUIESCED, but is required to be in state OPEN for put
operations.
at
java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:888)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.uniExceptionallyStage(CompletableFuture.java:898)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.exceptionally(CompletableFuture.java:2209)
~[?:1.8.0_292]
at
org.apache.flink.streaming.runtime.tasks.StreamTask.assertTriggeringCheckpointExceptions(StreamTask.java:1213)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask.triggerStopWithSavepointWithDrainAsync(SourceOperatorStreamTask.java:130)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask.triggerCheckpointAsync(SourceOperatorStreamTask.java:118)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.runtime.taskmanager.Task.triggerCheckpointBarrier(Task.java:1309)
~[flink-runtime-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.runtime.taskexecutor.TaskExecutor.triggerCheckpoint(TaskExecutor.java:956)
~[flink-runtime-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
Caused by: org.apache.flink.util.WrappingRuntimeException:
java.util.concurrent.CompletionException:
java.util.concurrent.RejectedExecutionException:
org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailbox$MailboxClosedException:
Mailbox is in state QUIESCED, but is required to be in state OPEN for put
operations.
at
org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$assertTriggeringCheckpointExceptions$12(StreamTask.java:1224)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884)
~[?:1.8.0_292]
... 36 more
Caused by: java.util.concurrent.CompletionException:
java.util.concurrent.RejectedExecutionException:
org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailbox$MailboxClosedException:
Mailbox is in state QUIESCED, but is required to be in state OPEN for put
operations.
at
java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:1005)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:2137)
~[?:1.8.0_292]
at
org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask.triggerStopWithSavepointWithDrainAsync(SourceOperatorStreamTask.java:133)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
... 32 more
Caused by: java.util.concurrent.RejectedExecutionException:
org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailbox$MailboxClosedException:
Mailbox is in state QUIESCED, but is required to be in state OPEN for put
operations.
at
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxExecutorImpl.execute(MailboxExecutorImpl.java:78)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointAsync(StreamTask.java:1106)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask.lambda$triggerStopWithSavepointWithDrainAsync$0(SourceOperatorStreamTask.java:135)
~[flink-streaming-java_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
at
java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:995)
~[?:1.8.0_292]
at
java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:2137)
~[?:1.8.0_292]
at
org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask.triggerStopWithSavepointWithDrainAsync(SourceOperatorStreamTask.java:133)
