[
https://issues.apache.org/jira/browse/FLINK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17787253#comment-17787253
]
Matthias Pohl commented on FLINK-33502:
---------------------------------------
You have to download the build artifacts for the corresponding stage (in this
case \{{tests}}). The archive will contain the {{watchdog}} file which is the
CI log content. Aside from that you have the JUnit fork logs {{mvn-*.log}} (4
since we have four surefire forks). I usually use {{grep -Hirn "<testname>" .}}
to see all occurrences. Usually, the that lists the {{watchdog}} and one
{{mvn-*.log}} file.
Here is the example for the last build failure:
{code:java}
$ unzip logs-ci-test_ci_tests-1699014739.zip
$ grep -Hirn HybridShuffleITCase .
mvn-3.log:103507:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridFullExchangesRestart[enableNewHybridMode=false]
is running.
mvn-3.log:104521:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridFullExchangesRestart[enableNewHybridMode=false]
successfully run.
mvn-3.log:104525:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridFullExchangesRestart[enableNewHybridMode=true]
is running.
mvn-3.log:105557:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridFullExchangesRestart[enableNewHybridMode=true]
successfully run.
mvn-3.log:105561:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridSelectiveExchangesRestart[enableNewHybridMode=false]
is running.
mvn-3.log:107414:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridSelectiveExchangesRestart[enableNewHybridMode=false]
successfully run.
mvn-3.log:107418:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridSelectiveExchangesRestart[enableNewHybridMode=true]
is running.
mvn-3.log:109414:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridSelectiveExchangesRestart[enableNewHybridMode=true]
successfully run.
mvn-3.log:109418:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridFullExchanges[enableNewHybridMode=false]
is running.
mvn-3.log:110391:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridFullExchanges[enableNewHybridMode=false]
successfully run.
mvn-3.log:110395:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridFullExchanges[enableNewHybridMode=true]
is running.
mvn-3.log:111388:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridFullExchanges[enableNewHybridMode=true]
successfully run.
mvn-3.log:111392:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridSelectiveExchanges[enableNewHybridMode=false]
is running.
mvn-3.log:112354:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridSelectiveExchanges[enableNewHybridMode=false]
successfully run.
mvn-3.log:112358:Test
org.apache.flink.test.runtime.HybridShuffleITCase.testHybridSelectiveExchanges[enableNewHybridMode=true]
is running.
watchdog:7740:Nov 03 12:47:49 12:47:49.161 [INFO] Running
org.apache.flink.test.runtime.HybridShuffleITCase
watchdog:8567:Nov 03 13:14:12 13:14:12.059 [ERROR]
org.apache.flink.test.runtime.HybridShuffleITCase
watchdog:8573:Nov 03 13:14:12 13:14:12.059 [ERROR]
org.apache.flink.test.runtime.HybridShuffleITCase
watchdog:8610:Nov 03 13:14:12 13:14:12.059 [ERROR]
org.apache.flink.test.runtime.HybridShuffleITCase{code}
Here you see that {{mvn-3.log}} contains the logs. The last run of
{{HybridShuffleITCase}} seems to not terminate (because there is a "is running"
but no "successfully run" line).
Does this help? Strangely, other tests pass afterwards which makes the logs
hard to browse... :-/
> HybridShuffleITCase caused a fatal error
> ----------------------------------------
>
> Key: FLINK-33502
> URL: https://issues.apache.org/jira/browse/FLINK-33502
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
> Affects Versions: 1.19.0
> Reporter: Matthias Pohl
> Priority: Major
> Labels: test-stability
>
> [https://github.com/XComp/flink/actions/runs/6789774296/job/18458197040#step:12:9177]
> {code:java}
> Error: 21:21:35 21:21:35.379 [ERROR] Error occurred in starting fork, check
> output in log
> 9168Error: 21:21:35 21:21:35.379 [ERROR] Process Exit Code: 239
> 9169Error: 21:21:35 21:21:35.379 [ERROR] Crashed tests:
> 9170Error: 21:21:35 21:21:35.379 [ERROR]
> org.apache.flink.test.runtime.HybridShuffleITCase
> 9171Error: 21:21:35 21:21:35.379 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> 9172Error: 21:21:35 21:21:35.379 [ERROR] Command was /bin/sh -c cd
> /root/flink/flink-tests && /usr/lib/jvm/jdk-11.0.19+7/bin/java -XX:+UseG1GC
> -Xms256m -XX:+IgnoreUnrecognizedVMOptions
> --add-opens=java.base/java.util=ALL-UNNAMED
> --add-opens=java.base/java.io=ALL-UNNAMED -Xmx1536m -jar
> /root/flink/flink-tests/target/surefire/surefirebooter10811559899200556131.jar
> /root/flink/flink-tests/target/surefire 2023-11-07T20-32-50_466-jvmRun4
> surefire6242806641230738408tmp surefire_1603959900047297795160tmp
> 9173Error: 21:21:35 21:21:35.379 [ERROR] Error occurred in starting fork,
> check output in log
> 9174Error: 21:21:35 21:21:35.379 [ERROR] Process Exit Code: 239
> 9175Error: 21:21:35 21:21:35.379 [ERROR] Crashed tests:
> 9176Error: 21:21:35 21:21:35.379 [ERROR]
> org.apache.flink.test.runtime.HybridShuffleITCase
> 9177Error: 21:21:35 21:21:35.379 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:532)
> 9178Error: 21:21:35 21:21:35.379 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:479)
> 9179Error: 21:21:35 21:21:35.379 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:322)
> 9180Error: 21:21:35 21:21:35.379 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:266)
> [...] {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
