[ 
https://issues.apache.org/jira/browse/FLINK-18338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138180#comment-17138180
 ] 

Robert Metzger edited comment on FLINK-18338 at 6/17/20, 7:32 AM:
------------------------------------------------------------------

Another case: 
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=3657&view=logs&j=0da23115-68bb-5dcd-192c-bd4c8adebde1&t=05b74a19-4ee4-5036-c46f-ada307df6cf0

This is how maven fails:
{code}
2020-06-17T03:22:58.7173637Z [ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.22.1:test (default-test) on 
project flink-statebackend-rocksdb_2.11: There are test failures.
2020-06-17T03:22:58.7175307Z [ERROR] 
2020-06-17T03:22:58.7176949Z [ERROR] Please refer to 
/__w/3/s/flink-state-backends/flink-statebackend-rocksdb/target/surefire-reports
 for the individual test results.
2020-06-17T03:22:58.7178591Z [ERROR] Please refer to dump files (if any exist) 
[date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
2020-06-17T03:22:58.7179590Z [ERROR] ExecutionException Error occurred in 
starting fork, check output in log
2020-06-17T03:22:58.7180750Z [ERROR] 
org.apache.maven.surefire.booter.SurefireBooterForkException: 
ExecutionException Error occurred in starting fork, check output in log
2020-06-17T03:22:58.7182154Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
2020-06-17T03:22:58.7183460Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkOnceMultiple(ForkStarter.java:382)
2020-06-17T03:22:58.7184827Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:297)
2020-06-17T03:22:58.7186293Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
2020-06-17T03:22:58.7187522Z [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
2020-06-17T03:22:58.7188983Z [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
2020-06-17T03:22:58.7190325Z [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
2020-06-17T03:22:58.7191589Z [ERROR] at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
2020-06-17T03:22:58.7192828Z [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
2020-06-17T03:22:58.7194029Z [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
2020-06-17T03:22:58.7195159Z [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
2020-06-17T03:22:58.7196547Z [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
2020-06-17T03:22:58.7197897Z [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
2020-06-17T03:22:58.7199359Z [ERROR] at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
2020-06-17T03:22:58.7200670Z [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
2020-06-17T03:22:58.7201762Z [ERROR] at 
org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355)
2020-06-17T03:22:58.7202764Z [ERROR] at 
org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
2020-06-17T03:22:58.7203716Z [ERROR] at 
org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
2020-06-17T03:22:58.7204717Z [ERROR] at 
org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
2020-06-17T03:22:58.7205620Z [ERROR] at 
org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
2020-06-17T03:22:58.7206495Z [ERROR] at 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-06-17T03:22:58.7207455Z [ERROR] at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-06-17T03:22:58.7208657Z [ERROR] at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-06-17T03:22:58.7209729Z [ERROR] at 
java.lang.reflect.Method.invoke(Method.java:498)
2020-06-17T03:22:58.7210726Z [ERROR] at 
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
2020-06-17T03:22:58.7211875Z [ERROR] at 
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
2020-06-17T03:22:58.7213014Z [ERROR] at 
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
2020-06-17T03:22:58.7214212Z [ERROR] at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
2020-06-17T03:22:58.7215465Z [ERROR] Caused by: 
org.apache.maven.surefire.booter.SurefireBooterForkException: Error occurred in 
starting fork, check output in log
2020-06-17T03:22:58.7216750Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:622)
2020-06-17T03:22:58.7217947Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:115)
2020-06-17T03:22:58.7219191Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:371)
2020-06-17T03:22:58.7220376Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:347)
2020-06-17T03:22:58.7221429Z [ERROR] at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
2020-06-17T03:22:58.7222477Z [ERROR] at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2020-06-17T03:22:58.7223602Z [ERROR] at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2020-06-17T03:22:58.7224621Z [ERROR] at java.lang.Thread.run(Thread.java:748)
2020-06-17T03:22:58.7225637Z [ERROR] -> [Help 1]
2020-06-17T03:22:58.7226066Z [ERROR] 
{code}

This is what the JVM debugging files have to say
{code}
# Created at 2020-06-17T03:21:56.823
pure virtual method called

# Created at 2020-06-17T03:21:56.823
terminate called without an active exception

# Created at 2020-06-17T03:21:59.079
Aborted (core dumped)
{code}
(The coredump is available)

>From the core dump I got
{code}
(gdb) where
#0  0x00007ff6d1cdf428 in __GI_raise (sig=sig@entry=6) at 
../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007ff6d1ce102a in __GI_abort () at abort.c:89
#2  0x00007ff6d042784d in __gnu_cxx::__verbose_terminate_handler() () from 
/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#3  0x00007ff6d04256b6 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#4  0x00007ff6d0425701 in std::terminate() () from 
/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#5  0x00007ff6d042623f in __cxa_pure_virtual () from 
/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#6  0x00007ff5536200d5 in rocksdb::DBImpl::CloseHelper() () from 
/tmp/junit2957569837385648710/junit7227349420023790038/librocksdbjni-linux64.so
#7  0x00007ff55362b17b in rocksdb::DBImpl::~DBImpl() () from 
/tmp/junit2957569837385648710/junit7227349420023790038/librocksdbjni-linux64.so
#8  0x00007ff55362b451 in rocksdb::DBImpl::~DBImpl() () from 
/tmp/junit2957569837385648710/junit7227349420023790038/librocksdbjni-linux64.so
#9  0x00007ff6ba4b4470 in ?? ()
#10 0x0000000085721e58 in ?? ()
#11 0x00007ff6ba2e2544 in ?? ()
#12 0x00007ff5dccad930 in ?? ()
#13 0x0000000085721938 in ?? ()
#14 0x00007ff6ba450f60 in ?? ()
#15 0x0000000000000000 in ?? ()
{code}


was (Author: rmetzger):
Another case: 
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=3657&view=logs&j=0da23115-68bb-5dcd-192c-bd4c8adebde1&t=05b74a19-4ee4-5036-c46f-ada307df6cf0

This is how maven fails:
{code}
2020-06-17T03:22:58.7173637Z [ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.22.1:test (default-test) on 
project flink-statebackend-rocksdb_2.11: There are test failures.
2020-06-17T03:22:58.7175307Z [ERROR] 
2020-06-17T03:22:58.7176949Z [ERROR] Please refer to 
/__w/3/s/flink-state-backends/flink-statebackend-rocksdb/target/surefire-reports
 for the individual test results.
2020-06-17T03:22:58.7178591Z [ERROR] Please refer to dump files (if any exist) 
[date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
2020-06-17T03:22:58.7179590Z [ERROR] ExecutionException Error occurred in 
starting fork, check output in log
2020-06-17T03:22:58.7180750Z [ERROR] 
org.apache.maven.surefire.booter.SurefireBooterForkException: 
ExecutionException Error occurred in starting fork, check output in log
2020-06-17T03:22:58.7182154Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
2020-06-17T03:22:58.7183460Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkOnceMultiple(ForkStarter.java:382)
2020-06-17T03:22:58.7184827Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:297)
2020-06-17T03:22:58.7186293Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
2020-06-17T03:22:58.7187522Z [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
2020-06-17T03:22:58.7188983Z [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
2020-06-17T03:22:58.7190325Z [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
2020-06-17T03:22:58.7191589Z [ERROR] at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
2020-06-17T03:22:58.7192828Z [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
2020-06-17T03:22:58.7194029Z [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
2020-06-17T03:22:58.7195159Z [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
2020-06-17T03:22:58.7196547Z [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
2020-06-17T03:22:58.7197897Z [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
2020-06-17T03:22:58.7199359Z [ERROR] at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
2020-06-17T03:22:58.7200670Z [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
2020-06-17T03:22:58.7201762Z [ERROR] at 
org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355)
2020-06-17T03:22:58.7202764Z [ERROR] at 
org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
2020-06-17T03:22:58.7203716Z [ERROR] at 
org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
2020-06-17T03:22:58.7204717Z [ERROR] at 
org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
2020-06-17T03:22:58.7205620Z [ERROR] at 
org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
2020-06-17T03:22:58.7206495Z [ERROR] at 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-06-17T03:22:58.7207455Z [ERROR] at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-06-17T03:22:58.7208657Z [ERROR] at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-06-17T03:22:58.7209729Z [ERROR] at 
java.lang.reflect.Method.invoke(Method.java:498)
2020-06-17T03:22:58.7210726Z [ERROR] at 
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
2020-06-17T03:22:58.7211875Z [ERROR] at 
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
2020-06-17T03:22:58.7213014Z [ERROR] at 
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
2020-06-17T03:22:58.7214212Z [ERROR] at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
2020-06-17T03:22:58.7215465Z [ERROR] Caused by: 
org.apache.maven.surefire.booter.SurefireBooterForkException: Error occurred in 
starting fork, check output in log
2020-06-17T03:22:58.7216750Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:622)
2020-06-17T03:22:58.7217947Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:115)
2020-06-17T03:22:58.7219191Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:371)
2020-06-17T03:22:58.7220376Z [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:347)
2020-06-17T03:22:58.7221429Z [ERROR] at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
2020-06-17T03:22:58.7222477Z [ERROR] at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2020-06-17T03:22:58.7223602Z [ERROR] at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2020-06-17T03:22:58.7224621Z [ERROR] at java.lang.Thread.run(Thread.java:748)
2020-06-17T03:22:58.7225637Z [ERROR] -> [Help 1]
2020-06-17T03:22:58.7226066Z [ERROR] 
{code}

This is what the JVM debugging files have to say
{code}
# Created at 2020-06-17T03:21:56.823
pure virtual method called

# Created at 2020-06-17T03:21:56.823
terminate called without an active exception

# Created at 2020-06-17T03:21:59.079
Aborted (core dumped)
{code}
(The coredump is available)



> RocksDB tests crash the JVM on CI
> ---------------------------------
>
>                 Key: FLINK-18338
>                 URL: https://issues.apache.org/jira/browse/FLINK-18338
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / State Backends, Tests
>    Affects Versions: 1.11.0
>            Reporter: Chesnay Schepler
>            Priority: Blocker
>              Labels: test-stability
>             Fix For: 1.11.0
>
>
> Something about {{pure virtual method called}}.
> Seen this twice in separate PRs.
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=3615&view=logs&j=0da23115-68bb-5dcd-192c-bd4c8adebde1
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=3632&view=logs&j=0da23115-68bb-5dcd-192c-bd4c8adebde1



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to