Robert Metzger created FLINK-25998: -------------------------------------- Summary: Flink akka runs into NoClassDefFoundError on shutdown Key: FLINK-25998 URL: https://issues.apache.org/jira/browse/FLINK-25998 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Robert Metzger
When trying to start a standalone jobmanager on an unavailable port, I see the following unexpected exception: {code} 2022-02-08 08:07:18,299 INFO akka.remote.Remoting [] - Starting remoting 2022-02-08 08:07:18,357 ERROR akka.remote.transport.netty.NettyTransport [] - failed to bind to /0.0.0.0:6123, shutting down Netty transport 2022-02-08 08:07:18,373 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting StandaloneApplicationClusterEntryPoint down with application status FAILED. Diagnostics java.net.BindException: Could not start actor system on any port in port range 6123 at org.apache.flink.runtime.rpc.akka.AkkaBootstrapTools.startRemoteActorSystem(AkkaBootstrapTools.java:133) at org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils$AkkaRpcServiceBuilder.createAndStart(AkkaRpcServiceUtils.java:358) at org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils$AkkaRpcServiceBuilder.createAndStart(AkkaRpcServiceUtils.java:327) at org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils$AkkaRpcServiceBuilder.createAndStart(AkkaRpcServiceUtils.java:247) at org.apache.flink.runtime.rpc.RpcUtils.createRemoteRpcService(RpcUtils.java:191) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:334) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:253) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$1(ClusterEntrypoint.java:203) at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:200) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:684) at org.apache.flink.container.entrypoint.StandaloneApplicationClusterEntryPoint.main(StandaloneApplicationClusterEntryPoint.java:82) . 2022-02-08 08:07:18,377 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon. 2022-02-08 08:07:18,377 ERROR org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread 'flink-akka.remote.default-remote-dispatcher-6' produced an uncaught exception. Stopping the process... java.lang.NoClassDefFoundError: akka/actor/dungeon/FaultHandling$$anonfun$handleNonFatalOrInterruptedException$1 at akka.actor.dungeon.FaultHandling.handleNonFatalOrInterruptedException(FaultHandling.scala:334) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.actor.dungeon.FaultHandling.handleNonFatalOrInterruptedException$(FaultHandling.scala:334) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.actor.ActorCell.handleNonFatalOrInterruptedException(ActorCell.scala:411) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.actor.ActorCell.invoke(ActorCell.scala:551) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.dispatch.Mailbox.run(Mailbox.scala:231) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_312] at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_312] at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_312] at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_312] Caused by: java.lang.ClassNotFoundException: akka.actor.dungeon.FaultHandling$$anonfun$handleNonFatalOrInterruptedException$1 at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_312] at java.lang.ClassLoader.loadClass(ClassLoader.java:419) ~[?:1.8.0_312] at org.apache.flink.core.classloading.ComponentClassLoader.loadClassFromComponentOnly(ComponentClassLoader.java:149) ~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] at org.apache.flink.core.classloading.ComponentClassLoader.loadClass(ComponentClassLoader.java:112) ~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] at java.lang.ClassLoader.loadClass(ClassLoader.java:352) ~[?:1.8.0_312] ... 11 more 2022-02-08 08:07:18,383 ERROR org.apache.flink.runtime.util.ClusterUncaughtExceptionHandler [] - WARNING: Thread 'flink-shutdown-hook-1' produced an uncaught exception. If you want to fail on uncaught exceptions, then configure cluster.uncaught-exception-handling accordingly java.lang.NoClassDefFoundError: scala/collection/convert/Wrappers$MutableSetWrapper at scala.collection.convert.AsScalaConverters.asScalaSet(AsScalaConverters.scala:126) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at scala.collection.convert.AsScalaConverters.asScalaSet$(AsScalaConverters.scala:124) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.util.ccompat.package$JavaConverters$.asScalaSet(package.scala:86) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at scala.collection.convert.DecorateAsScala.$anonfun$asScalaSetConverter$1(DecorateAsScala.scala:59) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at scala.collection.convert.Decorators$AsScala.asScala(Decorators.scala:25) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.actor.CoordinatedShutdown$tasks$.totalDuration(CoordinatedShutdown.scala:481) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.actor.CoordinatedShutdown.totalTimeout(CoordinatedShutdown.scala:784) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.actor.CoordinatedShutdown$.$anonfun$initJvmHook$1(CoordinatedShutdown.scala:271) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] at akka.actor.CoordinatedShutdown$$anon$3.run(CoordinatedShutdown.scala:814) ~[flink-rpc-akka_ce724655-52fe-4b3a-8cdc-b79ab446e34d.jar:1.15-SNAPSHOT] Caused by: java.lang.ClassNotFoundException: scala.collection.convert.Wrappers$MutableSetWrapper at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_312] at java.lang.ClassLoader.loadClass(ClassLoader.java:419) ~[?:1.8.0_312] at org.apache.flink.core.classloading.ComponentClassLoader.loadClassFromComponentOnly(ComponentClassLoader.java:149) ~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] at org.apache.flink.core.classloading.ComponentClassLoader.loadClass(ComponentClassLoader.java:112) ~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] at java.lang.ClassLoader.loadClass(ClassLoader.java:352) ~[?:1.8.0_312] ... 9 more {code} -- This message was sent by Atlassian Jira (v8.20.1#820001)