[jira] [Commented] (FLINK-25812) Show Plan in Ui doesn't show.
[ https://issues.apache.org/jira/browse/FLINK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484728#comment-17484728 ] None none commented on FLINK-25812: --- And this is the Javascript error I see in browser. If that helps. main-es2015.c6dc910dd819a55e81ef.js:1 ERROR TypeError: Cannot read properties of undefined (reading 'flush') at u._next (692-es2015.5d7e531366a9b04244c9.js:1) at u.__tryOrUnsub (main-es2015.c6dc910dd819a55e81ef.js:1) at u.next (main-es2015.c6dc910dd819a55e81ef.js:1) at c._next (main-es2015.c6dc910dd819a55e81ef.js:1) at c.next (main-es2015.c6dc910dd819a55e81ef.js:1) at o._next (main-es2015.c6dc910dd819a55e81ef.js:1) at o.next (main-es2015.c6dc910dd819a55e81ef.js:1) at o._next (main-es2015.c6dc910dd819a55e81ef.js:1) at o.next (main-es2015.c6dc910dd819a55e81ef.js:1) at o._next (main-es2015.c6dc910dd819a55e81ef.js:1) bi @ main-es2015.c6dc910dd819a55e81ef.js:1 handleError @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 __tryOrUnsub @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 _next @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 emit @ main-es2015.c6dc910dd819a55e81ef.js:1 (anonymous) @ main-es2015.c6dc910dd819a55e81ef.js:1 invoke @ polyfills-es2015.2473462a061a5e9d19fb.js:1 run @ polyfills-es2015.2473462a061a5e9d19fb.js:1 runOutsideAngular @ main-es2015.c6dc910dd819a55e81ef.js:1 onHandleError @ main-es2015.c6dc910dd819a55e81ef.js:1 handleError @ polyfills-es2015.2473462a061a5e9d19fb.js:1 runTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 invokeTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 invoke @ polyfills-es2015.2473462a061a5e9d19fb.js:1 n.args. @ polyfills-es2015.2473462a061a5e9d19fb.js:1 setTimeout (async) i @ polyfills-es2015.2473462a061a5e9d19fb.js:1 scheduleTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 onScheduleTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 scheduleTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 scheduleTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 scheduleMacroTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 l @ polyfills-es2015.2473462a061a5e9d19fb.js:1 (anonymous) @ polyfills-es2015.2473462a061a5e9d19fb.js:1 D.s. @ polyfills-es2015.2473462a061a5e9d19fb.js:1 i @ main-es2015.c6dc910dd819a55e81ef.js:1 __tryOrUnsub @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 _next @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 _next @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 _next @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 _next @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 notifyNext @ main-es2015.c6dc910dd819a55e81ef.js:1 _next @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 _next @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 o @ main-es2015.c6dc910dd819a55e81ef.js:1 invokeTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 onInvokeTask @ main-es2015.c6dc910dd819a55e81ef.js:1 invokeTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 runTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 invokeTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 p @ polyfills-es2015.2473462a061a5e9d19fb.js:1 f @ polyfills-es2015.2473462a061a5e9d19fb.js:1 load (async) P @ polyfills-es2015.2473462a061a5e9d19fb.js:1 scheduleTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 onScheduleTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 scheduleTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 scheduleTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 scheduleEventTask @ polyfills-es2015.2473462a061a5e9d19fb.js:1 (anonymous) @ polyfills-es2015.2473462a061a5e9d19fb.js:1 (anonymous) @ main-es2015.c6dc910dd819a55e81ef.js:1 _trySubscribe @ main-es2015.c6dc910dd819a55e81ef.js:1 subscribe @ main-es2015.c6dc910dd819a55e81ef.js:1 call @ main-es2015.c6dc910dd819a55e81ef.js:1 subscribe @ main-es2015.c6dc910dd819a55e81ef.js:1 l @ main-es2015.c6dc910dd819a55e81ef.js:1 _innerSub @ main-es2015.c6dc910dd819a55e81ef.js:1 _tryNext @ main-es2015.c6dc910dd819a55e81ef.js:1 _next @ main-es2015.c6dc910dd819a55e81ef.js:1 next @ main-es2015.c6dc910dd819a55e81ef.js:1 (anonymous) @ main-es2015.c6dc910dd819a55e81ef.js:1 _trySubscribe @ main-es2015.c6dc910dd819a55e81ef.js:1 subscribe @ main-es2015.c6dc910dd819a55e81ef.js:1 call @ main-es2015.c6dc910dd819a55e81ef.js:1 subscribe @ main-es2015.c6dc910dd819a55e81ef.js:1 call @ main-es2015.c6dc910dd819a55e81ef.js:1 subscribe @ main-es2015.c6dc910dd819a55e81ef.js:1 call @ main-es2015.c6dc910dd819a55e81ef.js:1 subscribe @ main-es2015.c6dc910dd819a55e81ef.js:1 call @ main-es2015.c6dc910dd819a55e81ef.js:1 subscribe @ mai
[jira] [Commented] (FLINK-25812) Show Plan in Ui doesn't show.
[ https://issues.apache.org/jira/browse/FLINK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484725#comment-17484725 ] None none commented on FLINK-25812: --- The UI looks like this: !Screen Shot 2022-01-31 at 9.55.26 AM.png! > Show Plan in Ui doesn't show. > - > > Key: FLINK-25812 > URL: https://issues.apache.org/jira/browse/FLINK-25812 > Project: Flink > Issue Type: Bug > Components: Runtime / Web Frontend >Affects Versions: 1.14.3 >Reporter: None none >Priority: Major > Attachments: Screen Shot 2022-01-31 at 9.55.26 AM.png > > > Click on any job on the Ui to run it. Click "Show Plan". Show plan ui shows > up but blank. There is also an exception recorded. > > 2022-01-25 21:34:02,243 INFO org.apache.flink.runtime.jobmaster.JobMaster > [] - Registration failure at ResourceManager occurred. > org.apache.flink.util.SerializedThrowable: > org.apache.flink.runtime.rpc.exceptions.RpcConnectionException: Could not > connect to rpc endpoint under address > akka.tcp://flink@xx-v-job-0001:46025/user/rpc/jobmanager_10. > at > org.apache.flink.runtime.rpc.akka.AkkaRpcService.lambda$resolveActorAddress$11(AkkaRpcService.java:602) > ~[?:?] > at > scala.concurrent.java8.FuturesConvertersImpl$CF$$anon$1.accept(FutureConvertersImpl.scala:59) > ~[?:?] > at > scala.concurrent.java8.FuturesConvertersImpl$CF$$anon$1.accept(FutureConvertersImpl.scala:53) > ~[?:?] > at > java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) > ~[?:1.8.0_312] > at > java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) > ~[?:1.8.0_312] > at > java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456) > ~[?:1.8.0_312] > at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_312] > Caused by: org.apache.flink.util.SerializedThrowable: Could not connect to > rpc endpoint under address > akka.tcp://flink@xx-v-job-0001:46025/user/rpc/jobmanager_10. > ... 7 more > Caused by: org.apache.flink.util.SerializedThrowable: Actor not found for: > ActorSelection[Anchor(akka://flink/), Path(/user/rpc/jobmanager_10)] > at > akka.actor.ActorSelection.$anonfun$resolveOne$1(ActorSelection.scala:74) > ~[?:?] > at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at > akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63) > ~[?:?] > at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:81) > ~[?:?] > at > akka.dispatch.internal.SameThreadExecutionContext$$anon$1.unbatchedExecute(SameThreadExecutionContext.scala:21) > ~[?:?] > at akka.dispatch.BatchingExecutor.execute(BatchingExecutor.scala:130) > ~[?:?] > at akka.dispatch.BatchingExecutor.execute$(BatchingExecutor.scala:124) > ~[?:?] > at > akka.dispatch.internal.SameThreadExecutionContext$$anon$1.execute(SameThreadExecutionContext.scala:20) > ~[?:?] > at > scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at > scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallback(Promise.scala:312) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at > scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:303) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at akka.actor.ActorSelection.resolveOne(ActorSelection.scala:72) ~[?:?] > at akka.actor.ActorSelection.resolveOne(ActorSelection.scala:89) ~[?:?] > at akka.actor.ActorSelection.resolveOne(ActorSelection.scala:130) ~[?:?] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcService.resolveActorAddress(AkkaRpcService.java:596) > ~[?:?] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcService.connectInternal(AkkaRpcService.java:547) > ~[?:?] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcService.connect(AkkaRpcService.java:233) > ~[?:?] > at > org.apache.flink.runtime.resourcemanager.ResourceManager.registerJobManager(ResourceManager.java:367) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at sun.reflect.GeneratedMethodAccessor70.invoke(Unknown Source) ~[?:?] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_312] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_312] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:316) > ~[?:?] > at > org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83) > ~[?:?] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:314) > ~[?:?] > at > org.apache.flink.runtime.rpc
[jira] [Commented] (FLINK-25812) Show Plan in Ui doesn't show.
[ https://issues.apache.org/jira/browse/FLINK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484723#comment-17484723 ] None none commented on FLINK-25812: --- Ok looked into it further. The error above is unrelated I guess. So the cluster now seems healthy and all... So what I did is I went and clicked show plan on all 3 job managers and the logs consistantly show... 2022-01-31 14:50:27,515 WARN org.apache.flink.runtime.webmonitor.handlers.JarPlanHandler [] - Configuring the job submission via query parameters is deprecated. Please migrate to submitting a JSON request instead. 2022-01-31 14:50:27,515 WARN org.apache.flink.runtime.webmonitor.handlers.JarPlanHandler [] - Configuring the job submission via query parameters is deprecated. Please migrate to submitting a JSON request instead. 2022-01-31 14:50:27,516 WARN org.apache.flink.runtime.webmonitor.handlers.JarPlanHandler [] - Configuring the job submission via query parameters is deprecated. Please migrate to submitting a JSON request instead. 2022-01-31 14:50:27,658 INFO org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT. 2022-01-31 14:50:27,658 INFO org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using default options factory: DefaultConfigurableOptionsFactory\{configuredOptions={}}. 2022-01-31 14:50:27,709 INFO org.apache.flink.api.java.typeutils.TypeExtractor [] - class io.vertx.core.json.JsonObject does not contain a setter for field map 2022-01-31 14:50:27,709 INFO org.apache.flink.api.java.typeutils.TypeExtractor [] - Class class io.vertx.core.json.JsonObject cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance. 2022-01-31 14:50:27,734 INFO org.apache.flink.api.java.typeutils.TypeExtractor [] - class io.vertx.core.json.JsonObject does not contain a setter for field map 2022-01-31 14:50:27,735 INFO org.apache.flink.api.java.typeutils.TypeExtractor [] - Class class io.vertx.core.json.JsonObject cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance. 2022-01-31 14:50:31,559 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager a70a698ba5d7fb9eb513611f1dbf4...@akka.tcp://flink@xx-v-job-0001:46025/user/rpc/jobmanager_10 for job b4ae95a2b94d8bad8a6a04c912e0bfa8. > Show Plan in Ui doesn't show. > - > > Key: FLINK-25812 > URL: https://issues.apache.org/jira/browse/FLINK-25812 > Project: Flink > Issue Type: Bug > Components: Runtime / Web Frontend >Affects Versions: 1.14.3 >Reporter: None none >Priority: Major > Attachments: Screen Shot 2022-01-31 at 9.55.26 AM.png > > > Click on any job on the Ui to run it. Click "Show Plan". Show plan ui shows > up but blank. There is also an exception recorded. > > 2022-01-25 21:34:02,243 INFO org.apache.flink.runtime.jobmaster.JobMaster > [] - Registration failure at ResourceManager occurred. > org.apache.flink.util.SerializedThrowable: > org.apache.flink.runtime.rpc.exceptions.RpcConnectionException: Could not > connect to rpc endpoint under address > akka.tcp://flink@xx-v-job-0001:46025/user/rpc/jobmanager_10. > at > org.apache.flink.runtime.rpc.akka.AkkaRpcService.lambda$resolveActorAddress$11(AkkaRpcService.java:602) > ~[?:?] > at > scala.concurrent.java8.FuturesConvertersImpl$CF$$anon$1.accept(FutureConvertersImpl.scala:59) > ~[?:?] > at > scala.concurrent.java8.FuturesConvertersImpl$CF$$anon$1.accept(FutureConvertersImpl.scala:53) > ~[?:?] > at > java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) > ~[?:1.8.0_312] > at > java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) > ~[?:1.8.0_312] > at > java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456) > ~[?:1.8.0_312] > at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_312] > Caused by: org.apache.flink.util.SerializedThrowable: Could not connect to > rpc endpoint under address > akka.tcp://flink@xx-v-job-0001:46025/user/rpc/jobmanager_10. > ... 7 more > Caused by: org.apache.flink.util.SerializedThrowable: Actor not found for: > ActorSelection[Anchor(akka://flink/), Path(/user/rpc/jobmanager_10)] > at > akka.actor.ActorSelection.$anonfun$resolveOne$1(ActorSelection.scala:74) > ~[?:?] > at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60) > ~[flink-dist_2.12-1.
[jira] [Commented] (FLINK-25812) Show Plan in Ui doesn't show.
[ https://issues.apache.org/jira/browse/FLINK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483056#comment-17483056 ] Chesnay Schepler commented on FLINK-25812: -- That looks like a connectivity issues between the different job managers, and if so this issue shouldn't be limited to this one REST endpoint. > Show Plan in Ui doesn't show. > - > > Key: FLINK-25812 > URL: https://issues.apache.org/jira/browse/FLINK-25812 > Project: Flink > Issue Type: Bug > Components: Runtime / Web Frontend >Affects Versions: 1.14.3 >Reporter: None none >Priority: Major > > Click on any job on the Ui to run it. Click "Show Plan". Show plan ui shows > up but blank. There is also an exception recorded. > > 2022-01-25 21:34:02,243 INFO org.apache.flink.runtime.jobmaster.JobMaster > [] - Registration failure at ResourceManager occurred. > org.apache.flink.util.SerializedThrowable: > org.apache.flink.runtime.rpc.exceptions.RpcConnectionException: Could not > connect to rpc endpoint under address > akka.tcp://flink@xx-v-job-0001:46025/user/rpc/jobmanager_10. > at > org.apache.flink.runtime.rpc.akka.AkkaRpcService.lambda$resolveActorAddress$11(AkkaRpcService.java:602) > ~[?:?] > at > scala.concurrent.java8.FuturesConvertersImpl$CF$$anon$1.accept(FutureConvertersImpl.scala:59) > ~[?:?] > at > scala.concurrent.java8.FuturesConvertersImpl$CF$$anon$1.accept(FutureConvertersImpl.scala:53) > ~[?:?] > at > java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) > ~[?:1.8.0_312] > at > java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) > ~[?:1.8.0_312] > at > java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456) > ~[?:1.8.0_312] > at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_312] > Caused by: org.apache.flink.util.SerializedThrowable: Could not connect to > rpc endpoint under address > akka.tcp://flink@xx-v-job-0001:46025/user/rpc/jobmanager_10. > ... 7 more > Caused by: org.apache.flink.util.SerializedThrowable: Actor not found for: > ActorSelection[Anchor(akka://flink/), Path(/user/rpc/jobmanager_10)] > at > akka.actor.ActorSelection.$anonfun$resolveOne$1(ActorSelection.scala:74) > ~[?:?] > at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at > akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63) > ~[?:?] > at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:81) > ~[?:?] > at > akka.dispatch.internal.SameThreadExecutionContext$$anon$1.unbatchedExecute(SameThreadExecutionContext.scala:21) > ~[?:?] > at akka.dispatch.BatchingExecutor.execute(BatchingExecutor.scala:130) > ~[?:?] > at akka.dispatch.BatchingExecutor.execute$(BatchingExecutor.scala:124) > ~[?:?] > at > akka.dispatch.internal.SameThreadExecutionContext$$anon$1.execute(SameThreadExecutionContext.scala:20) > ~[?:?] > at > scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at > scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallback(Promise.scala:312) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at > scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:303) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at akka.actor.ActorSelection.resolveOne(ActorSelection.scala:72) ~[?:?] > at akka.actor.ActorSelection.resolveOne(ActorSelection.scala:89) ~[?:?] > at akka.actor.ActorSelection.resolveOne(ActorSelection.scala:130) ~[?:?] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcService.resolveActorAddress(AkkaRpcService.java:596) > ~[?:?] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcService.connectInternal(AkkaRpcService.java:547) > ~[?:?] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcService.connect(AkkaRpcService.java:233) > ~[?:?] > at > org.apache.flink.runtime.resourcemanager.ResourceManager.registerJobManager(ResourceManager.java:367) > ~[flink-dist_2.12-1.14.3.jar:1.14.3] > at sun.reflect.GeneratedMethodAccessor70.invoke(Unknown Source) ~[?:?] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_312] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_312] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:316) > ~[?:?] > at > org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83) > ~[?:?] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:314) > ~[?:?] > at > org.apa