Re: Job submission failure via flink cli
Please make sure the client and server version are in sync. On 2/3/2021 4:12 PM, sidhant gupta wrote: I am getting following error while running the below command with the attached conf/flink-conf.yaml: bin/flink run -c firstflinkpackage.someJob ../somejob.jar arg1 arg2 arg3 2021-02-03 15:04:24,113 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 9cbf97d3f9b368bf2c27a52b39601500 (Flink FHIR Mapper). 2021-02-03 15:04:24,115 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 9cbf97d3f9b368bf2c27a52b39601500 (Flink FHIR Mapper). 2021-02-03 15:04:24,334 INFO org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphStore [] - Added JobGraph(jobId: 9cbf97d3f9b368bf2c27a52b39601500) to ZooKeeper. 2021-02-03 15:04:24,335 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_5 . 2021-02-03 15:04:24,336 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job Flink FHIR Mapper (9cbf97d3f9b368bf2c27a52b39601500). 2021-02-03 15:04:24,337 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=3, backoffTimeMS=5000) for Flink FHIR Mapper (9cbf97d3f9b368bf2c27a52b39601500). 2021-02-03 15:04:24,337 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job Flink FHIR Mapper (9cbf97d3f9b368bf2c27a52b39601500). 2021-02-03 15:04:24,337 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. 2021-02-03 15:04:24,461 INFO org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphStore [] - Removed job graph 9cbf97d3f9b368bf2c27a52b39601500 from ZooKeeper. 2021-02-03 15:04:24,461 INFO org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphStore [] - Removed job graph 9cbf97d3f9b368bf2c27a52b39601500 from ZooKeeper. 2021-02-03 15:04:24,697 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Failed to submit job 9cbf97d3f9b368bf2c27a52b39601500. org.apache.flink.runtime.client.JobExecutionException: Could not instantiate JobManager. at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$6(Dispatcher.java:398) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source) ~[?:?] at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.11-1.11.2.jar:1.11.2] Caused by: java.lang.NullPointerException at java.util.Collections$UnmodifiableCollection.(Unknown Source) ~[?:?] at java.util.Collections$UnmodifiableList.(Unknown Source) ~[?:?] at java.util.Collections.unmodifiableList(Unknown Source) ~[?:?] at org.apache.flink.runtime.jobgraph.JobVertex.getOperatorCoordinators(JobVertex.java:352) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.(ExecutionJobVertex.java:232) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.executiongraph.ExecutionGraph.attachJobGraph(ExecutionGraph.java:814) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:228) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.scheduler.SchedulerBase.createExecutionGraph(SchedulerBase.java:269) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:242) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.scheduler.SchedulerBase.(SchedulerBase.java:229) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.scheduler.DefaultScheduler.(DefaultScheduler.java:119) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:103) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:284) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.jobmaster.JobMaster.(JobMaster.java:272) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at
Job submission failure via flink cli
I am getting following error while running the below command with the attached conf/flink-conf.yaml: bin/flink run -c firstflinkpackage.someJob ../somejob.jar arg1 arg2 arg3 2021-02-03 15:04:24,113 INFO org.apache.flink.runtime.dispatcher. StandaloneDispatcher [] - Received JobGraph submission 9cbf97d3f9b368bf2c27a52b39601500 (Flink FHIR Mapper). 2021-02-03 15:04:24,115 INFO org.apache.flink.runtime.dispatcher. StandaloneDispatcher [] - Submitting job 9cbf97d3f9b368bf2c27a52b39601500 ( Flink FHIR Mapper). 2021-02-03 15:04:24,334 INFO org.apache.flink.runtime.jobmanager. ZooKeeperJobGraphStore [] - Added JobGraph(jobId: 9cbf97d3f9b368bf2c27a52b39601500) to ZooKeeper. 2021-02-03 15:04:24,335 INFO org.apache.flink.runtime.rpc.akka. AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_5 . 2021-02-03 15:04:24,336 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job Flink FHIR Mapper (9cbf97d3f9b368bf2c27a52b39601500). 2021-02-03 15:04:24,337 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=3, backoffTimeMS=5000) for Flink FHIR Mapper (9 cbf97d3f9b368bf2c27a52b39601500). 2021-02-03 15:04:24,337 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job Flink FHIR Mapper (9 cbf97d3f9b368bf2c27a52b39601500). 2021-02-03 15:04:24,337 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. 2021-02-03 15:04:24,461 INFO org.apache.flink.runtime.jobmanager. ZooKeeperJobGraphStore [] - Removed job graph 9cbf97d3f9b368bf2c27a52b39601500 from ZooKeeper. 2021-02-03 15:04:24,461 INFO org.apache.flink.runtime.jobmanager. ZooKeeperJobGraphStore [] - Removed job graph 9cbf97d3f9b368bf2c27a52b39601500 from ZooKeeper. 2021-02-03 15:04:24,697 ERROR org.apache.flink.runtime.dispatcher. StandaloneDispatcher [] - Failed to submit job 9 cbf97d3f9b368bf2c27a52b39601500. org.apache.flink.runtime.client.JobExecutionException: Could not instantiate JobManager. at org.apache.flink.runtime.dispatcher.Dispatcher .lambda$createJobManagerRunner$6(Dispatcher.java:398) ~[flink-dist_2.11-1.11 .2.jar:1.11.2] at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source) ~[?:?] at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool .java:1339) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.11-1.11.2.jar:1.11.2] at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread .java:107) [flink-dist_2.11-1.11.2.jar:1.11.2] Caused by: java.lang.NullPointerException at java.util.Collections$UnmodifiableCollection.(Unknown Source) ~[?:?] at java.util.Collections$UnmodifiableList.(Unknown Source) ~[?:?] at java.util.Collections.unmodifiableList(Unknown Source) ~[?:?] at org.apache.flink.runtime.jobgraph.JobVertex.getOperatorCoordinators( JobVertex.java:352) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.( ExecutionJobVertex.java:232) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.executiongraph.ExecutionGraph .attachJobGraph(ExecutionGraph.java:814) ~[flink-dist_2.11-1.11.2.jar:1.11.2 ] at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder .buildGraph(ExecutionGraphBuilder.java:228) ~[flink-dist_2.11-1.11.2.jar: 1.11.2] at org.apache.flink.runtime.scheduler.SchedulerBase .createExecutionGraph(SchedulerBase.java:269) ~[flink-dist_2.11-1.11.2.jar: 1.11.2] at org.apache.flink.runtime.scheduler.SchedulerBase .createAndRestoreExecutionGraph(SchedulerBase.java:242) ~[flink-dist_2.11- 1.11.2.jar:1.11.2] at org.apache.flink.runtime.scheduler.SchedulerBase.(SchedulerBase .java:229) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.scheduler.DefaultScheduler.( DefaultScheduler.java:119) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory .createInstance(DefaultSchedulerFactory.java:103) ~[flink-dist_2.11-1.11.2 .jar:1.11.2] at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler( JobMaster.java:284) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.jobmaster.JobMaster.(JobMaster.java: 272) ~[flink-dist_2.11-1.11.2.jar:1.11.2] at org.apache.flink.runtime.jobmaster.factories. DefaultJobMasterServiceFactory.createJobMasterService( DefaultJobMasterServiceFactory.java:98)
