Re: Job submission failure via flink cli

Wed, 03 Feb 2021 07:22:38 -0800 

Please make sure the client and server version are in sync.

On 2/3/2021 4:12 PM, sidhant gupta wrote:
I am getting following error while running the below command with the attached conf/flink-conf.yaml: 

bin/flink run -c firstflinkpackage.someJob ../somejob.jar arg1 arg2 arg3
2021-02-03 15:04:24,113 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 9cbf97d3f9b368bf2c27a52b39601500 (Flink FHIR Mapper). 2021-02-03 15:04:24,115 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 9cbf97d3f9b368bf2c27a52b39601500 (Flink FHIR Mapper). 2021-02-03 15:04:24,334 INFO org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphStore [] - Added JobGraph(jobId: 9cbf97d3f9b368bf2c27a52b39601500) to ZooKeeper. 2021-02-03 15:04:24,335 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_5 . 2021-02-03 15:04:24,336 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job Flink FHIR Mapper (9cbf97d3f9b368bf2c27a52b39601500). 2021-02-03 15:04:24,337 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=3, backoffTimeMS=5000) for Flink FHIR Mapper (9cbf97d3f9b368bf2c27a52b39601500). 2021-02-03 15:04:24,337 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job Flink FHIR Mapper (9cbf97d3f9b368bf2c27a52b39601500). 2021-02-03 15:04:24,337 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. 2021-02-03 15:04:24,461 INFO org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphStore [] - Removed job graph 9cbf97d3f9b368bf2c27a52b39601500 from ZooKeeper. 2021-02-03 15:04:24,461 INFO org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphStore [] - Removed job graph 9cbf97d3f9b368bf2c27a52b39601500 from ZooKeeper. 2021-02-03 15:04:24,697 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Failed to submit job 9cbf97d3f9b368bf2c27a52b39601500. org.apache.flink.runtime.client.JobExecutionException: Could not instantiate JobManager.     at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$6(Dispatcher.java:398) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source) ~[?:?]     at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.11-1.11.2.jar:1.11.2] 
Caused by: java.lang.NullPointerException
    at java.util.Collections$UnmodifiableCollection.<init>(Unknown Source) ~[?:?]     at java.util.Collections$UnmodifiableList.<init>(Unknown Source) ~[?:?] 
    at java.util.Collections.unmodifiableList(Unknown Source) ~[?:?]
    at org.apache.flink.runtime.jobgraph.JobVertex.getOperatorCoordinators(JobVertex.java:352) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<init>(ExecutionJobVertex.java:232) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.executiongraph.ExecutionGraph.attachJobGraph(ExecutionGraph.java:814) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:228) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.SchedulerBase.createExecutionGraph(SchedulerBase.java:269) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:242) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.SchedulerBase.<init>(SchedulerBase.java:229) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.DefaultScheduler.<init>(DefaultScheduler.java:119) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:103) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:284) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:272) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:98) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:40) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl.<init>(JobManagerRunnerImpl.java:140) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.dispatcher.DefaultJobManagerRunnerFactory.createJobManagerRunner(DefaultJobManagerRunnerFactory.java:84) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$6(Dispatcher.java:388) ~[flink-dist_2.11-1.11.2.jar:1.11.2] 
    ... 7 more
2021-02-03 15:04:24,698 ERROR org.apache.flink.runtime.rest.handler.job.JobSubmitHandler [] - Unhandled exception. org.apache.flink.runtime.client.JobSubmissionException: Failed to submit job.     at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$internalSubmitJob$3(Dispatcher.java:344) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at java.util.concurrent.CompletableFuture.uniHandle(Unknown Source) ~[?:?]     at java.util.concurrent.CompletableFuture$UniHandle.tryFire(Unknown Source) ~[?:?]     at java.util.concurrent.CompletableFuture$Completion.run(Unknown Source) ~[?:?]     at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.11-1.11.2.jar:1.11.2]     at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.11-1.11.2.jar:1.11.2] Caused by: org.apache.flink.runtime.client.JobExecutionException: Could not instantiate JobManager.     at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$6(Dispatcher.java:398) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source) ~[?:?] 
    ... 6 more
Caused by: java.lang.NullPointerException
    at java.util.Collections$UnmodifiableCollection.<init>(Unknown Source) ~[?:?]     at java.util.Collections$UnmodifiableList.<init>(Unknown Source) ~[?:?] 
    at java.util.Collections.unmodifiableList(Unknown Source) ~[?:?]
    at org.apache.flink.runtime.jobgraph.JobVertex.getOperatorCoordinators(JobVertex.java:352) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<init>(ExecutionJobVertex.java:232) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.executiongraph.ExecutionGraph.attachJobGraph(ExecutionGraph.java:814) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:228) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.SchedulerBase.createExecutionGraph(SchedulerBase.java:269) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:242) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.SchedulerBase.<init>(SchedulerBase.java:229) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.DefaultScheduler.<init>(DefaultScheduler.java:119) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:103) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:284) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:272) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:98) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:40) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl.<init>(JobManagerRunnerImpl.java:140) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.dispatcher.DefaultJobManagerRunnerFactory.createJobManagerRunner(DefaultJobManagerRunnerFactory.java:84) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$6(Dispatcher.java:388) ~[flink-dist_2.11-1.11.2.jar:1.11.2]     at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source) ~[?:?] 
    ... 6 more

Please help me on this.

Thanks
Sidhant Gupta

Reply via email to