Hi Burcu Could you show more logs? I could try to help find out what is happening. But to be honest the 1.4 is too old a version that the community does not support. You’d better upgrade to a newer version. Best, Guowei
On Fri, Jun 25, 2021 at 2:48 PM Burcu Gül POLAT EĞRİ <burcu...@gmail.com> wrote: > Dear All, > > we are using Flink 1.4.1 one of our projects. We send some image > processing jobs to our processing nodes via Flink. Flink Task Managers are > installed on each processing nodes. And our main application sends jobs to > Flink Job Manager and Flink Job Manager sends jobs to Flink Task Manages > according to availability. We implement a java application(let's say node > application) and send this application jar to nodes while sending jobs. > Flink executes this application. And this applications executes our > processors running on processing nodes. This was working properly but some > how we get a wierd error sometimes these day. We can not understan why. Our > main application send lots of jobs to Job Manager and some times it > responds HTTP 500 with below exception. But our node application continues > to execution. When we receive HTTP 500 we send the job again and for this > time Job Manager returns HTTP 200. We cannot understand why we received > HTTP 500 and below exception. This error causes to generate same images and > our customer doesn't want to generate images more than one. > > 09:45:49.614 WARN [local-cluster-thread-2] > t.c.s.m.w.n.a.e.FlinkJobExecutor.initializeJob:977 - [PROCESS_ID: > WFM-ba350a80-1b5a-4ca4-869a-e3c9d3a0c32d]/Cannot instantiate job in FLINK > in 1. trial; no job identifier is provided by Flink api, please check if > system configuration is valid and Flink is running. Flink responds with > http response is 500. Flink return response String: > java.util.concurrent.CompletionException: > org.apache.flink.util.FlinkException: Could not run the jar. > at > org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleJsonRequest$0(JarRunHandler.java:90) > at > java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Caused by: org.apache.flink.util.FlinkException: Could not run the jar. > ... 9 more > Caused by: org.apache.flink.client.program.ProgramInvocationException: The > program caused an error: > at > org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:93) > at > org.apache.flink.client.program.ClusterClient.getOptimizedPlan(ClusterClient.java:334) > at > org.apache.flink.runtime.webmonitor.handlers.JarActionHandler.getJobGraphAndClassLoader(JarActionHandler.java:87) > at > org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleJsonRequest$0(JarRunHandler.java:69) > ... 8 more > Caused by: > org.apache.flink.client.program.OptimizerPlanEnvironment$ProgramAbortException > at > org.apache.flink.client.program.OptimizerPlanEnvironment.execute(OptimizerPlanEnvironment.java:54) > at > org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:815) > at org.apache.flink.api.java.DataSet.collect(DataSet.java:413) > at org.apache.flink.api.java.DataSet.print(DataSet.java:1652) > at > tr.com.sdt.mm.wfm.processor.api.agent.ProcessorInvokerAgent.main(ProcessorInvokerAgent.java:139) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:525) > at > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:417) > at > org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:83) > ... 11 more > > -- > BURCU >
