Hi, I'm writing a job to merge old data with changelogs using DataSet API where I'm reading changelog using TextInputFormat and old data using HadoopInputFormat.
I can see, job manager has successfully deployed the program flow to worker nodes. However, workers are immediately going to failed state because of *Caused by: java.lang.IllegalArgumentException: Invalid lambda deserialization* Complete stack trace java.lang.RuntimeException: The initialization of the DataSource's outputs caused an error: Could not read the user code wrapper: unexpected exception type at org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:94) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.flink.runtime.operators.util.CorruptConfigurationException: Could not read the user code wrapper: unexpected exception type at org.apache.flink.runtime.operators.util.TaskConfig.getStubWrapper(TaskConfig.java:290) at org.apache.flink.runtime.operators.BatchTask.instantiateUserCode(BatchTask.java:1432) at org.apache.flink.runtime.operators.chaining.ChainedMapDriver.setup(ChainedMapDriver.java:39) at org.apache.flink.runtime.operators.chaining.ChainedDriver.setup(ChainedDriver.java:90) at org.apache.flink.runtime.operators.BatchTask.initOutputs(BatchTask.java:1299) at org.apache.flink.runtime.operators.DataSourceTask.initOutputs(DataSourceTask.java:287) at org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:91) ... 2 more Caused by: java.io.IOException: unexpected exception type at java.io.ObjectStreamClass.throwMiscException(ObjectStreamClass.java:1682) at java.io.ObjectStreamClass.invokeReadResolve(ObjectStreamClass.java:1254) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2078) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:433) at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:290) at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:248) at org.apache.flink.runtime.operators.util.TaskConfig.getStubWrapper(TaskConfig.java:288) ... 8 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at java.lang.invoke.SerializedLambda.readResolve(SerializedLambda.java:230) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at java.io.ObjectStreamClass.invokeReadResolve(ObjectStreamClass.java:1248) ... 18 more Caused by: java.lang.IllegalArgumentException: Invalid lambda deserialization at org.myorg.quickstart.MergeTableSecond.$deserializeLambda$(MergeTableSecond.java:41) ... 28 more Running Environment Flink: 1.3.2 Java: openjdk version "1.8.0_151" Please help us resolve this issue. -- Thanks, Amit
