Maybe you can share also which connector/format you are using? What is
the DDL?
Regards,
Timo
On 22.07.21 14:11, Natu Lauchande wrote:
Hey Timo,
Thanks for the reply.
No custom file as we are using Flink SQL and submitting the job directly
through the SQL Editor UI. We are using Flink 1.13.1 as the supported
flink version. No custom code all through Flink SQL on UI no jars.
Thanks,
Natu
On Thu, Jul 22, 2021 at 2:08 PM Timo Walther <twal...@apache.org
<mailto:twal...@apache.org>> wrote:
Hi Natu,
Ververica Platform 2.5 has updated the bundled Hadoop version but this
should not result in a NoClassDefFoundError exception. How are you
submitting your SQL jobs? You don't use Ververica's SQL service but
have
built a regular JAR file, right? If this is the case, can you share
your
pom.xml file with us? The Flink version stays constant at 1.12?
Regards,
Timo
On 22.07.21 12:22, Natu Lauchande wrote:
> Good day Flink community,
>
> Apache Flink/Ververica Community Edition - Question
>
>
> I am having an issue with my Flink SQL jobs since updating
from Flink
> 1.12/Ververica 2.4 to Ververica 2.5 . For all the jobs running on
> parquet and S3 i am getting the following error continuously:
>
> INITIALIZING to FAILED on 10.243.3.0:42337-2a3224 @
> 10-243-3-0.flink-metrics.vvp-jobs.svc.cluster.local (dataPort=39309).
>
> java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration
>
> at java.lang.Class.getDeclaredConstructors0(Native Method)
~[?:1.8.0_292]
>
> at java.lang.Class.privateGetDeclaredConstructors(Class.java:2671)
> ~[?:1.8.0_292]
>
> at java.lang.Class.getDeclaredConstructors(Class.java:2020)
~[?:1.8.0_292]
>
> *....*
>
> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461)
> ~[?:1.8.0_292]
>
> at
>
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:615)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:600)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:587)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:541)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:322)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:653)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:626)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:566)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:616)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:566)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:616)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:566)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:616)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:566)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:181)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.StreamTask.executeRestore(StreamTask.java:548)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:647)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:537)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:759)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_292]
>
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.conf.Configuration
>
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
~[?:1.8.0_292]
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
~[?:1.8.0_292]
>
> at
>
org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:65)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at
>
org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48)
> ~[flink-dist_2.12-1.13.1-stream1.jar:1.13.1-stream1[]
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
~[?:1.8.0_292]
>
> ... 57 more
>
> 2021-07-22 09:38:43,095 DEBUG
> org.apache.flink.runtime.scheduler.SharedSlot[] - Remove logical
slot
> (SlotRequestId{4297879e795d0516e36a7c26ccc795b2}) for execution
vertex
> (id cbc357ccb763df2852fee8c4fc7d55f2_0) from the physical slot
> (SlotRequestId{df7c49a6610b56f26aea214c05bcd9ed})
>
> 2021-07-22 09:38:43,096 DEBUG
> org.apache.flink.runtime.scheduler.SharedSlot[] - Release shared
slot
> externally (SlotRequestId{df7c49a6610b56f26aea214c05bcd9ed})
>
>
> Everything works well when i roll back to Ververica v2.4, has anyone
> experienced this error before.
>
> Thanks,
>
> Natu
>
