On Tue, Jun 07, 2022 at 03:26:43PM +0800, czc...@gmail.com wrote: > On Mon, Jun 06, 2022 at 10:42:08AM +0800, Shengkai Fang wrote: > > Hi. In my experience, the step to debug classloading problems are as > > follows: > > Thanks for the help. We get the following log when using > `-verbose:class`: > > [2.074s][info][class,load] org.apache.hadoop.fs.FileSystem source: > file:/opt/flink/opt/flink-s3-fs-hadoop-1.15.0.jar > ... > [8.094s][info][class,load] > com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem source: > file:/opt/flink/opt/flink-gs-fs-hadoop-1.15.0.jar > > > It looks like application uses hadoop.fs.FileSystem from > flink-s3-fs-hadoop-1.15.0.jar, and use GoogleHadoopFileSystem from > flink-gs-fs-hadoop-1.15.0.jar, and they are incompatible. Since we run > Flink in both AWS and GCP, our base image contains both plugins at the > same time. Any idea how to workaround it? > > We also try to set `classloader.resolve-order: parent-first`. However, > we got another error causing by library conflict between Flink and our > application: > > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Scala > module 2.11.3 requires Jackson Databind version >= 2.11.0 and < 2.12.0
We solve the problem by moving plugins into correct plugins directory.
Thanks for the help from slack.
--
ChangZhuo Chen (陳昌倬) czchen@{czchen,debian}.org
http://czchen.info/
Key fingerprint = BA04 346D C2E1 FE63 C790 8793 CC65 B0CD EC27 5D5B
signature.asc
Description: PGP signature
