看错误是 metaspace OOM 了,可以按照提示,增加 taskmanager.memory.jvm-metaspace.size
的大小,或者增加 TM 总内存大小

Best,
Lijie

weishishuo...@163.com <weishishuo...@163.com> 于2022年6月7日周二 18:37写道:

> 我使用的版本是:
> flink:1.13.2
> flink cdc: flink-connector-jdbc_2.11-1.13.2.jar
> flink-sql-connector-mysql-cdc-2.2.0.jar
> flink-sql-connector-postgres-cdc-2.2.0.jar
>
> 任务比较简单,就是从mysql、pg同步数据到pg,mysql,使用的是sql接口,请问大伙儿有碰到过这个问题吗?
>
> 2022-06-07 18:13:59,393 ERROR
> org.apache.flink.runtime.taskexecutor.TaskManagerRunner      [] - Fatal
> error occurred while executing the TaskManager. Shutting it down...
> java.lang.OutOfMemoryError: Metaspace. The metaspace out-of-memory error
> has occurred. This can mean two things: either the job requires a larger
> size of JVM metaspace to load classes or there is a class loading leak. In
> the first case 'taskmanager.memory.jvm-metaspace.size' configuration option
> should be increased. If the error persists (usually in cluster after
> several job (re-)submissions) then there is probably a class loading leak
> in user code or some of its dependencies which has to be investigated and
> fixed. The task executor has to be shutdown...    at
> java.lang.ClassLoader.defineClass1(Native Method) ~[?:1.8.0_112]
>     at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> ~[?:1.8.0_112]
>     at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> ~[?:1.8.0_112]
>     at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
> ~[?:1.8.0_112]
>     at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
> ~[?:1.8.0_112]
>     at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
> ~[?:1.8.0_112]
>     at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
> ~[?:1.8.0_112]
>     at java.security.AccessController.doPrivileged(Native Method)
> ~[?:1.8.0_112]
>     at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
> ~[?:1.8.0_112]
>     at
> org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:71)
> ~[flink-dist_2.11-1.13.2.jar:1.13.2]
>     at
> org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48)
> [flink-dist_2.11-1.13.2.jar:1.13.2]
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357) [?:1.8.0_112]
>     at io.debezium.relational.Column.editor(Column.java:31)
> [blob_p-343be43b7874de49f6ce1d8bcb6a90a384203530-2e5afb6f8bf4834164c1bb92aaf97a00:2.2.0]
>     at
> io.debezium.connector.postgresql.connection.PostgresConnection.readTableColumn(PostgresConnection.java:464)
> [blob_p-343be43b7874de49f6ce1d8bcb6a90a384203530-2e5afb6f8bf4834164c1bb92aaf97a00:2.2.0]
>     at
> io.debezium.jdbc.JdbcConnection.getColumnsDetails(JdbcConnection.java:1226)
> [blob_p-343be43b7874de49f6ce1d8bcb6a90a384203530-2e5afb6f8bf4834164c1bb92aaf97a00:2.2.0]
>     at
> io.debezium.jdbc.JdbcConnection.readSchema(JdbcConnection.java:1182)
> [blob_p-343be43b7874de49f6ce1d8bcb6a90a384203530-2e5afb6f8bf4834164c1bb92aaf97a00:2.2.0]
>     at
> io.debezium.connector.postgresql.PostgresSchema.refresh(PostgresSchema.java:100)
> [blob_p-343be43b7874de49f6ce1d8bcb6a90a384203530-2e5afb6f8bf4834164c1bb92aaf97a00:2.2.0]
>     at
> io.debezium.connector.postgresql.PostgresSnapshotChangeEventSource.connectionCreated(PostgresSnapshotChangeEventSource.java:95)
> [blob_p-343be43b7874de49f6ce1d8bcb6a90a384203530-2e5afb6f8bf4834164c1bb92aaf97a00:2.2.0]
>     at
> io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:103)
> [blob_p-343be43b7874de49f6ce1d8bcb6a90a384203530-2e5afb6f8bf4834164c1bb92aaf97a00:2.2.0]
>
>
>
>
> weishishuo...@163.com
>

回复