Re: UUID on TableAPI

Hi Ian, What is the problem that you're trying to solve? Best regards, Martijn Visser https://twitter.com/MartijnVisser82 https://github.com/MartijnVisser On Tue, 26 Apr 2022 at 02:41, lan tran wrote: > Ok, thanks for the clarification. > > > > Sent from Mail

Re: OOM errors cause by the new KafkaSink API

Hi, What's the Flink version that you're using? Could you also separate the two steps (switching from the old Kafka interfaces to the new ones + modifying serializers) to determine which of the two steps cause the problem? Best regards, Martijn Visser https://twitter.com/MartijnVisser82 https://

NO jobmanager.log for yarn-per-job submitted with sql-client.sh

Flink Version (1.13) There is not jobmanager.log file when submit yarn-per-job with sql-client.sh。(set execution.target = yarn-per-job;) There are not -Dlog.file and -Dlog4j.configuration properties argument in the auto-generated launch_container.sh on YARN cluster。e.g. the last line of launch_cont

Re: How to debug Metaspace exception?

So I put classloader.parent-first-patterns.additional: "org.apache.ignite." in the task config and so far I don't think I'm getting "java.lang.OutOfMemoryError: Metaspace" any more. Or it's too early to tell. Though now, the task managers are shutting down due to some other failures. So maybe be

Task manager shutting down.

Hi running 1.14.4 Logs included: https://www.dropbox.com/s/8zjndt5rzd9o80f/flink-flink-taskexecutor-138-task-0002.log?dl=0 1- My task managers shut down with: Terminating TaskManagerRunner with exit code 1. 2- It seems to happen at the same time every day. Which leads me to believe it's our datab

Re: Task manager shutting down.

Hi John, Have you built your own JDBC MSSQL source or sink or perhaps a CDC driver? Because I'm not aware of a Flink Microsoft SQL Server JDBC driver. Best regards, Martijn Visser https://twitter.com/MartijnVisser82 https://github.com/MartijnVisser On Tue, 26 Apr 2022 at 16:01, John Smith wro

Re: How to debug Metaspace exception?

JDBC drivers are well-known for leaking classloaders unfortunately. You have correctly identified your alternatives. You must put the jdbc driver into /lib instead. Setting only the parent-first pattern shouldn't affect anything. That is only relevant if something is in both in /lib and the use

Re: Task manager shutting down.

Yeah based off the flink JDBC output format... On Tue, Apr 26, 2022 at 10:05 AM Martijn Visser wrote: > Hi John, > > Have you built your own JDBC MSSQL source or sink or perhaps a CDC driver? > Because I'm not aware of a Flink Microsoft SQL Server JDBC driver. > > Best regards, > > Martijn Viss

Re: How to debug Metaspace exception?

Ok so I should put the Apache ignite and my Microsoft drivers in the lib folders of my task managers? And then in my job jar only include them as compile time dependencies? On Tue, Apr 26, 2022 at 10:42 AM Chesnay Schepler wrote: > JDBC drivers are well-known for leaking classloaders unfortuna

Re: How to debug Metaspace exception?

Hi Chesnay as per the docs... https://nightlies.apache.org/flink/flink-docs-master/docs/ops/debugging/debugging_classloading/ You can either put the jars in task manager lib folder or use classloader.parent-first-patterns-additional

Unsubscribe

Unsubscribe Regards, Amit Bhatia