---------- Forwarded message ---------
From: Yi Tang <ssnailt...@gmail.com>
Date: Sun, Apr 24, 2022 at 11:29 AM
Subject: Write to Aliyun OSS via FileSystem connector hang Job Master on
Finishing
To: <user@flink.apache.org>


Hi team;

I'm trying to write to aliyun oss via FileSystem connector. The job master
always hangs on finishing.

Looks like it is because the FileSystem connector commits the files by
#finalizeGlobal while the Job is finishing, which includes some rename
operations. However, the aliyun oss FileSystem renames files by copying,
which seems expensive.

Any suggestions about this scenario?

Thanks and regards.

Reply via email to