---------- Forwarded message --------- From: Yi Tang <ssnailt...@gmail.com> Date: Sun, Apr 24, 2022 at 11:29 AM Subject: Write to Aliyun OSS via FileSystem connector hang Job Master on Finishing To: <user@flink.apache.org>
Hi team; I'm trying to write to aliyun oss via FileSystem connector. The job master always hangs on finishing. Looks like it is because the FileSystem connector commits the files by #finalizeGlobal while the Job is finishing, which includes some rename operations. However, the aliyun oss FileSystem renames files by copying, which seems expensive. Any suggestions about this scenario? Thanks and regards.