Jiayi Liao created FLINK-19069: ---------------------------------- Summary: finalizeOnMaster takes too much time and client timeouts Key: FLINK-19069 URL: https://issues.apache.org/jira/browse/FLINK-19069 Project: Flink Issue Type: Improvement Components: Runtime / Task Affects Versions: 1.9.0 Reporter: Jiayi Liao
Currently we execute {{finalizeOnMaster}} in JM's main thread, which may stuck the JM for a very long time and client timeouts eventually. For example, we'd like to write data to HDFS and commit files on JM, which takes more than ten minutes to commit tens of thousands files. -- This message was sent by Atlassian Jira (v8.3.4#803005)