[ https://issues.apache.org/jira/browse/FLINK-27911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zoucao updated FLINK-27911: --------------------------- Component/s: FileSystems > Set HDFS LEASE_TIMEOUT as user-configurable > ------------------------------------------- > > Key: FLINK-27911 > URL: https://issues.apache.org/jira/browse/FLINK-27911 > Project: Flink > Issue Type: Improvement > Components: FileSystems > Affects Versions: 1.12.2, 1.14.4 > Reporter: zoucao > Priority: Major > Attachments: exceptions > > > The HDFS LEASE_TIMEOUT in *HadoopRecoverableFsDataOutputStream* is set to > 100_000 millis, In some cases, 100 seconds is not enough. In our company, > when using StreamingFileSink to write records to HDFS and the parallelism is > set to 512 or larger, the following exceptions occur frequently. I think we > can update the parameter LEASE_TIMEOUT as user-configurable. -- This message was sent by Atlassian Jira (v8.20.7#820007)