liuxiangwei created YARN-5939: --------------------------------- Summary: Disabling the cache of FileSystem leads to case that never close the FileSystem Key: YARN-5939 URL: https://issues.apache.org/jira/browse/YARN-5939 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 2.7.3, 2.5.1 Reporter: liuxiangwei
To use our self-defined FileSystem class, the item of configuration "fs.%s.impl.disable.cache" should set to true. In YARN's source code, the class named "org.apache.hadoop.yarn.util.FSDownload" use getFileSystem but never close, which leading to file descriptor leak because our self-defined FileSystem class close the file descriptor when the close function is invoked. My Question below: 1. whether invoking "getFileSystem" but never close is YARN's expected behavior 2. what should we do in our self-defined FileSystem resolve it. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org