liuxiangwei created YARN-5939:
---------------------------------

             Summary: Disabling the cache of FileSystem leads to case that 
never close the FileSystem
                 Key: YARN-5939
                 URL: https://issues.apache.org/jira/browse/YARN-5939
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 2.7.3, 2.5.1
            Reporter: liuxiangwei


To use our self-defined FileSystem class, the item of configuration 
"fs.%s.impl.disable.cache" should set to true.

In YARN's source code, the class named "org.apache.hadoop.yarn.util.FSDownload" 
use getFileSystem but never close, which leading to file descriptor leak 
because our self-defined FileSystem class close the file descriptor when the 
close function is invoked.

My Question below:
1. whether invoking "getFileSystem" but never close is YARN's expected behavior 
2. what should we do in our self-defined FileSystem resolve it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Reply via email to