[ https://issues.apache.org/jira/browse/HDFS-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brandon Li updated HDFS-5364: ----------------------------- Attachment: HDFS-5364.003.patch > Add OpenFileCtx cache > --------------------- > > Key: HDFS-5364 > URL: https://issues.apache.org/jira/browse/HDFS-5364 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: nfs > Reporter: Brandon Li > Assignee: Brandon Li > Attachments: HDFS-5364.001.patch, HDFS-5364.002.patch, > HDFS-5364.003.patch > > > NFS gateway can run out of memory when the stream timeout is set to a > relatively long period(e.g., >1 minute) and user uploads thousands of files > in parallel. Each stream DFSClient creates a DataStreamer thread, and will > eventually run out of memory by creating too many threads. > NFS gateway should have a OpenFileCtx cache to limit the total opened files. -- This message was sent by Atlassian JIRA (v6.1#6144)