[
https://issues.apache.org/jira/browse/HDFS-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816912#comment-13816912
]
Brandon Li commented on HDFS-5364:
----------------------------------
Thank you, Jing. I've committed the patch.
> Add OpenFileCtx cache
> ---------------------
>
> Key: HDFS-5364
> URL: https://issues.apache.org/jira/browse/HDFS-5364
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: nfs
> Reporter: Brandon Li
> Assignee: Brandon Li
> Fix For: 2.2.1
>
> Attachments: HDFS-5364.001.patch, HDFS-5364.002.patch,
> HDFS-5364.003.patch, HDFS-5364.004.patch, HDFS-5364.005.patch,
> HDFS-5364.006.patch, HDFS-5364.007.patch, HDFS-5364.008.patch,
> HDFS-5364.009.patch
>
>
> NFS gateway can run out of memory when the stream timeout is set to a
> relatively long period(e.g., >1 minute) and user uploads thousands of files
> in parallel. Each stream DFSClient creates a DataStreamer thread, and will
> eventually run out of memory by creating too many threads.
> NFS gateway should have a OpenFileCtx cache to limit the total opened files.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
