[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo Nicholas Sze updated HDFS-7276: -------------------------------------- Attachment: h7276_20141027b.patch h7276_20141027b.patch: configurable parameters and formatted the performance tests output. {noformat} arrayLength=65536, nThreads=512, nAllocations=16384, maxArrays=1024 NewByteArrayWithoutLimit: 1748, 1795, 1808, 1789, 1824, avg = 1792.800 NewByteArrayWithLimit: 1814, 1801, 1805, 1809, 1827, avg = 1811.200 UsingByteArrayManager: 1740, 1735, 1723, 1734, 1714, avg = 1729.200 {noformat} > Limit the number of byte arrays used by DFSOutputStream > ------------------------------------------------------- > > Key: HDFS-7276 > URL: https://issues.apache.org/jira/browse/HDFS-7276 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs-client > Reporter: Tsz Wo Nicholas Sze > Assignee: Tsz Wo Nicholas Sze > Attachments: h7276_20141021.patch, h7276_20141022.patch, > h7276_20141023.patch, h7276_20141024.patch, h7276_20141027.patch, > h7276_20141027b.patch > > > When there are a lot of DFSOutputStream's writing concurrently, the number of > outstanding packets could be large. The byte arrays created by those packets > could occupy a lot of memory. -- This message was sent by Atlassian JIRA (v6.3.4#6332)