[ https://issues.apache.org/jira/browse/HDFS-97?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harsh J resolved HDFS-97. ------------------------- Resolution: Not A Problem We do tend to avoid highly loaded DataNodes (via xceiver counts) which may almost do the same operation. Resolving as not a problem. > DFS should detect slow links(nodes) and avoid them > -------------------------------------------------- > > Key: HDFS-97 > URL: https://issues.apache.org/jira/browse/HDFS-97 > Project: Hadoop HDFS > Issue Type: Bug > Reporter: Runping Qi > > The current DFS does not detect slow links (nodes). > Thus, when a node or its network link is slow, it may affect the overall > system performance significantly. > Specifically, when a map job needs to read data from such a node, it may > progress 10X slower. > And when a DFS data node pipeline consists of such a node, the write > performance degrades significantly. > This may lead to some long tails for map/reduce jobs. We have experienced > such behaviors quite often. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira