Janus Chow created HDFS-16275:
---------------------------------
Summary: [HDFS] Enable considerLoad for localWrite
Key: HDFS-16275
URL: https://issues.apache.org/jira/browse/HDFS-16275
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Janus Chow
Assignee: Janus Chow
Currently when client is on the same machine of a datanode, it will try to
write to the local machine regardless of the load of the datanode, that is the
xceiverCount.
In our production cluster, datanode and Nodemanager are running on the same
server, so when there are heavy jobs running on a labeled queue, the
corresponding datanodes will have higher xceiverCounts than other datanodes.
When other clients are trying to write, the exception of "could only be
replicated to 0 nodes" would be thrown.
This ticket is to enable considerLoad to avoid the hot local write.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
