[ https://issues.apache.org/jira/browse/HDFS-14644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895543#comment-16895543 ]
Wei-Chiu Chuang commented on HDFS-14644: ---------------------------------------- What [~sodonnell] proposed makes sense to me. This is like the erasure coding topology verification command (hdfs ec -verifyClusterSetup) implemented in HDFS-12946. The trick is how to implement this at scale. Alternatively, while decomm, if the live nodes in the cluster are fewer than a block's target replica count, show it in the web UI. I think it shouldn't add too much overhead. > That replication of block failed leads to decommission is blocked when the > number of replicas of block is greater than the number of datanode > --------------------------------------------------------------------------------------------------------------------------------------------- > > Key: HDFS-14644 > URL: https://issues.apache.org/jira/browse/HDFS-14644 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namenode > Affects Versions: 3.1.1, 2.9.2, 3.0.3, 2.8.5, 2.7.7 > Reporter: Lisheng Sun > Priority: Major > > 2019-07-10,15:37:18,028 WARN > org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy: Failed to > place enough replicas, still in need of 5 to reach 10 > (unavailableStorages=[DISK, ARCHIVE], > storagePolicy=BlockStoragePolicy\{HOT:7, storageTypes=[DISK], > creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) All > required storage types are unavailable: unavailableStorages=[DISK, ARCHIVE], > storagePolicy=BlockStoragePolicy\{HOT:7, storageTypes=[DISK], > creationFallbacks=[], replicationFallbacks=[ARCHIVE]} > 2019-07-10,15:37:18,028 WARN > org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy: Failed to > place enough replicas, still in need of 5 to reach 10 > (unavailableStorages=[], storagePolicy=BlockStoragePolicy\{HOT:7, > storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, > newBlock=false) For more information, please enable DEBUG log level on > org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy -- This message was sent by Atlassian JIRA (v7.6.14#76016) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org