[ https://issues.apache.org/jira/browse/HDFS-16692?focusedWorklogId=795252&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795252 ]
ASF GitHub Bot logged work on HDFS-16692: ----------------------------------------- Author: ASF GitHub Bot Created on: 26/Jul/22 13:00 Start Date: 26/Jul/22 13:00 Worklog Time Spent: 10m Work Description: ZanderXu commented on PR #4630: URL: https://github.com/apache/hadoop/pull/4630#issuecomment-1195451753 @slfan1989 Thanks for your review and nice suggestion. I didn't do it on purpose. I'm found them one by one while troubleshooting issues in production. I thought this pr would help HDFS administrators to easily locate some abnormal case, so I crated it. not on purpose. Thanks for your review and suggestion again. Issue Time Tracking ------------------- Worklog Id: (was: 795252) Time Spent: 0.5h (was: 20m) > Add detailed scope info in NotEnoughReplicas Reason logs. > --------------------------------------------------------- > > Key: HDFS-16692 > URL: https://issues.apache.org/jira/browse/HDFS-16692 > Project: Hadoop HDFS > Issue Type: Improvement > Reporter: ZanderXu > Assignee: ZanderXu > Priority: Minor > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > When we write some ec data from clients that are not in hdfs cluster, there > is a lot of INFO log output, as blew > {code:shell} > 2022-07-26 15:50:40,973 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=17} > 2022-07-26 15:50:40,974 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=18} > 2022-07-26 15:50:40,974 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=17} > 2022-07-26 15:50:40,975 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=18} > 2022-07-26 15:50:40,975 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=17} > 2022-07-26 15:50:40,976 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=18} > 2022-07-26 15:50:40,976 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=18} > 2022-07-26 15:50:40,977 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=18} > 2022-07-26 15:50:40,977 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=19} > 2022-07-26 15:50:40,977 INFO blockmanagement.BlockPlacementPolicy > (BlockPlacementPolicyDefault.java:chooseRandom(912)) - Not enough replicas > was chosen. Reason: {NO_REQUIRED_STORAGE_TYPE=1, TOO_MANY_NODES_ON_RACK=3} > {code} > I feel that we should add detailed scope info in this log to show the scope > that we cannot select any good nodes from. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org