sarvekshayr opened a new pull request, #8079: URL: https://github.com/apache/ozone/pull/8079
## What changes were proposed in this pull request? Introduced a `--metadata` flag under `ozone debug replicas verify` command to check for block existence using `GetBlock` calls to the datanodes. For each key, it iterates through all replicas and verifies block presence. ## What is the link to the Apache JIRA [HDDS-12495](https://issues.apache.org/jira/browse/HDDS-12495) ## How was this patch tested? Tested the patch on a docker cluster. 1. When all the blocks exist for a given key, it will be indicated with `"status": "BLOCK_EXISTS"`. ``` bash-5.1$ ozone debug replicas verify --metadata / --output-dir /tmp | jq { "key": "ockrwvolume/ockrwbucket/vnmnn1ltsx/1679091", "blockID": "conID: 1 locID: 115816896921600007 bcsId: 25 replicaIndex: null", "status": "BLOCK_EXISTS", "pass": true } { "key": "ockrwvolume/ockrwbucket/vnmnn1ltsx/45c48cc", "blockID": "conID: 1 locID: 115816896921600010 bcsId: 38 replicaIndex: null", "status": "BLOCK_EXISTS", "pass": true } { "key": "ockrwvolume/ockrwbucket/vnmnn1ltsx/8f14e45", "blockID": "conID: 1 locID: 115816896921600008 bcsId: 29 replicaIndex: null", "status": "BLOCK_EXISTS", "pass": true } ``` 2. If some blocks are missing, it will be indicated with `"status": "MISSING"`. ``` bash-5.1$ ozone debug replicas verify --metadata / --output-dir /tmp | jq { "key": "ockrwvolume/ockrwbucket/vnmnn1ltsx/1679091", "status": "MISSING", "pass": false } { "key": "ockrwvolume/ockrwbucket/vnmnn1ltsx/45c48cc", "status": "MISSING", "pass": false } { "key": "ockrwvolume/ockrwbucket/vnmnn1ltsx/8f14e45", "status": "MISSING", "pass": false } ``` 3. If some error is encountered while fetching details, it throws `"status": "ERROR"` along with the error message. ``` bash-5.1$ ozone debug replicas verify --metadata / --output-dir /tmp | jq { "key": "ockrwvolume/ockrwbucket/vnmnn1ltsx/45c48cc", "status": "ERROR", "message": "No Route to Host from 10a39f1ddd74/172.31.0.7 to scm:9860 failed on socket timeout exception: java.net.NoRouteToHostException: No route to host; For more details see: http://wiki.apache.org/hadoop/NoRouteToHost";, "pass": false } ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
