adoroszlai opened a new pull request #694: HDDS-2943. Parameterize unit tests for chunk manager implementation URL: https://github.com/apache/hadoop-ozone/pull/694 ## What changes were proposed in this pull request? 1. Apply some unit tests for both kinds of chunk layout (per-chunk, per-block). 2. Fix a bug in container data scrubber, which was still using per-chunk layout regardless of config. This can result in marking containers unhealthy: ``` [ContainerDataScanner(/data/hdds/hdds)] ERROR interfaces.Container: Corruption detected in container: [1] Exception: [Missing chunk file /data/hdds/hdds/1560ebb4-2052-44ee-b16e-d74caaca055e/current/containerDir0/1/chunks/103843356633071616_chunk_1] [ContainerDataScanner(/data/hdds/hdds)] INFO ozoneimpl.ContainerDataScanner: Completed an iteration of container data scrubber in 0 minutes. Number of iterations (since the data-node restart) : 1, Number of containers scanned in this iteration : 1, Number of unhealthy containers found in this iteration : 1 ``` https://issues.apache.org/jira/browse/HDDS-2943 ## How was this patch tested? https://github.com/adoroszlai/hadoop-ozone/runs/516276869 Verified that data scrubber does not mark container as unhealthy: ``` $ ozone freon ockg -n 1 -p test $ ozone scmcli container close 1 $ ozone freon ockv -n 1 -p test ... Successful executions: 1 ``` ``` [ContainerDataScanner(/data/hdds/hdds)] INFO ozoneimpl.ContainerDataScanner: Completed an iteration of container data scrubber in 0 minutes. Number of iterations (since the data-node restart) : 1, Number of containers scanned in this iteration : 1, Number of unhealthy containers found in this iteration : 0 ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org
