Sreeja created HDDS-15455:
-----------------------------
Summary: Implement Custom DataNode Container Directory Discovery
and Duplicate Detection
Key: HDDS-15455
URL: https://issues.apache.org/jira/browse/HDDS-15455
Project: Apache Ozone
Issue Type: Sub-task
Reporter: Sreeja
Assignee: Sreeja
Implement logic to traverse all storage volumes configured in
*{{hdds.datanode.dir}}* and discover container directories present on disk. For
each container directory, collect the container ID, directory path, volume,
size, and
compute the metadata status :
if metadata/\{containerId}.container missing => *MISSING_METADATA*
if metadata/\{containerId}.container exists but parse fails or containerId does
not match with directory-name containerId => *INVALID_METADATA*
otherwise => *VALID*
Store the results as a mapping of {{{}containerId -> list of disk
occurrences{}}}, preserving all discovered copies of a container. This
information will also be used to identify duplicate container directories by
detecting container IDs with multiple on-disk occurrences across storage
volumes on the same DataNode.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
