Ethan Rose created HDDS-6235:
--------------------------------
Summary: Empty KeyValueContainers cannot be replicated
Key: HDDS-6235
URL: https://issues.apache.org/jira/browse/HDDS-6235
Project: Apache Ozone
Issue Type: Bug
Components: Ozone Datanode
Reporter: Ethan Rose
Assignee: Ethan Rose
An empty KeyValueContainer will have an empty chunks directory.
TarContainerPacker#pack recurses into directories adding files into containers,
but if the chunks directory is empty, it will not be included in the tar. The
receiver will unpack the tar successfully, but the resulting container will not
have a chunks directory. After this, the container will not be able to
replicated further, as the tar packing step requires all container pieces to be
present on disk. The container may also be marked unhealthy by the background
container scanner. This issue is more likely to occur due to HDDS-5359, which
causes many empty containers to be tracked by SCM indefinitely.
This Jira will fix the issue with the tar packer, and also add a repair step on
datanode startup to create the chunks directory for containers that do not have
one. This step should be a quick addition to datanode startup that already
iterates all the containers, and should not impact startup time.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
