[
https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969286#comment-16969286
]
Marton Elek commented on HDDS-2372:
-----------------------------------
{quote}Writing to the actual chunk file may lead to handling truncation log
entries in Ratis inside Ozone which we don't need to handle right now as we
always write to tmp chunk files. Even if log entries get truncated inside Ratis
, tmp files are left behind as garbage.
{quote}
Sorry, it's not clear for me what does it mean. Can you please give more
details about this scenario? We may have garbage tmp files anyway.
The suggestion from [~aengineer] would have a big benefit. Could would be
simplified a lot as we don't need to write anything during commit the commit
phse. The current code is a little tricky we have the same writeChunk method
for both commit and write and we have a flag (inside DispatcherContext) which
shows which function is called.
> Datanode pipeline is failing with NoSuchFileException
> -----------------------------------------------------
>
> Key: HDDS-2372
> URL: https://issues.apache.org/jira/browse/HDDS-2372
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Reporter: Marton Elek
> Assignee: Shashikant Banerjee
> Priority: Critical
>
> Found it on a k8s based test cluster using a simple 3 node cluster and
> HDDS-2327 freon test. After a while the StateMachine become unhealthy after
> this error:
> {code:java}
> datanode-0 datanode java.util.concurrent.ExecutionException:
> java.util.concurrent.ExecutionException:
> org.apache.hadoop.hdds.scm.container.common.helpers.StorageContainerException:
> java.nio.file.NoSuchFileException:
> /data/storage/hdds/2a77fab9-9dc5-4f73-9501-b5347ac6145c/current/containerDir0/1/chunks/gGYYgiTTeg_testdata_chunk_13931.tmp.2.20830
> {code}
> Can be reproduced.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
