[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974483#comment-16974483 ] Anu Engineer commented on HDDS-2372: bq. It's possible to remove the usage of the tmp files but only

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974161#comment-16974161 ] Marton Elek commented on HDDS-2372: --- We had a long discussion with [~shashikant] . Here is the summary:

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969470#comment-16969470 ] Anu Engineer commented on HDDS-2372: > Thanks Anu Engineer for the suggestion. Writing to the actual

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969379#comment-16969379 ] Shashikant Banerjee commented on HDDS-2372: --- In ratis, raft log entries can get truncated after

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969286#comment-16969286 ] Marton Elek commented on HDDS-2372: --- {quote}Writing to the actual chunk file may lead to handling

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968960#comment-16968960 ] Shashikant Banerjee commented on HDDS-2372: --- Thanks [~aengineer] for the suggestion. Writing to

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968767#comment-16968767 ] Anu Engineer commented on HDDS-2372: In the Chunk write path, we write chunks to a temp file and then

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968264#comment-16968264 ] Marton Elek commented on HDDS-2372: --- I had a long conversation with [~shashikant] and He helped me a lot

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968213#comment-16968213 ] Marton Elek commented on HDDS-2372: --- Yes, I tried this, but it doesn't work. Assuming the algorithm is

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967873#comment-16967873 ] Tsz-wo Sze commented on HDDS-2372: -- It makes sense to check the chunk file again after temporary chunk

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963815#comment-16963815 ] Shashikant Banerjee commented on HDDS-2372: --- [~szetszwo], to answer your question precisely,

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963813#comment-16963813 ] Shashikant Banerjee commented on HDDS-2372: --- Thanks [~elek] . I do agree that, there is no

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963796#comment-16963796 ] Marton Elek commented on HDDS-2372: --- cc: [~msingh] > Datanode pipeline is failing with

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962159#comment-16962159 ] Marton Elek commented on HDDS-2372: --- I tried to reproduce it locally with docker-compose. In container

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962153#comment-16962153 ] Marton Elek commented on HDDS-2372: --- Thanks the help [~szetszwo] # I found it only at one datanode. But

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962112#comment-16962112 ] Tsz-wo Sze commented on HDDS-2372: -- Some questions (sorry that I don't understand the test): - Did the

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961939#comment-16961939 ] Marton Elek commented on HDDS-2372: --- @szetszwo Do you think it's a possible explanation? > Datanode

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961938#comment-16961938 ] Marton Elek commented on HDDS-2372: --- Let's say I am writing chunks. Imagine the following timing.