[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443570#comment-17443570 ] Tsz-wo Sze commented on HDFS-16322: --- > ... (NOTE: t0 t0. It is correct if c1 succeeds but c0 gets

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443566#comment-17443566 ] Tsz-wo Sze commented on HDFS-16322: --- [~hexiaoqiao], The given case is not data loss. As long as NN has

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443550#comment-17443550 ] Xiaoqiao He commented on HDFS-16322: Thanks [~szetszwo] for your response. Considering the following

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=681327=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681327 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443527#comment-17443527 ] Tsz-wo Sze commented on HDFS-16322: --- > ... However, under concurrency, after the first execution of

[jira] [Work logged] (HDFS-16323) DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16323?focusedWorklogId=681306=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681306 ] ASF GitHub Bot logged work on HDFS-16323: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=681296=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681296 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=681294=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681294 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16323) DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16323?focusedWorklogId=681255=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681255 ] ASF GitHub Bot logged work on HDFS-16323: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16323) DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16323: -- Labels: pull-request-available (was: ) > DatanodeHttpServer doesn't require handler state map

[jira] [Created] (HDFS-16323) DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

2021-11-14 Thread Viraj Jasani (Jira)
Viraj Jasani created HDFS-16323: --- Summary: DatanodeHttpServer doesn't require handler state map while retrieving filter handlers Key: HDFS-16323 URL: https://issues.apache.org/jira/browse/HDFS-16323

[jira] [Work logged] (HDFS-16318) Add exception blockinfo

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16318?focusedWorklogId=681238=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681238 ] ASF GitHub Bot logged work on HDFS-16318: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=681237=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681237 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=681236=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681236 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16319) Add metrics doc for ReadLockLongHoldCount and WriteLockLongHoldCount

2021-11-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443357#comment-17443357 ] Ayush Saxena commented on HDFS-16319: - Committed to trunk and branch-3.3/ Thanx [~tomscut] for the

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=681226=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681226 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16319) Add metrics doc for ReadLockLongHoldCount and WriteLockLongHoldCount

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16319?focusedWorklogId=681225=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681225 ] ASF GitHub Bot logged work on HDFS-16319: - Author: ASF GitHub Bot

[jira] [Resolved] (HDFS-16319) Add metrics doc for ReadLockLongHoldCount and WriteLockLongHoldCount

2021-11-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16319. - Fix Version/s: 3.4.0 3.3.2 Hadoop Flags: Reviewed Resolution:

[jira] [Work logged] (HDFS-16319) Add metrics doc for ReadLockLongHoldCount and WriteLockLongHoldCount

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16319?focusedWorklogId=681223=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681223 ] ASF GitHub Bot logged work on HDFS-16319: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16319) Add metrics doc for ReadLockLongHoldCount and WriteLockLongHoldCount

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16319?focusedWorklogId=681224=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681224 ] ASF GitHub Bot logged work on HDFS-16319: - Author: ASF GitHub Bot

[jira] [Resolved] (HDFS-16321) Fix invalid config in TestAvailableSpaceRackFaultTolerantBPP

2021-11-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16321. - Fix Version/s: 3.4.0 3.3.2 Hadoop Flags: Reviewed Resolution:

[jira] [Commented] (HDFS-16321) Fix invalid config in TestAvailableSpaceRackFaultTolerantBPP

2021-11-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443355#comment-17443355 ] Ayush Saxena commented on HDFS-16321: - Committed to trunk and branch-3.3. Thanx [~philipse] for the

[jira] [Work logged] (HDFS-16321) Fix invalid config in TestAvailableSpaceRackFaultTolerantBPP

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16321?focusedWorklogId=681222=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681222 ] ASF GitHub Bot logged work on HDFS-16321: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-16321) Fix invalid config in TestAvailableSpaceRackFaultTolerantBPP

2021-11-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-16321: --- Assignee: guo > Fix invalid config in TestAvailableSpaceRackFaultTolerantBPP >

[jira] [Comment Edited] (HDFS-16320) Datanode retrieve slownode information from NameNode

2021-11-14 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443351#comment-17443351 ] Janus Chow edited comment on HDFS-16320 at 11/14/21, 2:13 PM: -- [~hexiaoqiao] 

[jira] [Commented] (HDFS-16320) Datanode retrieve slownode information from NameNode

2021-11-14 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443351#comment-17443351 ] Janus Chow commented on HDFS-16320: --- {quote}I mean that DataNode has the total information to decide if

[jira] [Commented] (HDFS-16318) Add exception blockinfo

2021-11-14 Thread guo (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443341#comment-17443341 ] guo commented on HDFS-16318: Thanks [~hexiaoqiao]  for your note, have just updated > Add exception

[jira] [Updated] (HDFS-16318) Add exception blockinfo

2021-11-14 Thread guo (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guo updated HDFS-16318: --- Description: we may suffer `Could not obtain the last block location` exception, but we may reading more than one

[jira] [Work logged] (HDFS-16318) Add exception blockinfo

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16318?focusedWorklogId=681218=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681218 ] ASF GitHub Bot logged work on HDFS-16318: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16321) Fix invalid config in TestAvailableSpaceRackFaultTolerantBPP

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16321?focusedWorklogId=681216=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681216 ] ASF GitHub Bot logged work on HDFS-16321: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16320) Datanode retrieve slownode information from NameNode

2021-11-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443283#comment-17443283 ] Xiaoqiao He commented on HDFS-16320: Thanks [~Symious] for your quick response. It is reasonable case

[jira] [Work logged] (HDFS-16321) Fix invalid config in TestAvailableSpaceRackFaultTolerantBPP

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16321?focusedWorklogId=681207=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681207 ] ASF GitHub Bot logged work on HDFS-16321: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16320) Datanode retrieve slownode information from NameNode

2021-11-14 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443276#comment-17443276 ] Janus Chow commented on HDFS-16320: --- [~hexiaoqiao]  Thank you for the review. The issue we met is we

[jira] [Comment Edited] (HDFS-16320) Datanode retrieve slownode information from NameNode

2021-11-14 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443276#comment-17443276 ] Janus Chow edited comment on HDFS-16320 at 11/14/21, 9:41 AM: -- [~hexiaoqiao] 

[jira] [Work logged] (HDFS-16318) Add exception blockinfo

2021-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16318?focusedWorklogId=681204=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681204 ] ASF GitHub Bot logged work on HDFS-16318: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16318) Add exception blockinfo

2021-11-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443273#comment-17443273 ] Xiaoqiao He commented on HDFS-16318: [~philipse] would you mind to add some information about

[jira] [Commented] (HDFS-16320) Datanode retrieve slownode information from NameNode

2021-11-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443268#comment-17443268 ] Xiaoqiao He commented on HDFS-16320: Thanks [~Symious] for your report and patch. IMO it is a little

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443263#comment-17443263 ] Xiaoqiao He commented on HDFS-16322: Thanks [~Nsupyq] for your report. It is interesting case. I am