[jira] [Commented] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-02-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289736#comment-17289736 ] Hadoop QA commented on HDFS-15809: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15584) Improve HDFS large deletion cause namenode lockqueue boom and pending deletion boom.

2021-02-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289721#comment-17289721 ] Qi Zhu commented on HDFS-15584: --- [~sodonnell]  [~hexiaoqiao]  If you any other advice abou

[jira] [Resolved] (HDFS-15781) Add metrics for how blocks are moved in replaceBlock

2021-02-23 Thread Jing Zhao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-15781. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed I've committed the patch. Tha

[jira] [Work logged] (HDFS-15781) Add metrics for how blocks are moved in replaceBlock

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15781?focusedWorklogId=556768&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556768 ] ASF GitHub Bot logged work on HDFS-15781: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15781) Add metrics for how blocks are moved in replaceBlock

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15781?focusedWorklogId=556765&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556765 ] ASF GitHub Bot logged work on HDFS-15781: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

2021-02-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289660#comment-17289660 ] Hadoop QA commented on HDFS-14013: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

2021-02-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289615#comment-17289615 ] Wei-Chiu Chuang commented on HDFS-15422: I think the patch looks reasonable. I am

[jira] [Commented] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-02-23 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289599#comment-17289599 ] Jinglun commented on HDFS-15809: Hi [~leosun08], thanks your comments. Submit v04 using L

[jira] [Updated] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-02-23 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15809: --- Attachment: HDFS-15809.004.patch > DeadNodeDetector doesn't remove live nodes from dead node set. > -

[jira] [Commented] (HDFS-15808) Add metrics for FSNamesystem read/write lock hold long time

2021-02-23 Thread tomscut (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289585#comment-17289585 ] tomscut commented on HDFS-15808: Hi [~xkrogen] [~aengineer]  [~shv] [~zhuqi] , could you

[jira] [Comment Edited] (HDFS-15854) Make some parameters configurable for SlowDiskTracker and SlowPeerTracker

2021-02-23 Thread tomscut (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289582#comment-17289582 ] tomscut edited comment on HDFS-15854 at 2/24/21, 1:57 AM: -- Hi [~

[jira] [Updated] (HDFS-15853) Add option to adjust slow IO warning threshold time for different StorageType on DFSClient

2021-02-23 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15853: Summary: Add option to adjust slow IO warning threshold time for different StorageType on DFSClient (was:

[jira] [Commented] (HDFS-15854) Make some parameters configurable for SlowDiskTracker and SlowPeerTracker

2021-02-23 Thread tomscut (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289582#comment-17289582 ] tomscut commented on HDFS-15854: Hi [~arp] [~dchitlangia] , Could you please help to revi

[jira] [Updated] (HDFS-15855) Solve the problem of incorrect EC progress when loading FsImage

2021-02-23 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-15855: Description: When loading FsImage, if EC information exists, the EC loading display is incorrect d

[jira] [Work logged] (HDFS-15781) Add metrics for how blocks are moved in replaceBlock

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15781?focusedWorklogId=556557&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556557 ] ASF GitHub Bot logged work on HDFS-15781: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

2021-02-23 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Target Version/s: 3.4.0 Status: Patch Available (was: Open) > HDFS ZKFC on

[jira] [Updated] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

2021-02-23 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Attachment: HDFS-14013.001.patch > HDFS ZKFC on standby NN not starting with credentials

[jira] [Assigned] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

2021-02-23 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-14013: Assignee: Stephen O'Donnell > HDFS ZKFC on standby NN not starting with credential

[jira] [Commented] (HDFS-15853) Add option to adjust slow IO warning threshold time for diffrent StorageType on DFSClient

2021-02-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289133#comment-17289133 ] Hadoop QA commented on HDFS-15853: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15849) ExpiredHeartbeats metric should be of Type.COUNTER

2021-02-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289120#comment-17289120 ] Hadoop QA commented on HDFS-15849: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Work logged] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15759?focusedWorklogId=556348&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556348 ] ASF GitHub Bot logged work on HDFS-15759: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15847) create client protocol: add ecPolicyName & storagePolicy param to debug statement string

2021-02-23 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289096#comment-17289096 ] Bhavik Patel commented on HDFS-15847: - Thank you [~ayushtkn] > create client protoco

[jira] [Updated] (HDFS-15847) create client protocol: add ecPolicyName & storagePolicy param to debug statement string

2021-02-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15847: Fix Version/s: 3.4.0 3.3.1 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HDFS-15847) create client protocol: add ecPolicyName & storagePolicy param to debug statement string

2021-02-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289087#comment-17289087 ] Ayush Saxena commented on HDFS-15847: - Committed to trunk and branch-3.3 Thanx [~bpa

[jira] [Updated] (HDFS-15847) create client protocol: add ecPolicyName & storagePolicy param to debug statement string

2021-02-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15847: Priority: Minor (was: Major) > create client protocol: add ecPolicyName & storagePolicy param to d

[jira] [Assigned] (HDFS-15855) Solve the problem of incorrect EC progress when loading FsImage

2021-02-23 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-15855: --- Assignee: JiangHua Zhu > Solve the problem of incorrect EC progress when loading FsImage > -

[jira] [Comment Edited] (HDFS-15847) create client protocol: add ecPolicyName & storagePolicy param to debug statement string

2021-02-23 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289077#comment-17289077 ] Bhavik Patel edited comment on HDFS-15847 at 2/23/21, 1:23 PM:

[jira] [Commented] (HDFS-15847) create client protocol: add ecPolicyName & storagePolicy param to debug statement string

2021-02-23 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289077#comment-17289077 ] Bhavik Patel commented on HDFS-15847: - [~ayushtkn] Thanks for reviewing the patch! ca

[jira] [Created] (HDFS-15855) Solve the problem of incorrect EC progress when loading FsImage

2021-02-23 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-15855: --- Summary: Solve the problem of incorrect EC progress when loading FsImage Key: HDFS-15855 URL: https://issues.apache.org/jira/browse/HDFS-15855 Project: Hadoop HDFS

[jira] [Work logged] (HDFS-15854) Make some parameters configurable for SlowDiskTracker and SlowPeerTracker

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15854?focusedWorklogId=556329&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556329 ] ASF GitHub Bot logged work on HDFS-15854: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15854) Make some parameters configurable for SlowDiskTracker and SlowPeerTracker

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15854: -- Labels: pull-request-available (was: ) > Make some parameters configurable for SlowDiskTracker

[jira] [Commented] (HDFS-15808) Add metrics for FSNamesystem read/write lock hold long time

2021-02-23 Thread tomscut (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289072#comment-17289072 ] tomscut commented on HDFS-15808: Thanks [~zhuqi] [~shv] [~xkrogen]  for review. > Add me

[jira] [Created] (HDFS-15854) Make some parameters configurable for SlowDiskTracker and SlowPeerTracker

2021-02-23 Thread tomscut (Jira)
tomscut created HDFS-15854: -- Summary: Make some parameters configurable for SlowDiskTracker and SlowPeerTracker Key: HDFS-15854 URL: https://issues.apache.org/jira/browse/HDFS-15854 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-15854) Make some parameters configurable for SlowDiskTracker and SlowPeerTracker

2021-02-23 Thread tomscut (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tomscut reassigned HDFS-15854: -- Assignee: tomscut > Make some parameters configurable for SlowDiskTracker and SlowPeerTracker > --

[jira] [Commented] (HDFS-15852) HDFS Put was failed with IPV6 cluster

2021-02-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289017#comment-17289017 ] Steve Loughran commented on HDFS-15852: --- You'll need the IPv6 support of HADOOP-118

[jira] [Updated] (HDFS-15852) HDFS Put was failed with IPV6 cluster

2021-02-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-15852: -- Fix Version/s: (was: 3.3.1) > HDFS Put was failed with IPV6 cluster >

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

2021-02-23 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289016#comment-17289016 ] Stephen O'Donnell commented on HDFS-15422: -- [~kihwal] Have you been running the

[jira] [Commented] (HDFS-15849) ExpiredHeartbeats metric should be of Type.COUNTER

2021-02-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288998#comment-17288998 ] Qi Zhu commented on HDFS-15849: --- [~shv] [~tomscut] Fixed the metric related test in latest

[jira] [Updated] (HDFS-15849) ExpiredHeartbeats metric should be of Type.COUNTER

2021-02-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated HDFS-15849: -- Attachment: HDFS-15849.002.patch > ExpiredHeartbeats metric should be of Type.COUNTER > ---

[jira] [Commented] (HDFS-15822) Client retry mechanism may invalid when use hedgedRead

2021-02-23 Thread tianhang tang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288995#comment-17288995 ] tianhang tang commented on HDFS-15822: -- [~ferhui] Hi, could u help me to review this

[jira] [Commented] (HDFS-15849) ExpiredHeartbeats metric should be of Type.COUNTER

2021-02-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288990#comment-17288990 ] Hadoop QA commented on HDFS-15849: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15808) Add metrics for FSNamesystem read/write lock hold long time

2021-02-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288982#comment-17288982 ] Qi Zhu commented on HDFS-15808: --- Thanks [~tomscut] for contribution, patch LGTM. +1  > Add

[jira] [Updated] (HDFS-15853) Add option to adjust slow IO warning threshold time for diffrent StorageType on DFSClient

2021-02-23 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15853: Attachment: HDFS-15853.001.patch Status: Patch Available (was: Open) > Add option to adjust slow I

[jira] [Created] (HDFS-15853) Add option to adjust slow IO warning threshold time for diffrent StorageType on DFSClient

2021-02-23 Thread Yang Yun (Jira)
Yang Yun created HDFS-15853: --- Summary: Add option to adjust slow IO warning threshold time for diffrent StorageType on DFSClient Key: HDFS-15853 URL: https://issues.apache.org/jira/browse/HDFS-15853 Project