[jira] [Commented] (HDFS-15684) EC: Call recoverLease on DFSStripedOutputStream close exception

[ https://issues.apache.org/jira/browse/HDFS-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290745#comment-17290745 ] Hongbing Wang commented on HDFS-15684: -- [~ferhui] ok. Because this PR depends on  -HDFS-14694,- I

[jira] [Comment Edited] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290727#comment-17290727 ] zhengchenyu edited comment on HDFS-15715 at 2/25/21, 6:55 AM: -- [~hexiaoqiao]

[jira] [Commented] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290727#comment-17290727 ] zhengchenyu commented on HDFS-15715: [~hexiaoqiao] Yeah, no problem.  Note: I found this problem in

[jira] [Updated] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated HDFS-15715: --- Attachment: image-2021-02-25-14-41-49-394.png > ReplicatorMonitor performance degrades, when the

[jira] [Work logged] (HDFS-15856) Make recover the pipeline in same packet exceed times for stream closed configurable.

[ https://issues.apache.org/jira/browse/HDFS-15856?focusedWorklogId=557715=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-557715 ] ASF GitHub Bot logged work on HDFS-15856: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290654#comment-17290654 ] Xiaoqiao He commented on HDFS-15180: Thanks [~zhuqi] for your pings. This improvement has deployed in

[jira] [Commented] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290648#comment-17290648 ] Xiaoqiao He commented on HDFS-15715: Thanks [~zhengchenyu] involve me here. Do you mind to attach

[jira] [Commented] (HDFS-15856) Make recover the pipeline in same packet exceed times for stream closed configurable.

[ https://issues.apache.org/jira/browse/HDFS-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290216#comment-17290216 ] Hadoop QA commented on HDFS-15856: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290071#comment-17290071 ] Stephen O'Donnell commented on HDFS-14013: -- This Yetus run looks much better. The failing tests

[jira] [Commented] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290061#comment-17290061 ] Hadoop QA commented on HDFS-14013: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed from trunk

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Fix Version/s: 2.10.2 > Reported IBR is partially replaced with stored info when

[jira] [Commented] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289972#comment-17289972 ] Krzysztof Adamski commented on HDFS-14013: -- Thank you for picking up on the issue and updating

[jira] [Updated] (HDFS-15856) Make recover the pipeline in same packet exceed times for stream closed configurable.

[ https://issues.apache.org/jira/browse/HDFS-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15856: -- Labels: pull-request-available (was: ) > Make recover the pipeline in same packet exceed

[jira] [Work logged] (HDFS-15856) Make recover the pipeline in same packet exceed times for stream closed configurable.

[ https://issues.apache.org/jira/browse/HDFS-15856?focusedWorklogId=556988=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556988 ] ASF GitHub Bot logged work on HDFS-15856: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289934#comment-17289934 ] Hadoop QA commented on HDFS-15422: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-15856) Make recover the pipeline in same packet exceed times for stream closed configurable.

Qi Zhu created HDFS-15856: - Summary: Make recover the pipeline in same packet exceed times for stream closed configurable. Key: HDFS-15856 URL: https://issues.apache.org/jira/browse/HDFS-15856 Project:

[jira] [Commented] (HDFS-15822) Client retry mechanism may invalid when use hedgedRead

[ https://issues.apache.org/jira/browse/HDFS-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289887#comment-17289887 ] Hui Fei commented on HDFS-15822: [~tangtianhang] Thanks for your contribution and ping. Minor comments:

[jira] [Commented] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289885#comment-17289885 ] zhengchenyu commented on HDFS-15715: I think it's a critical bug if trigger. We encounter several

[jira] [Commented] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289881#comment-17289881 ] zhengchenyu commented on HDFS-15715: I reconstruct the code, the patch has two part: (1) Reconstruct

[jira] [Updated] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated HDFS-15715: --- Attachment: HDFS-15715.002.patch > ReplicatorMonitor performance degrades, when the storagePolicy of

[jira] [Updated] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated HDFS-15715: --- Attachment: HDFS-15715.002.patch.addendum > ReplicatorMonitor performance degrades, when the

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289872#comment-17289872 ] Stephen O'Donnell commented on HDFS-15422: -- Thanks for the review [~weichiu]. I committed this

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Attachment: HDFS-15422-branch-2.10.002.patch > Reported IBR is partially replaced with

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289853#comment-17289853 ] Qi Zhu commented on HDFS-15180: --- [~hexiaoqiao] [~sodonnell] [~Aiphag0] Is it going on, i think we can push

[jira] [Commented] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289830#comment-17289830 ] Stephen O'Donnell commented on HDFS-14013: -- [~weichiu] Thanks for taking a look. I have updated

[jira] [Updated] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Description: HADOOP-15157 added the ability to use a jceks credential provider to store

[jira] [Updated] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Description: HADOOP-15157 added the ability to use a jceks credential provider to store

[jira] [Updated] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Summary: Skip any credentials stored in HDFS when starting ZKFC (was: HDFS ZKFC on

[jira] [Commented] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289817#comment-17289817 ] Wei-Chiu Chuang commented on HDFS-14013: Other than that the fix LGTM > HDFS ZKFC on standby NN

[jira] [Commented] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289782#comment-17289782 ] Wei-Chiu Chuang commented on HDFS-14013: I read the description and wondered why use HDFS to