[jira] [Work logged] (HDFS-16689) Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16689?focusedWorklogId=795522=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795522 ] ASF GitHub Bot logged work on HDFS-16689: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16659) JournalNode should throw CacheMissException if SinceTxId is bigger than HighestWrittenTxId

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16659?focusedWorklogId=795520=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795520 ] ASF GitHub Bot logged work on HDFS-16659: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16659) JournalNode should throw CacheMissException if SinceTxId is bigger than HighestWrittenTxId

2022-07-26 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-16659: Description: ### Description of PR JournalNode should throw `CacheMissException` if `sinceTxId` is bigger

[jira] [Updated] (HDFS-16659) JournalNode should throw CacheMissException if SinceTxId is bigger than HighestWrittenTxId

2022-07-26 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-16659: Description: JournalNode should throw `CacheMissException` if `sinceTxId` is bigger than

[jira] [Work logged] (HDFS-16601) Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16601?focusedWorklogId=795517=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795517 ] ASF GitHub Bot logged work on HDFS-16601: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15067) Optimize heartbeat for large cluster

2022-07-26 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571727#comment-17571727 ] Surendra Singh Lilhore commented on HDFS-15067: --- Thanks [~prasad-acit] . We can merge this,

[jira] [Updated] (HDFS-16601) Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try

2022-07-26 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-16601: Description: In our production environment, we found a bug and stack like: {code:java}

[jira] [Commented] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-26 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571722#comment-17571722 ] ZanderXu commented on HDFS-13522: - [~simbadzina][~zhengchenyu] bq. We can do a combination of both

[jira] [Commented] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-26 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571703#comment-17571703 ] zhengchenyu commented on HDFS-13522: [~simbadzina] I also agree the *combination of both Design A and

[jira] [Comment Edited] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-26 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571703#comment-17571703 ] zhengchenyu edited comment on HDFS-13522 at 7/27/22 2:45 AM: - [~simbadzina] I

[jira] [Work logged] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?focusedWorklogId=795504=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795504 ] ASF GitHub Bot logged work on HDFS-16645: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571701#comment-17571701 ] ZanderXu edited comment on HDFS-16645 at 7/27/22 2:36 AM: -- [~weichiu][~smeng]

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571701#comment-17571701 ] ZanderXu commented on HDFS-16645: - [~weichiu][~smeng] Thanks for your comments. > Would you give some

[jira] [Work logged] (HDFS-16601) Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16601?focusedWorklogId=795437=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795437 ] ASF GitHub Bot logged work on HDFS-16601: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16692?focusedWorklogId=795414=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795414 ] ASF GitHub Bot logged work on HDFS-16692: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571592#comment-17571592 ] Wei-Chiu Chuang commented on HDFS-16645: I think instead of ignoring the older inprogress edit

[jira] [Work logged] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?focusedWorklogId=795406=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795406 ] ASF GitHub Bot logged work on HDFS-16645: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571587#comment-17571587 ] Wei-Chiu Chuang edited comment on HDFS-16645 at 7/26/22 7:38 PM: -

[jira] [Comment Edited] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571587#comment-17571587 ] Wei-Chiu Chuang edited comment on HDFS-16645 at 7/26/22 7:38 PM: -

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571587#comment-17571587 ] Wei-Chiu Chuang commented on HDFS-16645: For the context: we started to notice that JN directory

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571585#comment-17571585 ] Siyao Meng commented on HDFS-16645: --- Thanks [~xuzq_zander] for reporting this issue and posting the

[jira] [Comment Edited] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-26 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571564#comment-17571564 ] Simbarashe Dzinamarira edited comment on HDFS-13522 at 7/26/22 6:01 PM:

[jira] [Commented] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-26 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571564#comment-17571564 ] Simbarashe Dzinamarira commented on HDFS-13522: --- Thanks [~xuzq_zander] for listing the

[jira] [Work logged] (HDFS-16693) RBF: Fix NPE in Quota

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16693?focusedWorklogId=795368=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795368 ] ASF GitHub Bot logged work on HDFS-16693: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16676) DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16676?focusedWorklogId=795364=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795364 ] ASF GitHub Bot logged work on HDFS-16676: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16661) Improve Code With Lambda in AsyncLoggerSet class

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16661?focusedWorklogId=795328=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795328 ] ASF GitHub Bot logged work on HDFS-16661: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16661) Improve Code With Lambda in AsyncLoggerSet class

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16661?focusedWorklogId=795316=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795316 ] ASF GitHub Bot logged work on HDFS-16661: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16693) RBF: Fix NPE in Quota

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16693?focusedWorklogId=795317=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795317 ] ASF GitHub Bot logged work on HDFS-16693: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16619) Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16619?focusedWorklogId=795314=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795314 ] ASF GitHub Bot logged work on HDFS-16619: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-26 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571458#comment-17571458 ] ZanderXu commented on HDFS-13522: - [~zhengchenyu][~simbadzina] Thanks for your good job. Maybe first we

[jira] [Work logged] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16692?focusedWorklogId=795281=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795281 ] ASF GitHub Bot logged work on HDFS-16692: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16693) RBF: Fix NPE in Quota

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16693?focusedWorklogId=795274=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795274 ] ASF GitHub Bot logged work on HDFS-16693: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16693) RBF: Fix NPE in Quota

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16693?focusedWorklogId=795271=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795271 ] ASF GitHub Bot logged work on HDFS-16693: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16693) RBF: Fix NPE in Quota

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16693: -- Labels: pull-request-available (was: ) > RBF: Fix NPE in Quota > - > >

[jira] [Work logged] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16692?focusedWorklogId=795266=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795266 ] ASF GitHub Bot logged work on HDFS-16692: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-16693) RBF: Fix NPE in Quota

2022-07-26 Thread Weison Wei (Jira)
Weison Wei created HDFS-16693: - Summary: RBF: Fix NPE in Quota Key: HDFS-16693 URL: https://issues.apache.org/jira/browse/HDFS-16693 Project: Hadoop HDFS Issue Type: Bug Reporter:

[jira] [Work logged] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16692?focusedWorklogId=795255=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795255 ] ASF GitHub Bot logged work on HDFS-16692: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16692?focusedWorklogId=795252=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795252 ] ASF GitHub Bot logged work on HDFS-16692: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16692?focusedWorklogId=795243=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795243 ] ASF GitHub Bot logged work on HDFS-16692: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-16692: Description: When we write some ec data from clients that are not in hdfs cluster, there is a lot of INFO

[jira] [Updated] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16692: -- Labels: pull-request-available (was: ) > Add detailed scope info in NotEnoughReplicas Reason

[jira] [Work logged] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16692?focusedWorklogId=795227=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795227 ] ASF GitHub Bot logged work on HDFS-16692: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-16692) Add detailed scope info in NotEnoughReplicas Reason logs.

2022-07-26 Thread ZanderXu (Jira)
ZanderXu created HDFS-16692: --- Summary: Add detailed scope info in NotEnoughReplicas Reason logs. Key: HDFS-16692 URL: https://issues.apache.org/jira/browse/HDFS-16692 Project: Hadoop HDFS Issue

[jira] [Work logged] (HDFS-16661) Improve Code With Lambda in AsyncLoggerSet class

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16661?focusedWorklogId=795205=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795205 ] ASF GitHub Bot logged work on HDFS-16661: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16660) Improve Code With Lambda in IPCLoggerChannel class

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16660?focusedWorklogId=795204=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795204 ] ASF GitHub Bot logged work on HDFS-16660: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16689) Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16689?focusedWorklogId=795201=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795201 ] ASF GitHub Bot logged work on HDFS-16689: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16658) BlockManager should output some logs when logEveryBlock is true.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16658?focusedWorklogId=795172=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795172 ] ASF GitHub Bot logged work on HDFS-16658: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15006) Add OP_SWAP_BLOCK_LIST as an operation code in FSEditLogOpCodes.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15006?focusedWorklogId=795157=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795157 ] ASF GitHub Bot logged work on HDFS-15006: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15006) Add OP_SWAP_BLOCK_LIST as an operation code in FSEditLogOpCodes.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15006?focusedWorklogId=795156=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795156 ] ASF GitHub Bot logged work on HDFS-15006: - Author: ASF GitHub Bot

[jira] [Resolved] (HDFS-16677) Add OP_SWAP_BLOCK_LIST as an operation code in FSEditLogOpCodes.

2022-07-26 Thread Max Xie (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Xie resolved HDFS-16677. - Resolution: Duplicate > Add OP_SWAP_BLOCK_LIST as an operation code in FSEditLogOpCodes. >

[jira] [Work logged] (HDFS-16677) Add OP_SWAP_BLOCK_LIST as an operation code in FSEditLogOpCodes.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16677?focusedWorklogId=795152=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795152 ] ASF GitHub Bot logged work on HDFS-16677: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16658) BlockManager should output some logs when logEveryBlock is true.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16658?focusedWorklogId=795145=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795145 ] ASF GitHub Bot logged work on HDFS-16658: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16619) Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import.

2022-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16619?focusedWorklogId=795136=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795136 ] ASF GitHub Bot logged work on HDFS-16619: - Author: ASF GitHub Bot