[jira] [Work logged] (HDDS-2169) Avoid buffer copies while submitting client requests in Ratis

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2169?focusedWorklogId=320363&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320363 ] ASF GitHub Bot logged work on HDDS-2169: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940674#comment-16940674 ] Xiaoqiao He commented on HDFS-14775: Thanks [~zhangchen] for your works. This improve

[jira] [Comment Edited] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940674#comment-16940674 ] Xiaoqiao He edited comment on HDFS-14775 at 9/30/19 6:34 AM: -

[jira] [Commented] (HDDS-2204) Avoid buffer coping in checksum verification

2019-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940671#comment-16940671 ] Hadoop QA commented on HDDS-2204: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-14881) Safemode 'forceExit' option, doesn’t shown in help message

2019-09-29 Thread Renukaprasad C (Jira)
Renukaprasad C created HDFS-14881: - Summary: Safemode 'forceExit' option, doesn’t shown in help message Key: HDFS-14881 URL: https://issues.apache.org/jira/browse/HDFS-14881 Project: Hadoop HDFS

[jira] [Work logged] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?focusedWorklogId=320358&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320358 ] ASF GitHub Bot logged work on HDDS-2034: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?focusedWorklogId=320356&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320356 ] ASF GitHub Bot logged work on HDDS-2034: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940660#comment-16940660 ] Xiaoqiao He commented on HDFS-14810: [~jojochuang] gentle reminder again. any update

[jira] [Work logged] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?focusedWorklogId=320353&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320353 ] ASF GitHub Bot logged work on HDDS-2034: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?focusedWorklogId=320350&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320350 ] ASF GitHub Bot logged work on HDDS-2034: Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-09-29 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940656#comment-16940656 ] Surendra Singh Lilhore edited comment on HDFS-14794 at 9/30/19 5:32 AM: ---

[jira] [Commented] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-09-29 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940656#comment-16940656 ] Surendra Singh Lilhore commented on HDFS-14794: --- Root cause of this bad blo

[jira] [Updated] (HDDS-2204) Avoid buffer coping in checksum verification

2019-09-29 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2204: - Status: Patch Available (was: Open) > Avoid buffer coping in checksum verification >

[jira] [Assigned] (HDDS-2056) Datanode unable to start command handler thread with security enabled

2019-09-29 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2056: --- Assignee: Xiaoyu Yao > Datanode unable to start command handler thread with security

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940652#comment-16940652 ] Xiaoqiao He commented on HDFS-14305: Thanks [~shv],[~arp] very much for your feedback

[jira] [Updated] (HDDS-2204) Avoid buffer coping in checksum verification

2019-09-29 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2204: - Attachment: o2204_20190930.patch > Avoid buffer coping in checksum verification >

[jira] [Commented] (HDFS-14554) Avoid to process duplicate blockreport of datanode when namenode in startup safemode

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940646#comment-16940646 ] Xiaoqiao He commented on HDFS-14554: Thanks [~lindongdong] for your comments. This ti

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940643#comment-16940643 ] Xiaoqiao He commented on HDFS-14090: Thanks [~crh] for your works and sorry for late

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2019-09-29 Thread CR Hota (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940620#comment-16940620 ] CR Hota commented on HDFS-14090: [~elgoiri] [~xkrogen] Thanks for your patience. Lets try

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940618#comment-16940618 ] Hadoop QA commented on HDFS-14814: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Created] (HDDS-2204) Avoid buffer coping in checksum verification

2019-09-29 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDDS-2204: Summary: Avoid buffer coping in checksum verification Key: HDDS-2204 URL: https://issues.apache.org/jira/browse/HDDS-2204 Project: Hadoop Distributed Data Store Issu

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940608#comment-16940608 ] Hadoop QA commented on HDFS-14814: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14554) Avoid to process duplicate blockreport of datanode when namenode in startup safemode

2019-09-29 Thread lindongdong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940607#comment-16940607 ] lindongdong commented on HDFS-14554: Hi, [~hexiaoqiao], Thanks for your work. I test

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.010.patch > RBF: RouterQuotaUpdateService supports inherited rule. > -

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: (was: HDFS-14814.010.patch) > RBF: RouterQuotaUpdateService supports inherited rule. > --

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940593#comment-16940593 ] Jinglun commented on HDFS-14814:   {quote}If you want to return a List of Entry, just cre

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.010.patch > RBF: RouterQuotaUpdateService supports inherited rule. > -

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940561#comment-16940561 ] Hadoop QA commented on HDFS-14305: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940533#comment-16940533 ] Hadoop QA commented on HDFS-13736: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-29 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940530#comment-16940530 ] Hudson commented on HDFS-14305: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-29 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14305: --- Status: Patch Available (was: Reopened) I just reverted this from trunk. Will let Je

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940521#comment-16940521 ] Konstantin Shvachko commented on HDFS-14509: Hey [~John Smith]. Agreed we sh

[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320279&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320279 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-2203) Race condition in ByteStringHelper.init()

2019-09-29 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940499#comment-16940499 ] Istvan Fajth commented on HDDS-2203: I have some concerns about the design of this cla

[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320245&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320245 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot

[jira] [Assigned] (HDDS-1615) ManagedChannel references are being leaked in ReplicationSupervisor.java

2019-09-29 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-1615: --- Assignee: Mukul Kumar Singh (was: Hrishikesh Gadre) > ManagedChannel references are

[jira] [Work logged] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1569?focusedWorklogId=320242&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320242 ] ASF GitHub Bot logged work on HDDS-1569: Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940342#comment-16940342 ] Fei Hui edited comment on HDFS-14847 at 9/29/19 10:56 AM: -- The p

[jira] [Comment Edited] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940342#comment-16940342 ] Fei Hui edited comment on HDFS-14847 at 9/29/19 10:56 AM: -- The p

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940342#comment-16940342 ] Fei Hui commented on HDFS-14847: * The problem of *findLeavingServiceSources* is that the

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940329#comment-16940329 ] Fei Hui commented on HDFS-14509: [~John Smith] Part of approach 1 will be good. We only

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940327#comment-16940327 ] Yuxuan Wang commented on HDFS-14509: [~ferhui] Oh, It's other approach can do, not my

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940326#comment-16940326 ] Yuxuan Wang commented on HDFS-14509: {quote} As for unit tests I think we need two t

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940325#comment-16940325 ] Fei Hui commented on HDFS-14509: [~John Smith] {quote} NN 3.x does not include storage ty

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-09-29 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940294#comment-16940294 ] hu xiaodong commented on HDFS-13736: Hello, [~ayushtkn]    sorry for no responding f

[jira] [Updated] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-09-29 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-13736: --- Attachment: HDFS-13736.002.patch > BlockPlacementPolicyDefault can not choose favored nodes when > '

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940277#comment-16940277 ] Yuxuan Wang commented on HDFS-14509: [~John Smith] If we add some fields in the futur

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940272#comment-16940272 ] Fei Hui commented on HDFS-14509: [~John Smith] If it's a general solution, I think target

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940266#comment-16940266 ] Yuxuan Wang commented on HDFS-14509: [~ferhui] If it's just for resolving upgrading f

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940264#comment-16940264 ] Fei Hui commented on HDFS-14509: Have one question Is target version is 2.x or both 2.x a