[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218746#comment-17218746 ] Hadoop QA commented on HDFS-15630: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Work logged] (HDFS-15616) Disable Observer NameNode to trigger edit log roll

2020-10-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15616?focusedWorklogId=503525&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503525 ] ASF GitHub Bot logged work on HDFS-15616: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-21 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218709#comment-17218709 ] Chengwei Wang commented on HDFS-15630: -- [~ferhui] [~elgoiri], thanks for comments. {

[jira] [Updated] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-21 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HDFS-15630: - Attachment: HDFS-15630.006.patch > RBF: Fix wrong client IP info in CallerContext when requests m

[jira] [Updated] (HDFS-15616) Disable Observer NameNode to trigger edit log roll

2020-10-21 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janus Chow updated HDFS-15616: -- Attachment: HDFS-15616.003.patch > Disable Observer NameNode to trigger edit log roll > ---

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503471&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503471 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15616) Disable Observer NameNode to trigger edit log roll

2020-10-21 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janus Chow updated HDFS-15616: -- Summary: Disable Observer NameNode to trigger edit log roll (was: [SBN] Disable Observers to trigger e

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-10-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=503431&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503431 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15623) Respect configured values of rpc.engine

2020-10-21 Thread Hector Sandoval Chaverri (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218606#comment-17218606 ] Hector Sandoval Chaverri commented on HDFS-15623: - Thanks [~shv], I can

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

2020-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218581#comment-17218581 ] Hadoop QA commented on HDFS-15644: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2020-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218578#comment-17218578 ] Hadoop QA commented on HDFS-15618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15623) Respect configured values of rpc.engine

2020-10-21 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218558#comment-17218558 ] Konstantin Shvachko commented on HDFS-15623: IIUC {{NameNodeRpcServer}} break

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-21 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218512#comment-17218512 ] Íñigo Goiri commented on HDFS-15630: Agreed, this looks clear. Can we make the javado

[jira] [Commented] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218484#comment-17218484 ] Hadoop QA commented on HDFS-15622: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Work logged] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

2020-10-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15616?focusedWorklogId=503346&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503346 ] ASF GitHub Bot logged work on HDFS-15616: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-10-21 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218440#comment-17218440 ] Xiaoyu Yao edited comment on HDFS-15553 at 10/21/20, 5:32 PM: -

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-10-21 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218440#comment-17218440 ] Xiaoyu Yao commented on HDFS-15553: --- bq. Do you see the queue overflow message in the N

[jira] [Updated] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

2020-10-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15644: - Attachment: HDFS-15644.002.patch > Failed volumes can cause DNs to stop block reporting > ---

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2020-10-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Attachment: HDFS-15618-branch-3.3.004.patch > Improve datanode shutdown latency > ---

[jira] [Commented] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218379#comment-17218379 ] Hadoop QA commented on HDFS-15645: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2020-10-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218375#comment-17218375 ] Ahmed Hussein commented on HDFS-15618: -- [~kihwal], HDFS-15618.004.patch can be appli

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2020-10-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218362#comment-17218362 ] Ahmed Hussein commented on HDFS-15618: -- Oh! that's because HADOOP-17288. Moving forw

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503248&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503248 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15622: - Attachment: HDFS-15622.002.patch > Deleted blocks linger in the replications queue >

[jira] [Commented] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

2020-10-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218329#comment-17218329 ] Ahmed Hussein commented on HDFS-15459: -- {quote}  For the fix itself, the other optio

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218324#comment-17218324 ] Hui Fei commented on HDFS-15630: [^HDFS-15630.005.patch] looks good. It is much clear an

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

2020-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218293#comment-17218293 ] Hadoop QA commented on HDFS-15640: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218287#comment-17218287 ] Hadoop QA commented on HDFS-15630: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-10-21 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218274#comment-17218274 ] Jinglun commented on HDFS-15645: Hi [~knanasi] [~hexiaoqiao] [~leosun08] , do you have ti

[jira] [Assigned] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-10-21 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15645: -- Assignee: Jinglun > DatanodeManager.getNumOfDataNodes should consider the include set of host > confi

[jira] [Updated] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-10-21 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15645: --- Attachment: HDFS-15645.001.patch Status: Patch Available (was: Open) > DatanodeManager.getNumOfDataN

[jira] [Created] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-10-21 Thread Jinglun (Jira)
Jinglun created HDFS-15645: -- Summary: DatanodeManager.getNumOfDataNodes should consider the include set of host config. Key: HDFS-15645 URL: https://issues.apache.org/jira/browse/HDFS-15645 Project: Hadoop H

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

2020-10-21 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218259#comment-17218259 ] Jinglun commented on HDFS-15640: Hi [~linyiqun], thanks your nice comments and clear expl

[jira] [Updated] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

2020-10-21 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15640: --- Attachment: HDFS-15640.002.patch > RBF: Add fast distcp threshold to FedBalance. > --

[jira] [Updated] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

2020-10-21 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15640: --- Attachment: (was: HDFS-15640.002.patch) > RBF: Add fast distcp threshold to FedBalance. > ---

[jira] [Updated] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

2020-10-21 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15640: --- Attachment: HDFS-15640.002.patch > RBF: Add fast distcp threshold to FedBalance. > --

[jira] [Comment Edited] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-21 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218255#comment-17218255 ] Chengwei Wang edited comment on HDFS-15630 at 10/21/20, 12:00 PM: -

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-21 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218255#comment-17218255 ] Chengwei Wang commented on HDFS-15630: -- [~elgoiri] [~ferhui], Thanks for comments.

[jira] [Updated] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-21 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HDFS-15630: - Attachment: HDFS-15630.005.patch > RBF: Fix wrong client IP info in CallerContext when requests m

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

2020-10-21 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218221#comment-17218221 ] Yiqun Lin commented on HDFS-15640: -- {quote} Only a little problem is it might not be eas

[jira] [Commented] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

2020-10-21 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218211#comment-17218211 ] Janus Chow commented on HDFS-15616: --- Updated a new patch with unit tests. > [SBN] Disa

[jira] [Updated] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

2020-10-21 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janus Chow updated HDFS-15616: -- Attachment: HDFS-15616.002.patch > [SBN] Disable Observers to trigger edit log roll > -