[jira] [Work started] (HDFS-15549) Improve DISK/ARCHIVE movement if they are on same filesystem

2020-11-12 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15549 started by Leon Gao. --- > Improve DISK/ARCHIVE movement if they are on same filesystem >

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-11-12 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15240: - Target Version/s: 3.3.1, 3.4.0 (was: 3.3.0) Hadoop 3.3.0 has been released. Updating the target

[jira] [Commented] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-11-12 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231129#comment-17231129 ] Jinglun commented on HDFS-15645: Hi [~jianghuazhu], thanks your comments. Yes, there will be dead nodes.

[jira] [Assigned] (HDFS-15682) TestStripedFileAppend#testAppendToNewBlock fails on trunk

2020-11-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-15682: --- Assignee: Takanobu Asanuma > TestStripedFileAppend#testAppendToNewBlock fails on

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231108#comment-17231108 ] Hadoop QA commented on HDFS-14090: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-11-12 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231103#comment-17231103 ] JiangHua Zhu commented on HDFS-15645: - [~LiJinglun] If all the host sets are returned, will there be

[jira] [Updated] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml

2020-11-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15538: Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-15649) the standby namenode's ReplQueues need to keep pace with active namenode.

2020-11-12 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231098#comment-17231098 ] JiangHua Zhu commented on HDFS-15649: - Can you share some more exception logs here? > the standby

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-11-12 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231092#comment-17231092 ] JiangHua Zhu commented on HDFS-15655: - I think you can add options to the command. > Add option to

[jira] [Commented] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml

2020-11-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231088#comment-17231088 ] Takanobu Asanuma commented on HDFS-15538: - The failure of TestStripedFileAppend doesn't seem to

[jira] [Created] (HDFS-15682) TestStripedFileAppend#testAppendToNewBlock fails on trunk

2020-11-12 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15682: --- Summary: TestStripedFileAppend#testAppendToNewBlock fails on trunk Key: HDFS-15682 URL: https://issues.apache.org/jira/browse/HDFS-15682 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231064#comment-17231064 ] Fengnan Li commented on HDFS-14090: --- [^HDFS-14090.025.patch] to fix tests and address comments.

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.025.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-12 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231056#comment-17231056 ] Akira Ajisaka commented on HDFS-15680: -- bq. I'll look at the Azure tests tomorrow; rolling back may

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-11-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15039: --- Fix Version/s: (was: 3.4.0) 3.3.0 > Cache meta file length of

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-11-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15039: --- Fix Version/s: 3.4.0 > Cache meta file length of FinalizedReplica to reduce call

[jira] [Updated] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

2020-11-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15545: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Work logged] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

2020-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15545?focusedWorklogId=511103=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-511103 ] ASF GitHub Bot logged work on HDFS-15545: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230829#comment-17230829 ] Íñigo Goiri commented on HDFS-14090: I'm guessing we are doing the documentation part in HDFS-14558,

[jira] [Comment Edited] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230612#comment-17230612 ] Yiqun Lin edited comment on HDFS-14090 at 11/12/20, 2:38 PM: - Hi

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230612#comment-17230612 ] Yiqun Lin commented on HDFS-14090: -- Hi [~fengnanli], two nits for the latest patch: {noformat} smaller

[jira] [Comment Edited] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230612#comment-17230612 ] Yiqun Lin edited comment on HDFS-14090 at 11/12/20, 1:07 PM: - Hi

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230515#comment-17230515 ] Steve Loughran commented on HDFS-15680: --- bq. There have been several emails sent, over the last

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-11-12 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230489#comment-17230489 ] Uma Maheswara Rao G commented on HDFS-15240: HI [~marvelrock] Thanks a lot for working on

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-12 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230459#comment-17230459 ] Akira Ajisaka commented on HDFS-15680: -- I've tried to fix the azure test for several hours but I

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230455#comment-17230455 ] Hadoop QA commented on HDFS-14090: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml

2020-11-12 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230425#comment-17230425 ] Hadoop QA commented on HDFS-15538: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||