[jira] [Updated] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9053: - Attachment: HDFS-9053.005.patch > Support large directories efficiently using B-Tree >

[jira] [Comment Edited] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949847#comment-14949847 ] Yi Liu edited comment on HDFS-9053 at 10/9/15 8:49 AM: --- Hi [~szetszwo], thanks for

[jira] [Commented] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950132#comment-14950132 ] J.Andreina commented on HDFS-9070: -- Hi [~demongaorui] ,thanks for the patch. It looks good overall . I

[jira] [Commented] (HDFS-9219) Even if permission is enabled in an environment, while resolving reserved paths there is no check on permission.

[ https://issues.apache.org/jira/browse/HDFS-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950148#comment-14950148 ] J.Andreina commented on HDFS-9219: -- Thanks [~liuml07] for checking this issue. I forgot to mention the

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration

[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8676: Attachment: HDFS-8676.02.patch Sorry for late update. Your concern is valid. Upload 02 patch to address

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950082#comment-14950082 ] Yi Liu commented on HDFS-9053: -- Update the patch. The new patch uses an array list if the children size is

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950084#comment-14950084 ] Yi Liu commented on HDFS-9053: -- The increased memory usage is only 8 bytes in {{SortedCollection}} comparing

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951376#comment-14951376 ] Hadoop QA commented on HDFS-9188: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951431#comment-14951431 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #517 (See

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951467#comment-14951467 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #506 (See

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.002.patch To address some offline comments, the v2 patch makes the caller

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951529#comment-14951529 ] Hudson commented on HDFS-9110: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2416 (See

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951530#comment-14951530 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2416 (See

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951528#comment-14951528 ] Hudson commented on HDFS-8941: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2416 (See

[jira] [Commented] (HDFS-9142) Separating Configuration object for namenode(s) in MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951527#comment-14951527 ] Hudson commented on HDFS-9142: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2416 (See

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951374#comment-14951374 ] Walter Su commented on HDFS-9173: - Jing, that's a good case. In my plan for this case, I'll include 64k +

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951430#comment-14951430 ] Zhe Zhang commented on HDFS-9173: - {code} for (int stripeIdx = 0; stripeIdx < totalStripes;

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951451#comment-14951451 ] Andrew Wang commented on HDFS-7087: --- Hi Xiao, thanks for working on this! Some review comments: * Would

[jira] [Updated] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8988: - Attachment: HDFS-8988.002.patch Rebase the patch. > Use LightWeightHashSet instead of LightWeightLinkedSet in >

[jira] [Updated] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8988: - Priority: Major (was: Minor) > Use LightWeightHashSet instead of LightWeightLinkedSet in >

[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951460#comment-14951460 ] Hadoop QA commented on HDFS-9222: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951390#comment-14951390 ] Lei (Eddy) Xu commented on HDFS-9188: - Some of the test failures are relevant. Working on them. > Make

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951440#comment-14951440 ] Walter Su commented on HDFS-9173: - bq. Actually the patch is already considering data and parity blocks

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951441#comment-14951441 ] Walter Su commented on HDFS-9173: - -algorithm- Calculation. > Erasure Coding: Lease recovery for striped

[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951471#comment-14951471 ] Mingliang Liu commented on HDFS-9222: - We don't need new test as this patch is for dependency

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951474#comment-14951474 ] Uma Maheswara Rao G commented on HDFS-8988: --- Thanks Yi. Yes, I think we don't need ordered in

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951511#comment-14951511 ] Hadoop QA commented on HDFS-3059: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951537#comment-14951537 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #478 (See

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Status: Patch Available (was: Open) > Reconfigure DN concurrent move on the fly >

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Attachment: HDFS-9214.001.patch I posted the 001 patch with a hope someone can review it. Thanks. >

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951380#comment-14951380 ] Hadoop QA commented on HDFS-1172: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.014.patch bq. Only nit is we can change the following if condition to if

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Status: Patch Available (was: Open) > Logging HDFS operation's caller context into audit logs >

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951493#comment-14951493 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2451 (See

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951500#comment-14951500 ] Hadoop QA commented on HDFS-7087: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951498#comment-14951498 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1244 (See

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951508#comment-14951508 ] Hadoop QA commented on HDFS-9221: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9201) Namenode Performance Improvement : Using for loop without iterator

[ https://issues.apache.org/jira/browse/HDFS-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951162#comment-14951162 ] Andrew Wang commented on HDFS-9201: --- So in the mentioned HBASE jira, it looks like they added asserts to

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951188#comment-14951188 ] Hudson commented on HDFS-8941: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #516 (See

[jira] [Updated] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9085: Release Note: The output of the "hdfs fetchdt --print" command now includes the token renewer

[jira] [Updated] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-4015: --- Attachment: HDFS-4015.004.patch > Safemode should count and report orphaned blocks >

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951312#comment-14951312 ] Haohui Mai commented on HDFS-9170: -- {noformat} [exec] CMake Error at CMakeLists.txt:19

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949967#comment-14949967 ] Hadoop QA commented on HDFS-9215: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949968#comment-14949968 ] Xiao Chen commented on HDFS-7087: - Now that HDFS-8164 is resolved (thanks [~yzhangal]!), I'm posting patch

[jira] [Updated] (HDFS-9173) Erasure Coding: Lease recovery for striped file

[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9173: Attachment: HDFS-9173.01.patch > Erasure Coding: Lease recovery for striped file >

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1495#comment-1495 ] Hadoop QA commented on HDFS-9205: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8704: Status: In Progress (was: Patch Available) > Erasure Coding: client fails to write large file when one datanode

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949950#comment-14949950 ] Hadoop QA commented on HDFS-3059: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949956#comment-14949956 ] Hadoop QA commented on HDFS-9085: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated HDFS-9085: Attachment: (was: HDFS-9085.002.patch) > Show renewer information in DelegationTokenIdentifier#toString

[jira] [Updated] (HDFS-7087) Ability to list /.reserved

[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7087: Attachment: HDFS-7087.001.patch > Ability to list /.reserved > -- > >

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.013.patch Thanks, [~jingzhao]! Your comment makes sense. I attached 013.

[jira] [Updated] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated HDFS-9085: Attachment: HDFS-9085.002.patch > Show renewer information in DelegationTokenIdentifier#toString >

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950026#comment-14950026 ] Hadoop QA commented on HDFS-9205: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9006) Provide BlockPlacementPolicy that supports upgrade domain

[ https://issues.apache.org/jira/browse/HDFS-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950032#comment-14950032 ] Hadoop QA commented on HDFS-9006: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949985#comment-14949985 ] Walter Su commented on HDFS-9173: - {noformat} blk_0 blk_1 blk_2 blk_3 blk_4 blk_5 blk_6 blk_7 blk_8

[jira] [Updated] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9221: -- Status: Patch Available (was: Open) > HdfsServerConstants#ReplicaState#getState should avoid

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951259#comment-14951259 ] Hudson commented on HDFS-9110: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #505 (See

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951258#comment-14951258 ] Hudson commented on HDFS-8941: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #505 (See

[jira] [Commented] (HDFS-9181) Better handling of exceptions thrown during upgrade shutdown

[ https://issues.apache.org/jira/browse/HDFS-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951260#comment-14951260 ] Hudson commented on HDFS-9181: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #505 (See

[jira] [Commented] (HDFS-9142) Separating Configuration object for namenode(s) in MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951257#comment-14951257 ] Hudson commented on HDFS-9142: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #505 (See

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951322#comment-14951322 ] Zhe Zhang commented on HDFS-9205: - Thanks Nicholas. bq. Those blocks have zero replicas so that it is

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951342#comment-14951342 ] Hudson commented on HDFS-9110: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2450 (See

[jira] [Commented] (HDFS-9142) Separating Configuration object for namenode(s) in MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951340#comment-14951340 ] Hudson commented on HDFS-9142: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2450 (See

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951341#comment-14951341 ] Hudson commented on HDFS-8941: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2450 (See

[jira] [Commented] (HDFS-9006) Provide BlockPlacementPolicy that supports upgrade domain

[ https://issues.apache.org/jira/browse/HDFS-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951160#comment-14951160 ] Hadoop QA commented on HDFS-9006: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9181) Better handling of exceptions thrown during upgrade shutdown

[ https://issues.apache.org/jira/browse/HDFS-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951222#comment-14951222 ] Hudson commented on HDFS-9181: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2415 (See

[jira] [Updated] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9085: Resolution: Fixed Fix Version/s: 3.0.0 Release Note: The output of the {{hdfs fetchdt

[jira] [Updated] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-4015: --- Attachment: (was: HDFS-4015.004.patch) > Safemode should count and report orphaned blocks >

[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-9170: - Attachment: native-package-build-fails-with-cmake-2.5.log bq. Eric Payne, do you mind posting the error

[jira] [Updated] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9223: Status: Patch Available (was: Open) > Code cleanup for DatanodeDescriptor and HeartbeatManager >

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951276#comment-14951276 ] Xiaobing Zhou commented on HDFS-8855: - Benchmarked the two approaches based on real token at 1 million

[jira] [Updated] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9223: Attachment: HDFS-9223.000.patch The patch also makes the following changes in {{heartbeatCheck}}. {code} -

[jira] [Commented] (HDFS-9220) ChecksumException after writing less than 512 bytes

[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951303#comment-14951303 ] Daniel Templeton commented on HDFS-9220: I saw a similar issue, and it went away when I backed out

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951352#comment-14951352 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-trunk-Commit #8603 (See

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951360#comment-14951360 ] Walter Su commented on HDFS-9173: - Great work Walter! It's probably simpler to treat data and parity blocks

[jira] [Updated] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9215: - Attachment: HDFS-9215.003.patch > Suppress the RAT warnings in hdfs-native-client module >

[jira] [Commented] (HDFS-9201) Namenode Performance Improvement : Using for loop without iterator

[ https://issues.apache.org/jira/browse/HDFS-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951190#comment-14951190 ] Haohui Mai commented on HDFS-9201: -- My understanding is that they are simply syntactic sugars. Can you

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951239#comment-14951239 ] zhihai xu commented on HDFS-9085: - Thanks [~cnauroth] for reviewing and committing the patch! > Show

[jira] [Created] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

Jing Zhao created HDFS-9223: --- Summary: Code cleanup for DatanodeDescriptor and HeartbeatManager Key: HDFS-9223 URL: https://issues.apache.org/jira/browse/HDFS-9223 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-4015: --- Attachment: HDFS-4015.004.patch update documentation > Safemode should count and report orphaned

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951261#comment-14951261 ] Andrew Wang commented on HDFS-9215: --- +1 again, thx! > Suppress the RAT warnings in hdfs-native-client

[jira] [Commented] (HDFS-9220) ChecksumException after writing less than 512 bytes

[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951287#comment-14951287 ] Kihwal Lee commented on HDFS-9220: -- It looks like it fails only when append is involved. If it is closed

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951345#comment-14951345 ] Hudson commented on HDFS-9110: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1243 (See

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951344#comment-14951344 ] Hudson commented on HDFS-8941: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1243 (See

[jira] [Updated] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9221: -- Attachment: (was: ReplicaState.patch) > HdfsServerConstants#ReplicaState#getState should

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951170#comment-14951170 ] Haohui Mai commented on HDFS-9170: -- [~eepayne], do you mind posting the error log? I'm not aware of that

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951189#comment-14951189 ] Hudson commented on HDFS-9110: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #516 (See

[jira] [Commented] (HDFS-9142) Separating Configuration object for namenode(s) in MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951187#comment-14951187 ] Hudson commented on HDFS-9142: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #516 (See

[jira] [Updated] (HDFS-8755) Fix typos in hadoop-hdfs-project module

[ https://issues.apache.org/jira/browse/HDFS-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8755: - Assignee: Neelesh Srinivas Salian (was: Ray Chiang) > Fix typos in hadoop-hdfs-project module >

[jira] [Updated] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9145: Attachment: HDFS-9145.002.patch Thank you [~jingzhao] for your review. The idea to track longest

[jira] [Commented] (HDFS-8664) Allow wildcards in dfs.datanode.data.dir

[ https://issues.apache.org/jira/browse/HDFS-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951350#comment-14951350 ] Hadoop QA commented on HDFS-8664: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9221: -- Attachment: HADOOP-9221.001.patch > HdfsServerConstants#ReplicaState#getState should avoid

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951127#comment-14951127 ] Staffan Friberg commented on HDFS-9221: --- Uploaded new version of the patch as the old one was

[jira] [Created] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

Haohui Mai created HDFS-9222: Summary: Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client Key: HDFS-9222 URL: https://issues.apache.org/jira/browse/HDFS-9222 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951219#comment-14951219 ] Jitendra Nath Pandey commented on HDFS-9184: [~liuml07], I would suggest to make the length of

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951237#comment-14951237 ] Daryn Sharp commented on HDFS-9221: --- +1 > HdfsServerConstants#ReplicaState#getState should avoid calling

[jira] [Updated] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9222: Attachment: HDFS-9222.000.patch Thanks [~wheat9] for reporting this. The v0 patch adds the

[jira] [Updated] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9222: Status: Patch Available (was: Open) > Add hadoop-hdfs-client as a dependency of

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951591#comment-14951591 ] Hadoop QA commented on HDFS-4015: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

  1   2   >