[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041216#comment-15041216 ] Xiao Chen commented on HDFS-9313: - Thanks again Zhe for the commit! > Possible NullPointer

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041203#comment-15041203 ] Zhe Zhang commented on HDFS-9313: - Thanks Xiao! +1 on the patches. I just committed to bran

[jira] [Updated] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9313: Fix Version/s: 2.6.4 2.7.3 > Possible NullPointerException in BlockManager if no excess re

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041155#comment-15041155 ] Hudson commented on HDFS-9436: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #663 (See [htt

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041157#comment-15041157 ] Hudson commented on HDFS-9484: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #663 (See [htt

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8901: Status: Patch Available (was: Open) > Use ByteBuffer in striping positional read > -

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8901: Attachment: HDFS-8901-v3.patch Updated the patch avoiding using codes from HDFS-8905 to make this one indepe

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8905: Attachment: HDFS-8905-v7.patch > Refactor DFSInputStream#ReaderStrategy > ---

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039702#comment-15039702 ] Hadoop QA commented on HDFS-8905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039699#comment-15039699 ] Hadoop QA commented on HDFS-8831: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039666#comment-15039666 ] Hadoop QA commented on HDFS-9498: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8905: Attachment: HDFS-8905-v6.patch Updated the patch addressing review comments. > Refactor DFSInputStream#Reade

[jira] [Assigned] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan reassigned HDFS-8986: --- Assignee: Gautam Gopalakrishnan (was: Jagadesh Kiran N) > Add option to -du t

[jira] [Created] (HDFS-9506) Move invalidate blocks to ReplicationManager

Mingliang Liu created HDFS-9506: --- Summary: Move invalidate blocks to ReplicationManager Key: HDFS-9506 URL: https://issues.apache.org/jira/browse/HDFS-9506 Project: Hadoop HDFS Issue Type: Sub-

[jira] [Updated] (HDFS-9506) Move invalidate blocks to ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9506: Description: The [HDFS-9442] moves basic replication mechanism from {{BlockManager}} to newly added

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039622#comment-15039622 ] Akira AJISAKA commented on HDFS-9505: - bq. "There is a plan to support appending-writes

[jira] [Commented] (HDFS-9472) concat() API does not resolve the .reserved path

[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039604#comment-15039604 ] Uma Maheswara Rao G commented on HDFS-9472: --- ok. then Just making log more meanin

[jira] [Commented] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039561#comment-15039561 ] Hadoop QA commented on HDFS-9228: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9417) Clean up the RAT warnings in the HDFS-8707 branch.

[ https://issues.apache.org/jira/browse/HDFS-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039552#comment-15039552 ] Hadoop QA commented on HDFS-9417: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039546#comment-15039546 ] Mingliang Liu commented on HDFS-9442: - Failing tests can not re-produce locally. Speci

[jira] [Updated] (HDFS-9417) Clean up the RAT warnings in the HDFS-8707 branch.

[ https://issues.apache.org/jira/browse/HDFS-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9417: - Attachment: HDFS-9417.HDFS-8707.003.patch New patch: cleans up ASF warnings on change that was landed. > C

[jira] [Updated] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9228: - Attachment: HDFS-9228.HDFS-8707.010.patch New patch: corrected errors revealed by integration tests. > l

[jira] [Updated] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9498: Attachment: HDFS-9498.001.patch The v1 patch is to address {{hadoop.hdfs.server.namenode.TestNameNod

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039485#comment-15039485 ] Hadoop QA commented on HDFS-9442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039180#comment-15039180 ] Arpit Agarwal commented on HDFS-8831: - +1 for the v05 patch, pending Jenkins. Thanks [~

[jira] [Updated] (HDFS-9272) Implement a unix-like cat utility

[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9272: - Attachment: HDFS-9272.HDFS-8707.001.patch > Implement a unix-like cat utility > ---

[jira] [Commented] (HDFS-9504) libhdfs++ Initialize BadNodeTracker in FileSystemImpl constructor

[ https://issues.apache.org/jira/browse/HDFS-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039174#comment-15039174 ] Bob Hansen commented on HDFS-9504: -- Definitely an improvement. +1. > libhdfs++ Initializ

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038821#comment-15038821 ] Arpit Agarwal commented on HDFS-9214: - The only related test failure is TestDFSAdmin#te

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038827#comment-15038827 ] Hudson commented on HDFS-9436: -- FAILURE: Integrated in Hadoop-trunk-Commit #8916 (See [https:

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038826#comment-15038826 ] Mingliang Liu commented on HDFS-9436: - Thanks for suggesting this jira, reviewing and c

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038828#comment-15038828 ] Hudson commented on HDFS-9484: -- FAILURE: Integrated in Hadoop-trunk-Commit #8916 (See [https:

[jira] [Updated] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9484: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Statu

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9436: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Statu

[jira] [Commented] (HDFS-9417) Clean up the RAT warnings in the HDFS-8707 branch.

[ https://issues.apache.org/jira/browse/HDFS-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038783#comment-15038783 ] Hadoop QA commented on HDFS-9417: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Attachment: HDFS-8831.05.patch Thanks [~arpitagarwal] for the review. Patch v05 addresses the latest review

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038772#comment-15038772 ] Mingliang Liu commented on HDFS-9442: - s/v5/v6/ I mean, "v6 patch is to...". Sorry for

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038766#comment-15038766 ] Mingliang Liu commented on HDFS-9214: - The latest patch looks good to me. Thanks. > Re

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038761#comment-15038761 ] Hadoop QA commented on HDFS-9214: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9504) libhdfs++ Initialize BadNodeTracker in FileSystemImpl constructor

[ https://issues.apache.org/jira/browse/HDFS-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038733#comment-15038733 ] Hadoop QA commented on HDFS-9504: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9417) Clean up the RAT warnings in the HDFS-8707 branch.

[ https://issues.apache.org/jira/browse/HDFS-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9417: - Attachment: HDFS-9417.HDFS-8707.002.patch Re-submitting to get a good run after HDFS-9497 committed. > Cle

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038717#comment-15038717 ] Arpit Agarwal commented on HDFS-9214: - Thanks for the v4 patch [~xiaobingo] +1 pending

[jira] [Updated] (HDFS-9504) libhdfs++ Initialize BadNodeTracker in FileSystemImpl constructor

[ https://issues.apache.org/jira/browse/HDFS-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9504: -- Status: Patch Available (was: Open) > libhdfs++ Initialize BadNodeTracker in FileSystemImpl cons

[jira] [Resolved] (HDFS-5958) One very large node in a cluster prevents balancer from balancing data

[ https://issues.apache.org/jira/browse/HDFS-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-5958. --- Resolution: Duplicate > One very large node in a cluster prevents balancer from balanci

[jira] [Commented] (HDFS-9497) libhdfs++: move lib/proto/cpp_helpers to third-party since it won't have an ASF license

[ https://issues.apache.org/jira/browse/HDFS-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038656#comment-15038656 ] James Clampffer commented on HDFS-9497: --- Committed to HDFS-8707. Thanks for the patc

[jira] [Updated] (HDFS-9497) libhdfs++: move lib/proto/cpp_helpers to third-party since it won't have an ASF license

[ https://issues.apache.org/jira/browse/HDFS-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9497: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: move lib/proto/cp

[jira] [Resolved] (HDFS-3439) Balancer exits if fs.defaultFS is set to a different, but semantically identical, URI from dfs.namenode.rpc-address

[ https://issues.apache.org/jira/browse/HDFS-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-3439. --- Resolution: Cannot Reproduce Target Version/s: (was: ) Resolving as Cannot

[jira] [Resolved] (HDFS-2851) HA: Optimize stale block processing by triggering block reports immediately on failover

[ https://issues.apache.org/jira/browse/HDFS-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2851. --- Resolution: Not A Problem Target Version/s: (was: ) Resolving this stale is

[jira] [Resolved] (HDFS-2621) Balancer is not checking ALREADY_RUNNING state and never returns this state.

[ https://issues.apache.org/jira/browse/HDFS-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2621. --- Resolution: Not A Problem Resolving this stale issue as Not A Problem. > Balancer is n

[jira] [Updated] (HDFS-9504) libhdfs++ Initialize BadNodeTracker in FileSystemImpl constructor

[ https://issues.apache.org/jira/browse/HDFS-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9504: -- Attachment: HDFS-9504.HDFS-8707.000.patch Attached fix, just adds a BadDataNodeTracker to the mem

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038632#comment-15038632 ] Xiao Chen commented on HDFS-9314: - Applied both patches locally and verified compile ok, to

[jira] [Resolved] (HDFS-2220) balancer.Balancer: java.lang.NullPointerException while HADOOP_CONF_DIR is empty or wrong

[ https://issues.apache.org/jira/browse/HDFS-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2220. --- Resolution: Cannot Reproduce Let's resolve this as Cannot Reproduce. > balancer.Balanc

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038629#comment-15038629 ] Xiao Chen commented on HDFS-9314: - As [discussed in HDFS-8647|https://issues.apache.org/ji

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9314: Attachment: HDFS-9314.branch27.patch HDFS-9314.branch26.patch > Improve BlockPlacementPolicyD

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038624#comment-15038624 ] Arpit Agarwal commented on HDFS-8647: - bq. a. After change, auto replication (if single

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038621#comment-15038621 ] Hadoop QA commented on HDFS-9129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.006.patch Thanks [~wheat9] for your review. The v5 patch is to address this. >

[jira] [Comment Edited] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038594#comment-15038594 ] Arpit Agarwal edited comment on HDFS-8831 at 12/3/15 9:14 PM: --

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038594#comment-15038594 ] Arpit Agarwal commented on HDFS-8831: - Hi Xiaoyu, thanks for the updated patch. A few m

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038570#comment-15038570 ] Chris Nauroth commented on HDFS-9505: - I haven't done a full read, but here are a few o

[jira] [Created] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

Chris Nauroth created HDFS-9505: --- Summary: HDFS Architecture documentation needs to be refreshed. Key: HDFS-9505 URL: https://issues.apache.org/jira/browse/HDFS-9505 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9414) Moving reconfiguration protocol out of ClientDatanodeProtocol for reusability

[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038548#comment-15038548 ] Xiaobing Zhou commented on HDFS-9414: - Move-out will break backward compatibility. It'd

[jira] [Created] (HDFS-9504) libhdfs++ Initialize BadNodeTracker in FileSystemImpl constructor

James Clampffer created HDFS-9504: - Summary: libhdfs++ Initialize BadNodeTracker in FileSystemImpl constructor Key: HDFS-9504 URL: https://issues.apache.org/jira/browse/HDFS-9504 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Attachment: HDFS-9214.004.patch v004 fixed [~liuml07]'s comment, check-style issues and one findbugs

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038482#comment-15038482 ] Xiaobing Zhou commented on HDFS-9214: - All fixed in v004. Thanks! > Reconfigure DN con

[jira] [Updated] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9313: Attachment: HDFS-9313.branch27.patch HDFS-9313.branch26.patch > Possible NullPointerException

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038479#comment-15038479 ] Xiao Chen commented on HDFS-9313: - As [discussed in HDFS-8647|https://issues.apache.org/ji

[jira] [Comment Edited] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038291#comment-15038291 ] Haohui Mai edited comment on HDFS-9442 at 12/3/15 7:43 PM: --- The p

[jira] [Commented] (HDFS-8705) BlockStoragePolicySuite uses equalsIgnoreCase for name lookup, won't work in all locales

[ https://issues.apache.org/jira/browse/HDFS-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038437#comment-15038437 ] Tsz Wo Nicholas Sze commented on HDFS-8705: --- [~steve_l], I believe the JDK bugs y

[jira] [Comment Edited] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038291#comment-15038291 ] Haohui Mai edited comment on HDFS-9442 at 12/3/15 7:40 PM: --- The p

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038427#comment-15038427 ] Tsz Wo Nicholas Sze commented on HDFS-9294: --- Merged to 2.8. Thanks for the remin

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038411#comment-15038411 ] Mingliang Liu commented on HDFS-9503: - Feel free to re-assign it to someone who's activ

[jira] [Assigned] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9503: --- Assignee: Mingliang Liu > Replace -namenode option with -fs for NNThroughputBenchmark > --

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038388#comment-15038388 ] Xiao Chen commented on HDFS-8647: - Thanks a lot for the review and commit Zhe! > Abstract

[jira] [Commented] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038374#comment-15038374 ] Hadoop QA commented on HDFS-9228: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038353#comment-15038353 ] Mingliang Liu commented on HDFS-9484: - [~shv] Thank you very much for your review, disc

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038347#comment-15038347 ] Konstantin Shvachko commented on HDFS-9484: --- +1 Will commit both shortly. > NNTh

[jira] [Commented] (HDFS-9501) TestBalancer#testBalancerWithPinnedBlocks fails in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038346#comment-15038346 ] Zhe Zhang commented on HDFS-9501: - I see, thx for confirming. FYI I just committed it to

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038342#comment-15038342 ] Konstantin Shvachko commented on HDFS-7847: --- I created HDFS-9503 to replace the {

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038338#comment-15038338 ] Zhe Zhang commented on HDFS-8647: - +1 on branch-2.6 patch as well. I just committed it. Gre

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8647: Fix Version/s: 2.6.4 > Abstract BlockManager's rack policy into BlockPlacementPolicy > --

[jira] [Created] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

Konstantin Shvachko created HDFS-9503: - Summary: Replace -namenode option with -fs for NNThroughputBenchmark Key: HDFS-9503 URL: https://issues.apache.org/jira/browse/HDFS-9503 Project: Hadoop HDF

[jira] [Commented] (HDFS-9501) TestBalancer#testBalancerWithPinnedBlocks fails in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038295#comment-15038295 ] Arpit Agarwal commented on HDFS-9501: - Hi Zhe, yes I meant you just cherry-picked HDFS-

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038291#comment-15038291 ] Haohui Mai commented on HDFS-9442: -- The patch looks good to me overall. Thanks Mingliang f

[jira] [Created] (HDFS-9502) DiskBalancer : Replace Node and Data Density with Weighted Mean and Variance

Anu Engineer created HDFS-9502: -- Summary: DiskBalancer : Replace Node and Data Density with Weighted Mean and Variance Key: HDFS-9502 URL: https://issues.apache.org/jira/browse/HDFS-9502 Project: Hadoop

[jira] [Commented] (HDFS-9501) TestBalancer#testBalancerWithPinnedBlocks fails in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038277#comment-15038277 ] Zhe Zhang commented on HDFS-9501: - Thanks for pinging Arpit. Are you referring to HDFS-8647

[jira] [Comment Edited] (HDFS-9501) TestBalancer#testBalancerWithPinnedBlocks fails in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038270#comment-15038270 ] Arpit Agarwal edited comment on HDFS-9501 at 12/3/15 6:35 PM: --

[jira] [Commented] (HDFS-9501) TestBalancer#testBalancerWithPinnedBlocks fails in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038270#comment-15038270 ] Arpit Agarwal commented on HDFS-9501: - Thanks a lot for debugging and fixing this [~bra

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038264#comment-15038264 ] Zhe Zhang commented on HDFS-8647: - Thanks for the work Xiao! +1 on the branch-2.7 patch. I

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8647: Fix Version/s: 2.7.3 > Abstract BlockManager's rack policy into BlockPlacementPolicy > --

[jira] [Updated] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9228: - Attachment: HDFS-9228.HDFS-8707.009.patch Added a fix for when sending larger packets > libhdfs++ should r

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038227#comment-15038227 ] Hadoop QA commented on HDFS-8578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038204#comment-15038204 ] Ming Ma commented on HDFS-9430: --- Thanks all. I agree with the above analysis and the patch is

[jira] [Commented] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038158#comment-15038158 ] Hadoop QA commented on HDFS-9228: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038103#comment-15038103 ] Bob Hansen commented on HDFS-9448: -- [~aw] - thanks for your patience. As it stands, the p

[jira] [Updated] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9228: - Attachment: HDFS-9228.HDFS-8707.008.patch Rebased on current HDFS-8707 > libhdfs++ should respect NN retry

[jira] [Commented] (HDFS-9501) TestBalancer#testBalancerWithPinnedBlocks fails in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038065#comment-15038065 ] Brahma Reddy Battula commented on HDFS-9501: [~xyao] thanks a lot for your revi

[jira] [Commented] (HDFS-9501) TestBalancer#testBalancerWithPinnedBlocks fails in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037997#comment-15037997 ] Xiaoyu Yao commented on HDFS-9501: -- Thanks [~brahmareddy] for working on this. Patch LGTM

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037978#comment-15037978 ] Kihwal Lee commented on HDFS-8791: -- Linking HDFS-8578 as a blocker for this jira. Although

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9500: - Target Version/s: 2.7.3, 2.6.4 (was: 2.7.2, 2.6.4) 2.7.2 is waiting for a couple of blockers. Targeting 2.

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037921#comment-15037921 ] Vinayakumar B commented on HDFS-8791: - Thanks [~ctrezzo] and [~kihwal] for bringing up

  1   2   >