[jira] [Commented] (HDFS-8421) Move startFile() and related operations into FSDirWriteFileOp

[ https://issues.apache.org/jira/browse/HDFS-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556073#comment-14556073 ] Hudson commented on HDFS-8421: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #935 (See

[jira] [Commented] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556077#comment-14556077 ] Hudson commented on HDFS-8454: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #935 (See

[jira] [Commented] (HDFS-8451) DFSClient probe for encryption testing interprets empty URI property for enabled

[ https://issues.apache.org/jira/browse/HDFS-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556076#comment-14556076 ] Hudson commented on HDFS-8451: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #935 (See

[jira] [Updated] (HDFS-8461) Erasure coding: fix priority level of UnderReplicatedBlocks for striped block

[ https://issues.apache.org/jira/browse/HDFS-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8461: Attachment: (was: HDFS-8461-HDFS-7285.001.patch) Erasure coding: fix priority level of

[jira] [Updated] (HDFS-8461) Erasure coding: fix priority level of UnderReplicatedBlocks for striped block

[ https://issues.apache.org/jira/browse/HDFS-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8461: Attachment: HDFS-8461-HDFS-7285.001.patch Erasure coding: fix priority level of UnderReplicatedBlocks for

[jira] [Commented] (HDFS-7116) Add a command to get the bandwidth of balancer

[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556068#comment-14556068 ] Hadoop QA commented on HDFS-7116: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8461) Erasure coding: fix priority level of UnderReplicatedBlocks for striped block

[ https://issues.apache.org/jira/browse/HDFS-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8461: Description: {code:title=UnderReplicatedBlocks.java} private int getPriority(int curReplicas, ... }

[jira] [Commented] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556196#comment-14556196 ] Hudson commented on HDFS-8454: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2133 (See

[jira] [Commented] (HDFS-8421) Move startFile() and related operations into FSDirWriteFileOp

[ https://issues.apache.org/jira/browse/HDFS-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556192#comment-14556192 ] Hudson commented on HDFS-8421: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2133 (See

[jira] [Commented] (HDFS-8268) Port conflict log for data node server is not sufficient

[ https://issues.apache.org/jira/browse/HDFS-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556194#comment-14556194 ] Hudson commented on HDFS-8268: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2133 (See

[jira] [Commented] (HDFS-8268) Port conflict log for data node server is not sufficient

[ https://issues.apache.org/jira/browse/HDFS-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556221#comment-14556221 ] Hudson commented on HDFS-8268: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #193 (See

[jira] [Commented] (HDFS-8467) [HDFS-Quota]Quota is getting updated after storage policy is modified even before mover command is executed.

[ https://issues.apache.org/jira/browse/HDFS-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556242#comment-14556242 ] Xiaoyu Yao commented on HDFS-8467: -- Thanks [~surendrasingh] for reporting the issue. This

[jira] [Commented] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556307#comment-14556307 ] Hadoop QA commented on HDFS-8382: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8268) Port conflict log for data node server is not sufficient

[ https://issues.apache.org/jira/browse/HDFS-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556327#comment-14556327 ] Hudson commented on HDFS-8268: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2151 (See

[jira] [Commented] (HDFS-8451) DFSClient probe for encryption testing interprets empty URI property for enabled

[ https://issues.apache.org/jira/browse/HDFS-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556328#comment-14556328 ] Hudson commented on HDFS-8451: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2151 (See

[jira] [Commented] (HDFS-8421) Move startFile() and related operations into FSDirWriteFileOp

[ https://issues.apache.org/jira/browse/HDFS-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556325#comment-14556325 ] Hudson commented on HDFS-8421: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2151 (See

[jira] [Commented] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556329#comment-14556329 ] Hudson commented on HDFS-8454: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2151 (See

[jira] [Commented] (HDFS-8408) Revisit and refactor ErasureCodingInfo

[ https://issues.apache.org/jira/browse/HDFS-8408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556339#comment-14556339 ] Hadoop QA commented on HDFS-8408: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8451) DFSClient probe for encryption testing interprets empty URI property for enabled

[ https://issues.apache.org/jira/browse/HDFS-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556195#comment-14556195 ] Hudson commented on HDFS-8451: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2133 (See

[jira] [Commented] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556223#comment-14556223 ] Hudson commented on HDFS-8454: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #193 (See

[jira] [Commented] (HDFS-8421) Move startFile() and related operations into FSDirWriteFileOp

[ https://issues.apache.org/jira/browse/HDFS-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556219#comment-14556219 ] Hudson commented on HDFS-8421: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #193 (See

[jira] [Updated] (HDFS-8465) Mover is success even when space exceeds storage quota.

[ https://issues.apache.org/jira/browse/HDFS-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8465: - Component/s: namenode Mover is success even when space exceeds storage quota.

[jira] [Updated] (HDFS-8465) Mover is success even when space exceeds storage quota.

[ https://issues.apache.org/jira/browse/HDFS-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8465: - Affects Version/s: 2.7.0 Mover is success even when space exceeds storage quota.

[jira] [Commented] (HDFS-8421) Move startFile() and related operations into FSDirWriteFileOp

[ https://issues.apache.org/jira/browse/HDFS-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556290#comment-14556290 ] Hudson commented on HDFS-8421: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #203 (See

[jira] [Commented] (HDFS-8451) DFSClient probe for encryption testing interprets empty URI property for enabled

[ https://issues.apache.org/jira/browse/HDFS-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556293#comment-14556293 ] Hudson commented on HDFS-8451: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #203 (See

[jira] [Commented] (HDFS-8268) Port conflict log for data node server is not sufficient

[ https://issues.apache.org/jira/browse/HDFS-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556292#comment-14556292 ] Hudson commented on HDFS-8268: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #203 (See

[jira] [Commented] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556294#comment-14556294 ] Hudson commented on HDFS-8454: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #203 (See

[jira] [Commented] (HDFS-8451) DFSClient probe for encryption testing interprets empty URI property for enabled

[ https://issues.apache.org/jira/browse/HDFS-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556222#comment-14556222 ] Hudson commented on HDFS-8451: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #193 (See

[jira] [Commented] (HDFS-8465) Mover is success even when space exceeds storage quota.

[ https://issues.apache.org/jira/browse/HDFS-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556260#comment-14556260 ] Xiaoyu Yao commented on HDFS-8465: -- This is by design. It is the same as setting space

[jira] [Commented] (HDFS-8458) Abstract an application layer in DataNode WebHdfs implementation

[ https://issues.apache.org/jira/browse/HDFS-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556399#comment-14556399 ] Hadoop QA commented on HDFS-8458: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556425#comment-14556425 ] Allen Wittenauer commented on HDFS-8382: bq. I think the solution will be like

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556434#comment-14556434 ] Allen Wittenauer commented on HDFS-7991: bq. Any thoughts? Just one, and this is

[jira] [Comment Edited] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556434#comment-14556434 ] Allen Wittenauer edited comment on HDFS-7991 at 5/22/15 4:57 PM:

[jira] [Commented] (HDFS-8461) Erasure coding: fix priority level of UnderReplicatedBlocks for striped block

[ https://issues.apache.org/jira/browse/HDFS-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556403#comment-14556403 ] Hadoop QA commented on HDFS-8461: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556586#comment-14556586 ] Suresh Srinivas commented on HDFS-7991: --- bq. Yup, and in those cases, that's what

[jira] [Created] (HDFS-8469) Lockfiles are not being created for datanode storage directories

Colin Patrick McCabe created HDFS-8469: -- Summary: Lockfiles are not being created for datanode storage directories Key: HDFS-8469 URL: https://issues.apache.org/jira/browse/HDFS-8469 Project:

[jira] [Updated] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally

[ https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8460: Summary: Erasure Coding: stateful read result doesn't match data occasionally (was: Erasure Coding:

[jira] [Commented] (HDFS-8469) Lockfiles are not being created for datanode storage directories

[ https://issues.apache.org/jira/browse/HDFS-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556632#comment-14556632 ] Colin Patrick McCabe commented on HDFS-8469: It looks like this behavior was

[jira] [Commented] (HDFS-8461) Erasure coding: fix priority level of UnderReplicatedBlocks for striped block

[ https://issues.apache.org/jira/browse/HDFS-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556637#comment-14556637 ] Zhe Zhang commented on HDFS-8461: - HDFS-8010 does the same thing; sorry that I haven't

[jira] [Updated] (HDFS-8469) Lockfiles are not being created for datanode storage directories

[ https://issues.apache.org/jira/browse/HDFS-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8469: --- Affects Version/s: 2.4.0 Lockfiles are not being created for datanode storage

[jira] [Updated] (HDFS-8469) Lockfiles are not being created for datanode storage directories

[ https://issues.apache.org/jira/browse/HDFS-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8469: --- Status: Patch Available (was: Open) Lockfiles are not being created for datanode

[jira] [Updated] (HDFS-8469) Lockfiles are not being created for datanode storage directories

[ https://issues.apache.org/jira/browse/HDFS-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8469: --- Attachment: HDFS-8469.001.patch Lockfiles are not being created for datanode storage

[jira] [Resolved] (HDFS-8010) Erasure coding: extend UnderReplicatedBlocks to accurately handle striped blocks

[ https://issues.apache.org/jira/browse/HDFS-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8010. - Resolution: Duplicate Erasure coding: extend UnderReplicatedBlocks to accurately handle striped blocks

[jira] [Commented] (HDFS-8461) Erasure coding: fix priority level of UnderReplicatedBlocks for striped block

[ https://issues.apache.org/jira/browse/HDFS-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556655#comment-14556655 ] Zhe Zhang commented on HDFS-8461: - HDFS-8010 patch (note that the rename part has been

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556496#comment-14556496 ] Allen Wittenauer commented on HDFS-7991: bq. Ideally when 2NN or standby is

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556546#comment-14556546 ] Allen Wittenauer commented on HDFS-7991: bq. Just in your previous comment it

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556684#comment-14556684 ] Vinayakumar B commented on HDFS-7991: - bq. If doing checkpointing in the active

[jira] [Commented] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556690#comment-14556690 ] Vinayakumar B commented on HDFS-8382: - bq. This is on my list of things to do, but it's

[jira] [Updated] (HDFS-8456) Introduce STORAGE_CONTAINER_SERVICE as a new NodeType.

[ https://issues.apache.org/jira/browse/HDFS-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8456: Attachment: HDFS-8456-HDFS-7240.02.patch Introduce STORAGE_CONTAINER_SERVICE as a new NodeType.

[jira] [Commented] (HDFS-8465) Mover is success even when space exceeds storage quota.

[ https://issues.apache.org/jira/browse/HDFS-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556458#comment-14556458 ] Xiaoyu Yao commented on HDFS-8465: -- Issue 2 - The negative quota is by design. Issue 1 -

[jira] [Comment Edited] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556470#comment-14556470 ] Suresh Srinivas edited comment on HDFS-7991 at 5/22/15 5:23 PM:

[jira] [Comment Edited] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556470#comment-14556470 ] Suresh Srinivas edited comment on HDFS-7991 at 5/22/15 5:24 PM:

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556511#comment-14556511 ] Suresh Srinivas commented on HDFS-7991: --- bq. I don't think I can put enough lol's in

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556470#comment-14556470 ] Suresh Srinivas commented on HDFS-7991: --- bq. I've been working under the assumption

<    1   2