[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

2015-08-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8838: Attachment: HDFS-8838-HDFS-7285-20150809-test.patch A test patch HDFS-8838-HDFS-7285-20150809-test.patch to

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696880#comment-14696880 ] Vinayakumar B commented on HDFS-7285: - I have tried to rebase current {{HDFS-7285}}

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696547#comment-14696547 ] Hudson commented on HDFS-7213: -- FAILURE: Integrated in Hadoop-trunk-Commit #8298 (See

[jira] [Commented] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696548#comment-14696548 ] Hudson commented on HDFS-7235: -- FAILURE: Integrated in Hadoop-trunk-Commit #8298 (See

[jira] [Commented] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696558#comment-14696558 ] Hudson commented on HDFS-7263: -- FAILURE: Integrated in Hadoop-trunk-Commit #8299 (See

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696524#comment-14696524 ] Vinayakumar B commented on HDFS-7213: - Cherry-picked to 2.6.1.

[jira] [Updated] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7213: Fix Version/s: (was: 2.7.0) 2.6.1 processIncrementalBlockReport performance

[jira] [Updated] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7213: Fix Version/s: 2.7.0 processIncrementalBlockReport performance degradation

[jira] [Updated] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7235: Labels: (was: 2.6.1-candidate) DataNode#transferBlock should report blocks that don't exist using

[jira] [Updated] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7235: Fix Version/s: 2.6.1 DataNode#transferBlock should report blocks that don't exist using

[jira] [Commented] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696535#comment-14696535 ] Vinayakumar B commented on HDFS-7235: - Cherry-picked to 2.6.1 DataNode#transferBlock

[jira] [Updated] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7263: Labels: (was: 2.6.1-candidate) Snapshot read can reveal future bytes for appended files.

[jira] [Commented] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696550#comment-14696550 ] Vinayakumar B commented on HDFS-7263: - Cherry-picked to 2.6.1 Snapshot read can

[jira] [Updated] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7263: Fix Version/s: 2.6.1 Snapshot read can reveal future bytes for appended files.

[jira] [Updated] (HDFS-7225) Remove stale block invalidation work when DN re-registers with different UUID

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7225: Labels: (was: 2.6.1-candidate) Remove stale block invalidation work when DN re-registers with

[jira] [Updated] (HDFS-7225) Remove stale block invalidation work when DN re-registers with different UUID

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7225: Fix Version/s: 2.6.1 Remove stale block invalidation work when DN re-registers with different UUID

[jira] [Commented] (HDFS-7225) Remove stale block invalidation work when DN re-registers with different UUID

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696620#comment-14696620 ] Vinayakumar B commented on HDFS-7225: - Cherry-picked to 2.6.1 Remove stale block

[jira] [Commented] (HDFS-7225) Remove stale block invalidation work when DN re-registers with different UUID

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696624#comment-14696624 ] Hudson commented on HDFS-7225: -- FAILURE: Integrated in Hadoop-trunk-Commit #8302 (See

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696642#comment-14696642 ] Hadoop QA commented on HDFS-8891: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-08-14 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696639#comment-14696639 ] Yi Liu commented on HDFS-8859: -- The two test failures are not related. Improve DataNode

[jira] [Updated] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7213: Labels: (was: 2.6.1-candidate) processIncrementalBlockReport performance degradation

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696635#comment-14696635 ] Hadoop QA commented on HDFS-8859: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697031#comment-14697031 ] Hudson commented on HDFS-8270: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #284 (See

[jira] [Commented] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697033#comment-14697033 ] Hudson commented on HDFS-7235: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #284 (See

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697034#comment-14697034 ] Hudson commented on HDFS-7213: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #284 (See

[jira] [Commented] (HDFS-7225) Remove stale block invalidation work when DN re-registers with different UUID

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697036#comment-14697036 ] Hudson commented on HDFS-7225: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #284 (See

[jira] [Commented] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697037#comment-14697037 ] Hudson commented on HDFS-7263: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #284 (See

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697057#comment-14697057 ] Hudson commented on HDFS-7213: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2233 (See

[jira] [Commented] (HDFS-7225) Remove stale block invalidation work when DN re-registers with different UUID

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697059#comment-14697059 ] Hudson commented on HDFS-7225: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2233 (See

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697065#comment-14697065 ] Hudson commented on HDFS-7649: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2233 (See

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697042#comment-14697042 ] Hudson commented on HDFS-7649: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #284 (See

[jira] [Commented] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697060#comment-14697060 ] Hudson commented on HDFS-7263: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2233 (See

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697054#comment-14697054 ] Hudson commented on HDFS-8270: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2233 (See

[jira] [Commented] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697056#comment-14697056 ] Hudson commented on HDFS-7235: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2233 (See

[jira] [Commented] (HDFS-8093) BP does not exist or is not under Constructionnull

2015-08-14 Thread Felix Borchers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696757#comment-14696757 ] Felix Borchers commented on HDFS-8093: -- I have a very similar problem while running

[jira] [Commented] (HDFS-7116) Add a command to get the bandwidth of balancer

2015-08-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696698#comment-14696698 ] Rakesh R commented on HDFS-7116: Hi All, In the proposed patch, Datanode is sending

[jira] [Updated] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

2015-08-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-8850: -- Labels: (was: 2.6.1-candidate) Removing the 2.6.1-candidate label, as this is an issue for a class

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-14 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696691#comment-14696691 ] Yong Zhang commented on HDFS-8891: -- Failed test cases are not related to this patch.

[jira] [Commented] (HDFS-7116) Add a command to get the bandwidth of balancer

2015-08-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696692#comment-14696692 ] Rakesh R commented on HDFS-7116: Hi All, Add a command to get the bandwidth of balancer

[jira] [Commented] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697117#comment-14697117 ] Hudson commented on HDFS-7263: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2214 (See

[jira] [Commented] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697113#comment-14697113 ] Hudson commented on HDFS-7235: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2214 (See

[jira] [Commented] (HDFS-7225) Remove stale block invalidation work when DN re-registers with different UUID

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697116#comment-14697116 ] Hudson commented on HDFS-7225: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2214 (See

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697114#comment-14697114 ] Hudson commented on HDFS-7213: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2214 (See

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697122#comment-14697122 ] Hudson commented on HDFS-7649: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2214 (See

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697111#comment-14697111 ] Hudson commented on HDFS-8270: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2214 (See

[jira] [Commented] (HDFS-7225) Remove stale block invalidation work when DN re-registers with different UUID

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697138#comment-14697138 ] Hudson commented on HDFS-7225: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #276 (See

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697133#comment-14697133 ] Hudson commented on HDFS-8270: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #276 (See

[jira] [Commented] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697135#comment-14697135 ] Hudson commented on HDFS-7235: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #276 (See

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697136#comment-14697136 ] Hudson commented on HDFS-7213: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #276 (See

[jira] [Commented] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697139#comment-14697139 ] Hudson commented on HDFS-7263: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #276 (See

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697144#comment-14697144 ] Hudson commented on HDFS-7649: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #276 (See

[jira] [Created] (HDFS-8897) Loadbalancer

2015-08-14 Thread LINTE (JIRA)
LINTE created HDFS-8897: --- Summary: Loadbalancer Key: HDFS-8897 URL: https://issues.apache.org/jira/browse/HDFS-8897 Project: Hadoop HDFS Issue Type: Bug Components: balancer mover

[jira] [Updated] (HDFS-8897) Loadbalancer always exits with : java.io.IOException: Another Balancer is running.. Exiting ...

2015-08-14 Thread LINTE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LINTE updated HDFS-8897: Summary: Loadbalancer always exits with : java.io.IOException: Another Balancer is running.. Exiting ... (was:

[jira] [Commented] (HDFS-8896) DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager

2015-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697154#comment-14697154 ] Hadoop QA commented on HDFS-8896: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

2015-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697240#comment-14697240 ] Hadoop QA commented on HDFS-8838: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8896) DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager

2015-08-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697316#comment-14697316 ] Walter Su commented on HDFS-8896: - The failed tests failed before the

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-08-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697551#comment-14697551 ] Rakesh R commented on HDFS-8220: I've rebased previous patch on {{HDFS-7285-merge}} branch

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota without need to get file and directory counts

2015-08-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697547#comment-14697547 ] Jason Lowe commented on HDFS-8898: -- This would solve a significant annoyance with

[jira] [Commented] (HDFS-8565) Typo in dfshealth.html - Decomissioning

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697646#comment-14697646 ] Hudson commented on HDFS-8565: -- FAILURE: Integrated in Hadoop-trunk-Commit #8307 (See

[jira] [Commented] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697564#comment-14697564 ] Hadoop QA commented on HDFS-6244: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697693#comment-14697693 ] Arpit Agarwal commented on HDFS-7649: - Thanks for catching and taking care of this

[jira] [Updated] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-14 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6244: -- Status: Open (was: Patch Available) Make Trash Interval configurable for each of the namespaces

[jira] [Updated] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-14 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6244: -- Status: Patch Available (was: Open) Make Trash Interval configurable for each of the namespaces

[jira] [Updated] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-14 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6244: -- Attachment: HDFS-6244.v5.patch Make Trash Interval configurable for each of the namespaces

[jira] [Updated] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-14 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6244: -- Attachment: (was: HDFS-6244.v5.patch) Make Trash Interval configurable for each of the namespaces

[jira] [Updated] (HDFS-8565) Typo in dfshealth.html - Decomissioning

2015-08-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8565: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697669#comment-14697669 ] Tsz Wo Nicholas Sze commented on HDFS-7649: --- Merged this to branch-2.

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697668#comment-14697668 ] Tsz Wo Nicholas Sze commented on HDFS-7649: --- It seems that this was only

[jira] [Updated] (HDFS-8565) Typo in dfshealth.html - Decomissioning

2015-08-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8565: - Fix Version/s: 2.8.0 Typo in dfshealth.html - Decomissioning -

[jira] [Commented] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697529#comment-14697529 ] Hadoop QA commented on HDFS-6244: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-08-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8220: --- Attachment: HDFS-8220-HDFS-7285-merge-10.patch Erasure Coding: StripedDataStreamer fails to handle the

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-08-14 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697681#comment-14697681 ] Ravi Prakash commented on HDFS-8344: Hi Haohui! There are arguments on both sides (time

[jira] [Commented] (HDFS-8824) Do not use small blocks for balancing the cluster

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697679#comment-14697679 ] Hudson commented on HDFS-8824: -- FAILURE: Integrated in Hadoop-trunk-Commit #8308 (See

[jira] [Updated] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-14 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6244: -- Attachment: HDFS-6244.v5.patch Make Trash Interval configurable for each of the namespaces

[jira] [Commented] (HDFS-8565) Typo in dfshealth.html - Decomissioning

2015-08-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697592#comment-14697592 ] Xiaoyu Yao commented on HDFS-8565: -- +1. Patch LGTM. I will commit it shortly. Typo in

[jira] [Created] (HDFS-8899) Erasure Coding: use threadpool for EC recovery tasks

2015-08-14 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8899: -- Summary: Erasure Coding: use threadpool for EC recovery tasks Key: HDFS-8899 URL: https://issues.apache.org/jira/browse/HDFS-8899 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-08-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697324#comment-14697324 ] Rakesh R commented on HDFS-8220: Any more comments on the attached patch. Hi [~zhz], I hope

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697397#comment-14697397 ] Hadoop QA commented on HDFS-6955: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

2015-08-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697330#comment-14697330 ] Walter Su commented on HDFS-8838: - failed tests not related. +1 for the last patch.

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-08-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697377#comment-14697377 ] Zhe Zhang commented on HDFS-8220: - [~rakeshr] Yes it'd be great if you can create a patch

[jira] [Created] (HDFS-8898) Create API and command-line argument to get quota without need to get file and directory counts

2015-08-14 Thread Joep Rottinghuis (JIRA)
Joep Rottinghuis created HDFS-8898: -- Summary: Create API and command-line argument to get quota without need to get file and directory counts Key: HDFS-8898 URL: https://issues.apache.org/jira/browse/HDFS-8898

[jira] [Commented] (HDFS-8093) BP does not exist or is not under Constructionnull

2015-08-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697395#comment-14697395 ] Tsz Wo Nicholas Sze commented on HDFS-8093: --- The file /system/balancer.id seems

[jira] [Commented] (HDFS-8801) Convert BlockInfoUnderConstruction as a feature

2015-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697787#comment-14697787 ] Jing Zhao commented on HDFS-8801: - Actually converting BlockInfoUnderConstruction can bring

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

2015-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8891: Issue Type: Bug (was: Improvement) HDFS concat should keep srcs order --

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697814#comment-14697814 ] Jing Zhao commented on HDFS-8891: - +1. I will commit the patch shortly. HDFS concat

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697842#comment-14697842 ] Hudson commented on HDFS-8891: -- FAILURE: Integrated in Hadoop-trunk-Commit #8309 (See

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697844#comment-14697844 ] Hadoop QA commented on HDFS-8833: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-08-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697981#comment-14697981 ] Haohui Mai commented on HDFS-8344: -- bq. Even if its simpler, there's a chance that

[jira] [Updated] (HDFS-8801) Convert BlockInfoUnderConstruction as a feature

2015-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8801: Attachment: HDFS-8801.000.patch Initial patch to demo the idea. Convert BlockInfoUnderConstruction as a

[jira] [Commented] (HDFS-7446) HDFS inotify should have the ability to determine what txid it has read up to

2015-08-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697725#comment-14697725 ] Ming Ma commented on HDFS-7446: --- For the 2.6.1 effort, the backport is straightforward. But

[jira] [Updated] (HDFS-8801) Convert BlockInfoUnderConstruction as a feature

2015-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8801: Affects Version/s: (was: 2.7.1) Status: Patch Available (was: Open) Convert

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-08-14 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697817#comment-14697817 ] Ravi Prakash commented on HDFS-8344: bq. If you take down the cluster and bring it back

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

2015-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8891: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

2015-08-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697873#comment-14697873 ] Zhe Zhang commented on HDFS-8853: - Thanks [~andreina] for the patch. Do you mind rebasing

[jira] [Commented] (HDFS-8801) Convert BlockInfoUnderConstruction as a feature

2015-08-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697904#comment-14697904 ] Zhe Zhang commented on HDFS-8801: - Thanks for initiating the work Jing! The overall

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

2015-08-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697943#comment-14697943 ] Walter Su commented on HDFS-8838: - I saw HDFS-8220 just get committed, would you mind

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697956#comment-14697956 ] Zhe Zhang commented on HDFS-7285: - Many thanks to Vinay for the great effort! I just

[jira] [Assigned] (HDFS-8801) Convert BlockInfoUnderConstruction as a feature

2015-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-8801: --- Assignee: Jing Zhao Convert BlockInfoUnderConstruction as a feature

[jira] [Updated] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-08-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8833: Status: Patch Available (was: Open) Erasure coding: store EC schema and cell size in INodeFile and

[jira] [Updated] (HDFS-8824) Do not use small blocks for balancing the cluster

2015-08-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8824: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

  1   2   >