[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-03-20 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9555: Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.6.5) > LazyPersistFileScrubber should still sleep if there are

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2016-02-06 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15135908#comment-15135908 ] Phil Yang commented on HDFS-9600: - Hi [~yzhangal] BlockManager.isReplicationInProgress is u

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2016-01-07 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15087292#comment-15087292 ] Phil Yang commented on HDFS-9600: - Thanks :) > do not check replication if the block is un

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2015-12-30 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075782#comment-15075782 ] Phil Yang commented on HDFS-9600: - Ok, what should I do now? > do not check replication if

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2015-12-30 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074934#comment-15074934 ] Phil Yang commented on HDFS-9600: - Why 2.6 patch failed on compiling... :( It failed on na

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-30 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Attachment: HDFS-9600-branch-2.6.patch HDFS-9600-branch-2.7.patch HDFS-9600-br

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Attachment: HDFS-9600-v4.patch upload v4 patch to remove checkstyle warnings and add cluster.waitActive(). D

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2015-12-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073618#comment-15073618 ] Phil Yang commented on HDFS-9600: - I run tests that failed in the latest Jenkins report, th

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-28 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Attachment: HDFS-9600-v3.patch > do not check replication if the block is under construction > --

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-28 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Attachment: (was: HDFS-9600-v3.patch) > do not check replication if the block is under construction > ---

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-28 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Attachment: HDFS-9600-v3.patch testDecommissionStatus failed, upload v3 patch to pass it. In DecommissionMana

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2015-12-28 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15072731#comment-15072731 ] Phil Yang commented on HDFS-9600: - Thanks! I find that branch-2.6 and branch-2.7 have a dif

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2015-12-28 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15072703#comment-15072703 ] Phil Yang commented on HDFS-9600: - Hi, Thanks for your reply. I'm not sure what is the diff

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-28 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Attachment: HDFS-9600-v2.patch Upload v2 patch which adds a testcase to reproduce this bug > do not check re

[jira] [Commented] (HDFS-9597) BaseReplicationPolicyTest should update data node stats after adding a data node

2015-12-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071596#comment-15071596 ] Phil Yang commented on HDFS-9597: - Sorry for duplicating, this patch looks good to me :) >

[jira] [Commented] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

2015-12-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071594#comment-15071594 ] Phil Yang commented on HDFS-9034: - This patch seems unfortunately broke test case on trunk

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2015-12-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071592#comment-15071592 ] Phil Yang commented on HDFS-9600: - I find the reason of test case breaking and open a new

[jira] [Updated] (HDFS-9602) TestReplicationPolicyConsiderLoad.testChooseTargetWithDecomNodes failed on trunk

2015-12-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9602: Status: Patch Available (was: Open) > TestReplicationPolicyConsiderLoad.testChooseTargetWithDecomNodes faile

[jira] [Updated] (HDFS-9602) TestReplicationPolicyConsiderLoad.testChooseTargetWithDecomNodes failed on trunk

2015-12-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9602: Attachment: HDFS-9602-v1.patch > TestReplicationPolicyConsiderLoad.testChooseTargetWithDecomNodes failed on

[jira] [Created] (HDFS-9602) TestReplicationPolicyConsiderLoad.testChooseTargetWithDecomNodes failed on trunk

2015-12-25 Thread Phil Yang (JIRA)
Phil Yang created HDFS-9602: --- Summary: TestReplicationPolicyConsiderLoad.testChooseTargetWithDecomNodes failed on trunk Key: HDFS-9602 URL: https://issues.apache.org/jira/browse/HDFS-9602 Project: Hadoop HD

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2015-12-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071494#comment-15071494 ] Phil Yang commented on HDFS-9600: - The unit tests failed, but it seems that it is not cause

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Description: When appending a file, we will update pipeline to bump a new GS and the old GS will be consider

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Description: When appending a file, we will update pipeline to bump a new GS and the old GS will be consider

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Description: When appending a file, we will update pipeline to bump a new GS and the old GS will be consider

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Attachment: HDFS-9600-v1.patch > do not check replication if the block is under construction > --

[jira] [Updated] (HDFS-9600) do not check replication if the block is under construction

2015-12-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9600: Status: Patch Available (was: Open) > do not check replication if the block is under construction >

[jira] [Created] (HDFS-9600) do not check replication if the block is under construction

2015-12-24 Thread Phil Yang (JIRA)
Phil Yang created HDFS-9600: --- Summary: do not check replication if the block is under construction Key: HDFS-9600 URL: https://issues.apache.org/jira/browse/HDFS-9600 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

2015-12-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067495#comment-15067495 ] Phil Yang commented on HDFS-9586: - {quote} So all the blocks that go into QUEUE_WITH_CORRUP

[jira] [Updated] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

2015-12-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9586: Status: Patch Available (was: Open) > listCorruptFileBlocks should not output files that all replications ar

[jira] [Updated] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

2015-12-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9586: Attachment: 9586-v1.patch > listCorruptFileBlocks should not output files that all replications are > decomm

[jira] [Updated] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

2015-12-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9586: Attachment: (was: patch) > listCorruptFileBlocks should not output files that all replications are > dec

[jira] [Updated] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

2015-12-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9586: Attachment: patch > listCorruptFileBlocks should not output files that all replications are > decommissionin

[jira] [Created] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

2015-12-21 Thread Phil Yang (JIRA)
Phil Yang created HDFS-9586: --- Summary: listCorruptFileBlocks should not output files that all replications are decommissioning Key: HDFS-9586 URL: https://issues.apache.org/jira/browse/HDFS-9586 Project: Ha

[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2015-12-14 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9555: Status: Patch Available (was: Open) > LazyPersistFileScrubber should still sleep if there are errors in the

[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2015-12-14 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9555: Attachment: 9555-v1.patch > LazyPersistFileScrubber should still sleep if there are errors in the clear > pr

[jira] [Created] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2015-12-14 Thread Phil Yang (JIRA)
Phil Yang created HDFS-9555: --- Summary: LazyPersistFileScrubber should still sleep if there are errors in the clear progress Key: HDFS-9555 URL: https://issues.apache.org/jira/browse/HDFS-9555 Project: Hadoo

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2015-12-02 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9500: Status: Patch Available (was: Open) > datanodesSoftwareVersions map may counting wrong when rolling upgrade

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2015-12-02 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9500: Description: While rolling upgrading, namenode's website overview will report there are two versions datanod

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2015-12-02 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9500: Description: While rolling upgrading, namenode's website overview will report there are two versions datanod

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2015-12-02 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9500: Attachment: 9500-v1.patch > datanodesSoftwareVersions map may counting wrong when rolling upgrade > -

[jira] [Created] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2015-12-02 Thread Phil Yang (JIRA)
Phil Yang created HDFS-9500: --- Summary: datanodesSoftwareVersions map may counting wrong when rolling upgrade Key: HDFS-9500 URL: https://issues.apache.org/jira/browse/HDFS-9500 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2015-12-02 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9500: Description: While rolling upgrading, namenode's website overview will report there are two versions datanod