[jira] [Updated] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11122: - Component/s: test > TestDFSAdmin.testReportCommand fails due to timed out >

[jira] [Updated] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11122: - Affects Version/s: (was: 3.0.0-alpha1) Target Version/s: 2.8.0, 3.0.0-alpha2 >

[jira] [Commented] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654836#comment-15654836 ] Mingliang Liu commented on HDFS-11122: -- Triggering block report should help here obviously. +1

[jira] [Updated] (HDFS-11085) Add unit test for NameNode failing to start when name dir is unwritable

2016-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11085: - Summary: Add unit test for NameNode failing to start when name dir is unwritable (was: Add unit

[jira] [Updated] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11085: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11083: - Description: {{hdfs dfsadmin -report}} has very useful information about the cluster. There are

[jira] [Updated] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11011: - Attachment: HDFS-11011.004.patch The v3 patch looks good to me overall. {code} 1454

[jira] [Updated] (HDFS-11008) Change unit test for testing parsing "-source" parameter in Balancer CLI

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11008: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576620#comment-15576620 ] Mingliang Liu commented on HDFS-11011: -- Hi Xiaobing, before reviewing the patch, I have a question:

[jira] [Commented] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576698#comment-15576698 ] Mingliang Liu commented on HDFS-11016: -- Please see my comments in [HDFS-11011] about

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576736#comment-15576736 ] Mingliang Liu commented on HDFS-11011: -- Can we move them together (and add comments in the UT about

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577281#comment-15577281 ] Mingliang Liu commented on HDFS-10922: -- I always prefer these JIRAd being backported to

[jira] [Comment Edited] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577281#comment-15577281 ] Mingliang Liu edited comment on HDFS-10922 at 10/15/16 3:44 AM: I always

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583864#comment-15583864 ] Mingliang Liu commented on HDFS-11011: -- Thanks for your patch [~xiaobingo]. It looks good to me

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031-branch-2.003.patch > Add additional unit test for DataNode startup

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.003.patch > Add additional unit test for DataNode startup behavior when

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: (was: HDFS-11031.003.patch) > Add additional unit test for DataNode startup

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.003.patch Thanks [~brahmareddy] for your review. The v3 patch addressed

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603138#comment-15603138 ] Mingliang Liu commented on HDFS-11031: -- [~brahmareddy] would you kindly review the patch? Thank, >

[jira] [Commented] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603216#comment-15603216 ] Mingliang Liu commented on HDFS-11047: -- +1 for the proposal. Nice catch. Wondering if

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Description: TestDataNodeVolumeFailure#testVolumeFailure fails a volume and verifies the blocks

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Status: Patch Available (was: Open) > TestDataNodeVolumeFailure#testVolumeFailure is flaky

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Description: TestDataNodeVolumeFailure#testVolumeFailure fails a volume and verifies the blocks

[jira] [Issue Comment Deleted] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Comment: was deleted (was: Sending block report code seems complex. This is the internal logic of

[jira] [Assigned] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-11031: Assignee: Mingliang Liu > Add additional unit test for DataNode startup behavior when

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Attachment: HDFS-11030.000.patch Anyone can review the JIRA and the patch? Thanks, Ping [~jnp]

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Attachment: HDFS-11030-branch-2.000.patch > TestDataNodeVolumeFailure#testVolumeFailure is flaky

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.000.patch > Add additional unit test for DataNode startup behavior when

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Status: Patch Available (was: Open) > Add additional unit test for DataNode startup behavior

[jira] [Commented] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593541#comment-15593541 ] Mingliang Liu commented on HDFS-10998: -- +1 Will commit shortly. > Add unit tests for HDFS command

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593747#comment-15593747 ] Mingliang Liu commented on HDFS-11031: -- I'd like to ping [~jnp] for code review. > Add additional

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031-branch-2.001.patch > Add additional unit test for DataNode startup

[jira] [Updated] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10998: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593873#comment-15593873 ] Mingliang Liu commented on HDFS-11031: -- [~brahmareddy] that's a good idea. I'll update the patch with

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.001.patch > Add additional unit test for DataNode startup behavior when

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593785#comment-15593785 ] Mingliang Liu commented on HDFS-11011: -- +1 after the checkstyle warning is addressed. Thanks. > Add

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.002.patch V2 patch addresses [~brahmareddy]'s comments. > Add additional

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031-branch-2.002.patch > Add additional unit test for DataNode startup

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Description: TestDataNodeVolumeFailure#testVolumeFailure fails a volume and verifies the blocks

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Description: TestDataNodeVolumeFailure#testVolumeFailure fails a volume and verifies the blocks

[jira] [Commented] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587343#comment-15587343 ] Mingliang Liu commented on HDFS-11030: -- Sending block report code seems complex. This is the internal

[jira] [Created] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-18 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11030: Summary: TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing) Key: HDFS-11030 URL: https://issues.apache.org/jira/browse/HDFS-11030 Project: Hadoop

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Component/s: datanode > Add additional unit test for DataNode startup behavior when volumes fail

[jira] [Created] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-18 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11031: Summary: Add additional unit test for DataNode startup behavior when volumes fail Key: HDFS-11031 URL: https://issues.apache.org/jira/browse/HDFS-11031 Project:

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Description: TestDataNodeVolumeFailure#testVolumeFailure fails a volume and verifies the blocks

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Description: TestDataNodeVolumeFailure#testVolumeFailure fails a volume and verifies the blocks

[jira] [Updated] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11105: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-10666 >

[jira] [Commented] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664545#comment-15664545 ] Mingliang Liu commented on HDFS-11105: -- I think the patch makes sense; we need to make sure the

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688745#comment-15688745 ] Mingliang Liu commented on HDFS-11156: -- It may happen this week or after the holiday. Thanks, >

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703132#comment-15703132 ] Mingliang Liu commented on HDFS-11156: -- The patch looks good to me overall. +1 I have several minor

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703492#comment-15703492 ] Mingliang Liu commented on HDFS-11178: -- Is {{MiniDFSCluster#triggerBlockReports()}} blocking call? If

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703890#comment-15703890 ] Mingliang Liu commented on HDFS-11094: -- Hi [~ebadger], thanks for updating the patch. Sorry for

[jira] [Comment Edited] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703890#comment-15703890 ] Mingliang Liu edited comment on HDFS-11094 at 11/29/16 2:18 AM: Hi

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Target Version/s: 2.9.0, 3.0.0-alpha2 Thanks for updating the JIRA. I changed the target version

[jira] [Updated] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11105: - Resolution: Cannot Reproduce Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11105: - Affects Version/s: (was: 3.0.0-alpha1) 2.8.0 Component/s:

[jira] [Reopened] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HDFS-11105: -- > TestRBWBlockInvalidation#testRWRInvalidation fails intermittently >

[jira] [Resolved] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-11105. -- Resolution: Fixed > TestRBWBlockInvalidation#testRWRInvalidation fails intermittently >

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Target Version/s: 3.0.0-alpha2 (was: 2.8.0) +1 for the idea. I change the target version as

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675208#comment-15675208 ] Mingliang Liu commented on HDFS-11094: -- +1 Some comments: # Is it possible to add a unit test for

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Component/s: datanode > Send back HAState along with NamespaceInfo during a versionRequest as an

[jira] [Commented] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658089#comment-15658089 ] Mingliang Liu commented on HDFS-11122: -- Failing tests are not related. Will commit in one second. >

[jira] [Updated] (HDFS-11122) TestDFSAdmin#testReportCommand fails due to timed out

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11122: - Summary: TestDFSAdmin#testReportCommand fails due to timed out (was:

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658299#comment-15658299 ] Mingliang Liu commented on HDFS-10872: -- +1 > Add MutableRate metrics for FSNamesystemLock operations

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658608#comment-15658608 ] Mingliang Liu commented on HDFS-10872: -- still +1 Thanks for updating the code. > Add MutableRate

[jira] [Commented] (HDFS-11094) TestLargeBlockReport fails intermittently

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658693#comment-15658693 ] Mingliang Liu commented on HDFS-11094: -- I think this should work. Having the HAState namespace info

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658355#comment-15658355 ] Mingliang Liu commented on HDFS-10872: -- That's a good point. We can add prefix (e.g. FSNLock) in

[jira] [Updated] (HDFS-11122) TestDFSAdmin#testReportCommand fails due to timed out

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11122: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15659125#comment-15659125 ] Mingliang Liu commented on HDFS-10872: -- Thanks for taking care of this. I usually don't bump the

[jira] [Resolved] (HDFS-10666) Über-jira: Unit tests should not use fixed sleep interval to wait for conditions

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10666. -- Resolution: Fixed Target Version/s: 2.8.0 (was: 3.0.0-alpha2) > Über-jira: Unit

[jira] [Commented] (HDFS-11129) TestAppendSnapshotTruncate fails with bind exception

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15659104#comment-15659104 ] Mingliang Liu commented on HDFS-11129: -- +1 It's a good idea to revisit quickly other places that

[jira] [Updated] (HDFS-11129) TestAppendSnapshotTruncate fails with bind exception

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11129: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.007.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.008.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.006.patch Ping [~yzhangal] and [~jnp] for review. Thanks, > Make

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623700#comment-15623700 ] Mingliang Liu commented on HDFS-11065: -- The patch looks good to me overall. +1 pending on Jenkins

[jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623458#comment-15623458 ] Mingliang Liu commented on HDFS-11065: -- The description is a very detailed list. Thanks for updating

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11076: - Target Version/s: 2.8.0 > Add unit test for extended Acls > --- > >

[jira] [Updated] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11065: - Target Version/s: 2.8.0 > Add space quota tests for heterogenous storages >

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.005.patch > Add additional unit test for DataNode startup behavior when

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031-branch-2.005.patch Thanks [~brahmareddy] for your prompt effort to commit.

[jira] [Commented] (HDFS-11090) Leave safemode immediately if all blocks have reported in

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629748#comment-15629748 ] Mingliang Liu commented on HDFS-11090: -- Ping [~jingzhao] for more input. > Leave safemode

[jira] [Commented] (HDFS-11079) Accelerate TestQuotaByStorageType using shared MiniDFSCluster

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629983#comment-15629983 ] Mingliang Liu commented on HDFS-11079: -- Is it possible to totally isolate each test in this case

[jira] [Commented] (HDFS-11090) Leave safemode immediately if all blocks have reported in

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629742#comment-15629742 ] Mingliang Liu commented on HDFS-11090: -- {quote} Is this mean we should leave safemode when all the

[jira] [Updated] (HDFS-11095) BlockManagerSafeMode should respect extension period default config value (30s)

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11095: - Attachment: HDFS-11095.001.patch The v1 patch update the config description. Note that the

[jira] [Commented] (HDFS-11079) Accelerate TestQuotaByStorageType using shared MiniDFSCluster

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630303#comment-15630303 ] Mingliang Liu commented on HDFS-11079: -- You're correct [~arpitagarwal] I just had a look at the code

[jira] [Commented] (HDFS-11092) Stackoverflow if only root directory is used in Command Line

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630445#comment-15630445 ] Mingliang Liu commented on HDFS-11092: -- This is embarrassing. {{java.net.URI.create()}} factory

[jira] [Updated] (HDFS-11079) TestQuotaByStorageType#setUp does not need refresh the cluster

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11079: - Description: UPDATED: We don't need call {{refreshClusterState();}} after we build a brand new

[jira] [Updated] (HDFS-11079) TestQuotaByStorageType#setUp does not need refresh the cluster

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11079: - Target Version/s: 2.8.0, 3.0.0-alpha2 > TestQuotaByStorageType#setUp does not need refresh the

[jira] [Created] (HDFS-11095) BlockManagerSafeMode should respect extension period default config value (30s)

2016-11-02 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11095: Summary: BlockManagerSafeMode should respect extension period default config value (30s) Key: HDFS-11095 URL: https://issues.apache.org/jira/browse/HDFS-11095

[jira] [Updated] (HDFS-11095) BlockManagerSafeMode should respect extension period default config value (30s)

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11095: - Attachment: HDFS-11095.000.patch Ping [~jingzhao] for review. Thanks, > BlockManagerSafeMode

[jira] [Commented] (HDFS-11076) Add unit test for extended Acls

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630261#comment-15630261 ] Mingliang Liu commented on HDFS-11076: -- +1 [~arpitagarwal] do you need to have a look at this before

[jira] [Updated] (HDFS-11095) BlockManagerSafeMode should respect extension period default config value (30s)

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11095: - Status: Patch Available (was: Open) > BlockManagerSafeMode should respect extension period

[jira] [Updated] (HDFS-11079) Accelerate TestQuotaByStorageType using shared MiniDFSCluster

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11079: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-10891 > Accelerate

[jira] [Created] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-01 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11085: Summary: Add unit tests for NameNode failing to startup when name dir can not be written Key: HDFS-11085 URL: https://issues.apache.org/jira/browse/HDFS-11085

[jira] [Created] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-01 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11083: Summary: Add unit test for DFSAdmin -report command Key: HDFS-11083 URL: https://issues.apache.org/jira/browse/HDFS-11083 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11079) Accelerate TestQuotaByStorageType using shared MiniDFSCluster

2016-11-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11079: - Summary: Accelerate TestQuotaByStorageType using shared MiniDFSCluster (was:

[jira] [Commented] (HDFS-11088) Quash unnecessary safemode WARN message during NameNode startup

2016-11-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631856#comment-15631856 ] Mingliang Liu commented on HDFS-11088: -- If only we have tests... +1 anyway. > Quash unnecessary

[jira] [Comment Edited] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634134#comment-15634134 ] Mingliang Liu edited comment on HDFS-11085 at 11/3/16 8:27 PM: --- The patch

<    9   10   11   12   13   14   15   16   17   18   >