[jira] [Updated] (HDFS-11079) TestQuotaByStorageType#setUp does not need refresh the cluster

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11079: - Resolution: Not A Problem Status: Resolved (was: Patch Available) Sorry I messed the code

[jira] [Comment Edited] (HDFS-11079) TestQuotaByStorageType#setUp does not need refresh the cluster

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15630303#comment-15630303 ] Mingliang Liu edited comment on HDFS-11079 at 11/3/16 6:33 AM: -

[jira] [Updated] (HDFS-11079) Accelerate TestQuotaByStorageType using shared MiniDFSCluster

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11079: - Summary: Accelerate TestQuotaByStorageType using shared MiniDFSCluster (was: TestQuotaByStorageTy

[jira] [Commented] (HDFS-11088) Quash unnecessary safemode WARN message during NameNode startup

2016-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15631856#comment-15631856 ] Mingliang Liu commented on HDFS-11088: -- If only we have tests... +1 anyway. > Quash

[jira] [Comment Edited] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634134#comment-15634134 ] Mingliang Liu edited comment on HDFS-11085 at 11/3/16 8:27 PM: -

[jira] [Commented] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634134#comment-15634134 ] Mingliang Liu commented on HDFS-11085: -- The patch looks good to me overall. Some min

[jira] [Comment Edited] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634134#comment-15634134 ] Mingliang Liu edited comment on HDFS-11085 at 11/3/16 8:39 PM: -

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-11-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11076: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11085: - Description: This can be placed in {{org.apache.hadoop.hdfs.server.namenode.TestStartup}} test cl

[jira] [Commented] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634790#comment-15634790 ] Mingliang Liu commented on HDFS-11085: -- +1 pending on Jenkins. > Add unit tests for

[jira] [Commented] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637156#comment-15637156 ] Mingliang Liu commented on HDFS-11085: -- It's interesting {{hadoop.hdfs.server.namenod

[jira] [Updated] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11085: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11085) Add unit test for NameNode failing to start when name dir is unwritable

2016-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11085: - Summary: Add unit test for NameNode failing to start when name dir is unwritable (was: Add unit t

[jira] [Updated] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11083: - Description: {{hdfs dfsadmin -report}} has very useful information about the cluster. There are s

[jira] [Comment Edited] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645938#comment-15645938 ] Mingliang Liu edited comment on HDFS-11083 at 11/8/16 12:26 AM:

[jira] [Commented] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645938#comment-15645938 ] Mingliang Liu commented on HDFS-11083: -- The patch looks good to me overall. Thanks,

[jira] [Comment Edited] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645938#comment-15645938 ] Mingliang Liu edited comment on HDFS-11083 at 11/8/16 12:26 AM:

[jira] [Commented] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649004#comment-15649004 ] Mingliang Liu commented on HDFS-11083: -- {code} 537 fs.setReplication(file,

[jira] [Updated] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11083: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Closed] (HDFS-11089) Accelerate TestDiskBalancerCommand using static shared MiniDFSCluster

2016-11-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu closed HDFS-11089. > Accelerate TestDiskBalancerCommand using static shared MiniDFSCluster > --

[jira] [Resolved] (HDFS-11089) Accelerate TestDiskBalancerCommand using static shared MiniDFSCluster

2016-11-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-11089. -- Resolution: Not A Problem Thanks [~arpitagarwal] for your suggestion. Closing this JIRA as "Not

[jira] [Updated] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11122: - Issue Type: Sub-task (was: Bug) Parent: HDFS-10891 > TestDFSAdmin.testReportCommand fails

[jira] [Commented] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15651765#comment-15651765 ] Mingliang Liu commented on HDFS-11122: -- Seems still failing? > TestDFSAdmin.testRepo

[jira] [Commented] (HDFS-11087) NamenodeFsck should check if the output writer is still writable.

2016-11-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652327#comment-15652327 ] Mingliang Liu commented on HDFS-11087: -- HDFS-11087.branch-2.000.patch -> HDFS-11087-b

[jira] [Updated] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11122: - Component/s: test > TestDFSAdmin.testReportCommand fails due to timed out > --

[jira] [Updated] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11122: - Affects Version/s: (was: 3.0.0-alpha1) Target Version/s: 2.8.0, 3.0.0-alpha2 > TestDFSAdm

[jira] [Commented] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654836#comment-15654836 ] Mingliang Liu commented on HDFS-11122: -- Triggering block report should help here obvi

[jira] [Commented] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655872#comment-15655872 ] Mingliang Liu commented on HDFS-11122: -- +1 Will commit this with a clean Jenkins run

[jira] [Commented] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658089#comment-15658089 ] Mingliang Liu commented on HDFS-11122: -- Failing tests are not related. Will commit in

[jira] [Updated] (HDFS-11122) TestDFSAdmin#testReportCommand fails due to timed out

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11122: - Summary: TestDFSAdmin#testReportCommand fails due to timed out (was: TestDFSAdmin.testReportComma

[jira] [Updated] (HDFS-11122) TestDFSAdmin#testReportCommand fails due to timed out

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11122: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658299#comment-15658299 ] Mingliang Liu commented on HDFS-10872: -- +1 > Add MutableRate metrics for FSNamesyste

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658355#comment-15658355 ] Mingliang Liu commented on HDFS-10872: -- That's a good point. We can add prefix (e.g.

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658608#comment-15658608 ] Mingliang Liu commented on HDFS-10872: -- still +1 Thanks for updating the code. > Add

[jira] [Commented] (HDFS-11094) TestLargeBlockReport fails intermittently

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658693#comment-15658693 ] Mingliang Liu commented on HDFS-11094: -- I think this should work. Having the HAState

[jira] [Resolved] (HDFS-10666) Über-jira: Unit tests should not use fixed sleep interval to wait for conditions

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10666. -- Resolution: Fixed Target Version/s: 2.8.0 (was: 3.0.0-alpha2) > Über-jira: Unit tests

[jira] [Commented] (HDFS-11129) TestAppendSnapshotTruncate fails with bind exception

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15659104#comment-15659104 ] Mingliang Liu commented on HDFS-11129: -- +1 It's a good idea to revisit quickly other

[jira] [Updated] (HDFS-11129) TestAppendSnapshotTruncate fails with bind exception

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11129: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15659125#comment-15659125 ] Mingliang Liu commented on HDFS-10872: -- Thanks for taking care of this. I usually don

[jira] [Updated] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11105: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-10666 > TestRBWBlockInvalidation#tes

[jira] [Commented] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664545#comment-15664545 ] Mingliang Liu commented on HDFS-11105: -- I think the patch makes sense; we need to mak

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.006.patch Ping [~yzhangal] and [~jnp] for review. Thanks, > Make DistCpOpt

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.007.patch > Make DistCpOptions class immutable > --

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.008.patch > Make DistCpOptions class immutable > --

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Target Version/s: 2.9.0, 3.0.0-alpha2 Thanks for updating the JIRA. I changed the target version b

[jira] [Updated] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11105: - Resolution: Cannot Reproduce Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11105: - Affects Version/s: (was: 3.0.0-alpha1) 2.8.0 Component/s: test

[jira] [Reopened] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HDFS-11105: -- > TestRBWBlockInvalidation#testRWRInvalidation fails intermittently > --

[jira] [Resolved] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-11105. -- Resolution: Fixed > TestRBWBlockInvalidation#testRWRInvalidation fails intermittently >

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675208#comment-15675208 ] Mingliang Liu commented on HDFS-11094: -- +1 Some comments: # Is it possible to add a

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Component/s: datanode > Send back HAState along with NamespaceInfo during a versionRequest as an

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Target Version/s: 3.0.0-alpha2 (was: 2.8.0) +1 for the idea. I change the target version as 3.0+

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15688745#comment-15688745 ] Mingliang Liu commented on HDFS-11156: -- It may happen this week or after the holiday.

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703132#comment-15703132 ] Mingliang Liu commented on HDFS-11156: -- The patch looks good to me overall. +1 I hav

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703492#comment-15703492 ] Mingliang Liu commented on HDFS-11178: -- Is {{MiniDFSCluster#triggerBlockReports()}} b

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703890#comment-15703890 ] Mingliang Liu commented on HDFS-11094: -- Hi [~ebadger], thanks for updating the patch.

[jira] [Comment Edited] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703890#comment-15703890 ] Mingliang Liu edited comment on HDFS-11094 at 11/29/16 2:18 AM:

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15705922#comment-15705922 ] Mingliang Liu commented on HDFS-11156: -- They are two different problems. P1. The mis

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Issue Type: Improvement (was: Bug) +1 Please also add doc in the REST API page {{hadoop-hdfs-pr

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 3.0.0-alpha2) > Webhdfs rest api GET_BLOCK_LOCATIONS

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Summary: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API (was: Webhdfs rest api GET_BLOCK_LO

[jira] [Commented] (HDFS-11166) Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15712884#comment-15712884 ] Mingliang Liu commented on HDFS-11166: -- In [HDFS-11156], we add a new op {{GETFILEBLO

[jira] [Commented] (HDFS-11166) Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15712918#comment-15712918 ] Mingliang Liu commented on HDFS-11166: -- private/stable change only makes more sense t

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Summary: Allow AccessControlException in contract tests when getFileStatus on subdirectory of exis

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Assignee: Vishwajeet Dusane > Allow AccessControlException in contract tests when getFileStatus on

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Component/s: test > Allow AccessControlException in contract tests when getFileStatus on > subdir

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11166) Add webhdfs GETFILEBLOCKLOCATIONS document

2016-12-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15716398#comment-15716398 ] Mingliang Liu commented on HDFS-11166: -- I can also have a look at next week. If [~aji

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15716886#comment-15716886 ] Mingliang Liu commented on HDFS-11094: -- For the protocol changes, end-to-end tests ar

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-12-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15721602#comment-15721602 ] Mingliang Liu commented on HDFS-11178: -- Sorry I'm not actively reviewing this patch.

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15724650#comment-15724650 ] Mingliang Liu commented on HDFS-11156: -- Sorry I missed the point of not changing the

[jira] [Updated] (HDFS-11211) Add a time unit to the DataNode client trace format

2016-12-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11211: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11211) Add a time unit to the DataNode client trace format

2016-12-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11211: - Fix Version/s: (was: 2.8.0) 2.9.0 > Add a time unit to the DataNode client

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726664#comment-15726664 ] Mingliang Liu commented on HDFS-11094: -- Thanks for bringing this up. If we agree to r

[jira] [Commented] (HDFS-11226) Storagepolicy command is not working with "-fs" option

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736115#comment-15736115 ] Mingliang Liu commented on HDFS-11226: -- {code} hdfs storagepolicies Usage: bin/hdfs s

[jira] [Updated] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11227: - Assignee: Suresh Bahuguna > BlockReader read doesn't timeout > >

[jira] [Updated] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11227: - Status: Patch Available (was: Open) > BlockReader read doesn't timeout >

[jira] [Commented] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736130#comment-15736130 ] Mingliang Liu commented on HDFS-11227: -- [~subahugu] I've added you as HDFS contributo

[jira] [Updated] (HDFS-11234) distcp performance is suboptimal for high bandwidth/high latency setups

2016-12-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11234: - Assignee: Suresh Bahuguna > distcp performance is suboptimal for high bandwidth/high latency setup

[jira] [Commented] (HDFS-11234) distcp performance is suboptimal for high bandwidth/high latency setups

2016-12-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742769#comment-15742769 ] Mingliang Liu commented on HDFS-11234: -- Can you have a look at [HDFS-10326]? I think

[jira] [Updated] (HDFS-11226) cacheadmin,cryptoadmin and storagepolicyadmin should support generic options

2016-12-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11226: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11226) cacheadmin,cryptoadmin and storagepolicyadmin should support generic options

2016-12-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11226: - Component/s: tools > cacheadmin,cryptoadmin and storagepolicyadmin should support generic options

[jira] [Commented] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15745608#comment-15745608 ] Mingliang Liu commented on HDFS-11240: -- https://mvnrepository.com/artifact/com.micros

[jira] [Commented] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15745625#comment-15745625 ] Mingliang Liu commented on HDFS-11240: -- I think we can simply remove the {{repositori

[jira] [Updated] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11240: - Component/s: fs/adl > Remove snapshot version of SDK dependency from Azure Data Lake Store File >

[jira] [Updated] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11240: - Assignee: Vishwajeet Dusane > Remove snapshot version of SDK dependency from Azure Data Lake Store

[jira] [Updated] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11240: - Target Version/s: 3.0.0-alpha2 > Remove snapshot version of SDK dependency from Azure Data Lake St

[jira] [Updated] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11240: - Component/s: (was: fs/adl) fs/azure > Remove snapshot version of SDK dependen

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15746031#comment-15746031 ] Mingliang Liu commented on HDFS-11094: -- Yes I will review this week if no reviews fro

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

2016-12-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749667#comment-15749667 ] Mingliang Liu commented on HDFS-11246: -- audit log can be async; anyway logging out of

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750003#comment-15750003 ] Mingliang Liu commented on HDFS-11094: -- +1 Failing test is not related. Do we need s

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752505#comment-15752505 ] Mingliang Liu commented on HDFS-11094: -- +1 pending on Jenkins. > Send back HAState a

[jira] [Commented] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752555#comment-15752555 ] Mingliang Liu commented on HDFS-11253: -- +1 pending on Jenkins. > FileInputStream lea

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Status: Re

[jira] [Updated] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11253: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.9.0, 3.0.0-alpha2) Fix Version/s: (was: 2

[jira] [Commented] (HDFS-11270) Document the missing options of NameNode bootstrap command

2016-12-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15770866#comment-15770866 ] Mingliang Liu commented on HDFS-11270: -- Thanks [~linyiqun]. I think the patch is good

[jira] [Commented] (HDFS-11272) Missing whitespace in the message of TestFSDirAttrOp.java

2016-12-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15771032#comment-15771032 ] Mingliang Liu commented on HDFS-11272: -- +1 pending on Jenkins. For the last two asse

<    10   11   12   13   14   15   16   17   18   >