[jira] [Updated] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10678: - Attachment: HDFS-10678.004.patch > Documenting NNThroughputBenchmark tool >

[jira] [Commented] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412526#comment-15412526 ] Mingliang Liu commented on HDFS-10678: -- Thanks [~shv] for your comments. I apologize for my omission

[jira] [Updated] (HDFS-10724) Document the caller context config keys

2016-08-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10724: - Labels: reviewded (was: ) > Document the caller context config keys >

[jira] [Updated] (HDFS-10725) Caller context should always be constructed by a builder

2016-08-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10725: - Affects Version/s: (was: 2.8.0) Target Version/s: 3.0.0-alpha2 (was: 2.8.0)

[jira] [Updated] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10678: - Attachment: HDFS-10678.003.patch Thanks for the review and suggestions, [~shv]. The v3 patch is

[jira] [Updated] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10678: - Attachment: HDFS-10678.002.patch The v2 patch is to address [~iwasakims]'s last comment. Thanks

[jira] [Commented] (HDFS-8991) Provide information on BPOfferService in DN JMX

2016-07-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359854#comment-15359854 ] Mingliang Liu commented on HDFS-8991: - Thanks [~jnp] for the review and comment. For the mini-dfs

[jira] [Issue Comment Deleted] (HDFS-9407) TestFileTruncate fails with BindException

2016-07-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9407: Comment: was deleted (was: Thanks for reporting and working on this.) > TestFileTruncate fails with

[jira] [Issue Comment Deleted] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-07-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9652: Comment: was deleted (was: +1 (non-binding)) > TestStartup.testImageChecksum is broken by HDFS-9569

[jira] [Issue Comment Deleted] (HDFS-9566) Remove expensive 'BlocksMap#getStorages(Block b, final DatanodeStorage.State state)' method

2016-07-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9566: Comment: was deleted (was: +1 (non-binding) pending on Jenkins.) > Remove expensive

[jira] [Issue Comment Deleted] (HDFS-9528) Cleanup namenode audit/log/exception messages

2016-07-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9528: Comment: was deleted (was: +1 (non-binding)) > Cleanup namenode audit/log/exception messages >

[jira] [Issue Comment Deleted] (HDFS-9700) DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol

2016-07-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9700: Comment: was deleted (was: Nice. +1 (non-binding)) > DFSClient and DFSOutputStream should set

[jira] [Updated] (HDFS-10641) TestBlockManager#testBlockReportQueueing fails intermittently

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10641: - Assignee: Daryn Sharp (was: Mingliang Liu) Hadoop Flags: Reviewed >

[jira] [Updated] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10678: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Updated] (HDFS-10747) o.a.h.hdfs.tools.DebugAdmin usage message is misleading

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10747: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.4 Status:

[jira] [Resolved] (HDFS-10677) Über-jira: Enhancements to NNThroughputBenchmark tool

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10677. -- Resolution: Fixed Fix Version/s: 2.8.0 > Über-jira: Enhancements to

[jira] [Issue Comment Deleted] (HDFS-10747) o.a.h.hdfs.tools.DebugAdmin usage message is misleading

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10747: - Comment: was deleted (was: Thanks for the review, [~jojochuang].) > o.a.h.hdfs.tools.DebugAdmin

[jira] [Updated] (HDFS-10725) Caller context should always be constructed by a builder

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10725: - Hadoop Flags: Incompatible change,Reviewed (was: Incompatible change) > Caller context should

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2016-08-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15423654#comment-15423654 ] Mingliang Liu commented on HDFS-10480: -- {{hadoop.hdfs.server.namenode.ha.TestBootstrapStandby}} is

[jira] [Updated] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11419: - Target Version/s: 3.0.0-alpha3 Setting target version as Hadoop 3. Correct me if I'm wrong. >

[jira] [Updated] (HDFS-11438) Fix typo in error message of StoragePolicyAdmin tool

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11438: - Hadoop Flags: Reviewed Status: Patch Available (was: Open) Submitting patch. Changed

[jira] [Updated] (HDFS-11438) Fix typo in error message of StoragePolicyAdmin tool

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11438: - Summary: Fix typo in error message of StoragePolicyAdmin tool (was: Fix Typo in HDFS) > Fix

[jira] [Commented] (HDFS-11439) testGenerationStampInFuture UT fails

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879339#comment-15879339 ] Mingliang Liu commented on HDFS-11439: -- If it fails in {{trunk}}, [HDFS-10499] should have fixed it?

[jira] [Commented] (HDFS-11450) HDFS specific network topology classes with storage type info included

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881661#comment-15881661 ] Mingliang Liu commented on HDFS-11450: -- I see a few of code logic duplicate in between newly added

[jira] [Commented] (HDFS-11455) Fix javadoc warnings in HDFS caused by deprecated FileSystem APIs

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883965#comment-15883965 ] Mingliang Liu commented on HDFS-11455: -- I'll review/commit next week. Thanks for working on this! >

[jira] [Commented] (HDFS-11455) Fix javadoc warnings in HDFS caused by deprecated FileSystem APIs

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883964#comment-15883964 ] Mingliang Liu commented on HDFS-11455: -- I see. We can file JIRAs on different modules as subtasks of

[jira] [Commented] (HDFS-11455) Fix javadoc warnings due to deprecated FileSystem APIs

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883401#comment-15883401 ] Mingliang Liu commented on HDFS-11455: -- This is duplicate to [HADOOP-14106], right? > Fix javadoc

[jira] [Commented] (HDFS-11434) TestQuota fails in windows

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876882#comment-15876882 ] Mingliang Liu commented on HDFS-11434: -- I lik [~linyiqun]'s idea. p.s. {{public static Path

[jira] [Commented] (HDFS-11430) Separate class InnerNode from class NetworkTopology and make it extendable

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876970#comment-15876970 ] Mingliang Liu commented on HDFS-11430: -- +1 This is straightforward and clear enough as a refactoring

[jira] [Updated] (HDFS-11430) Separate class InnerNode from class NetworkTopology and make it extendable

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11430: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-02-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.009.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-11375) Display the volume storage type in datanode UI

2017-02-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11375: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11375) Display the volume storage type in datanode UI

2017-02-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868453#comment-15868453 ] Mingliang Liu commented on HDFS-11375: -- +1 The failing tests are not related; let's fix checkstyle

[jira] [Commented] (HDFS-9599) TestDecommissioningStatus.testDecommissionStatus occasionally fails

2016-08-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427406#comment-15427406 ] Mingliang Liu commented on HDFS-9599: - The test is still failing sometimes. See

[jira] [Updated] (HDFS-10725) Caller context should always be constructed by a builder

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10725: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-10724) Document the caller context config keys

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10724: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10641) TestBlockManager#testBlockReportQueueing fails intermittently

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10641: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to {{trunk}},

[jira] [Updated] (HDFS-10641) TestBlockManager#testBlockReportQueueing fails intermittently

2016-08-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10641: - Fix Version/s: 2.8.0 > TestBlockManager#testBlockReportQueueing fails intermittently >

[jira] [Commented] (HDFS-11455) Fix javac warnings in HDFS that caused by deprecated FileSystem APIs

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888436#comment-15888436 ] Mingliang Liu commented on HDFS-11455: -- Failing tests seem unrelated. I'm +1 on this. Let's hold on

[jira] [Updated] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11476: - Target Version/s: 2.8.0 Component/s: datanode > Fix NPE in FsDatasetImpl#checkAndUpdate

[jira] [Commented] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889159#comment-15889159 ] Mingliang Liu commented on HDFS-11476: -- That's interesting. Even the log is checking if the

[jira] [Commented] (HDFS-11455) Fix javadoc warnings in HDFS that caused by deprecated FileSystem APIs

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886638#comment-15886638 ] Mingliang Liu commented on HDFS-11455: -- The patch looks good to me overall. One comment is that, for

[jira] [Comment Edited] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453359#comment-15453359 ] Mingliang Liu edited comment on HDFS-10713 at 8/31/16 9:42 PM: --- One concern

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453359#comment-15453359 ] Mingliang Liu commented on HDFS-10713: -- {code:title=DFSConfigKeys.java} 414 // Threshold for

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459801#comment-15459801 ] Mingliang Liu commented on HDFS-10475: -- A complete op->lock time will be feasible for sure. To obtain

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459759#comment-15459759 ] Mingliang Liu commented on HDFS-10713: -- {quote} If we just capture the longest lock held interval but

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468133#comment-15468133 ] Mingliang Liu commented on HDFS-10810: -- Will do this week. Thanks. > Setreplication removing block

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-08-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446604#comment-15446604 ] Mingliang Liu commented on HDFS-10810: -- The newly added unit test {{testSetReplicationWhenBatchIBR}},

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10810: - Attachment: (was: HDFS-10810-003.patch) > Setreplication removing block from

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491119#comment-15491119 ] Mingliang Liu commented on HDFS-10810: -- {quote} Brahma Reddy Battula: we can remove v3 patch from

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10810: - Attachment: HDFS-10810-003.patch Hi, [~brahmareddy], I can understand that the block is removed

[jira] [Commented] (HDFS-10644) Fix intermittently failing TestDFSUpgradeWithHA#testRollbackWithJournalNodes

2016-09-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488369#comment-15488369 ] Mingliang Liu commented on HDFS-10644: -- In case the stack is missing in Jenkins cluster and hard to

[jira] [Updated] (HDFS-10644) TestDFSUpgradeWithHA#testRollbackWithJournalNodes fails intermittently

2016-09-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10644: - Summary: TestDFSUpgradeWithHA#testRollbackWithJournalNodes fails intermittently (was: Fix

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489196#comment-15489196 ] Mingliang Liu commented on HDFS-10810: -- Hi [~szetszwo], please have a look at the v2 for the unit

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-09-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.004.patch Rebase from {{trunk}} branch and resolved conflicts with

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Summary: Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' (was: Add unit tests for

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Status: Patch Available (was: Open) > Add unit tests for HDFS command 'dfs -tail' and 'dfs

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.000.patch The v0 patch added tests for 'dfs -tail' and 'dfs -stat'. Will

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.001.patch > Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' >

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10903: - Description: In *Hadoop HDFS*, there are some places that use config key literal strings instead

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Description: I did not find unit test in {{trunk}} code for following cases: - HDFS command {{dfs

[jira] [Moved] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu moved HADOOP-13644 to HDFS-10903: --- Target Version/s: 2.8.0 (was: 2.8.0) Component/s: (was:

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.002.patch > Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' >

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.003.patch > Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' >

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-09-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530249#comment-15530249 ] Mingliang Liu commented on HDFS-10906: -- Thanks for the to do list, [~xyao]. +1 for the proposal. It

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530236#comment-15530236 ] Mingliang Liu commented on HDFS-10810: -- Thanks [~brahmareddy]. That's true that [HDFS-10666] has not

[jira] [Commented] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535145#comment-15535145 ] Mingliang Liu commented on HDFS-10893: -- [~jnp] would you like review this? Thanks. > Refactor

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Attachment: HDFS-10893-branch-2.002.patch > Refactor TestDFSShell by setting up MiniDFSCluser

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Target Version/s: 2.9.0 (was: 2.8.0) > Refactor TestDFSShell by setting up MiniDFSCluser once

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Attachment: HDFS-10893.002.patch > Refactor TestDFSShell by setting up MiniDFSCluser once for all

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1885#comment-1885 ] Mingliang Liu commented on HDFS-10972: -- Can you add a failing case (e.g. no arguments provided) for

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556745#comment-15556745 ] Mingliang Liu commented on HDFS-10972: -- # We don't have to call {{restoreStream()}} in

[jira] [Updated] (HDFS-10986) DFSAdmin should show detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Description: There are some subcommands in {{DFSAdmin}} that swallow IOException and give very

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Description: {{TestZKFailoverController#testGracefulFailoverMultipleZKfcs}} uses fixed time sleep

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs should not use fixed time sleep before assertsions

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Summary: o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs should not use

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs should not use fixed time sleep before assertsions

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Priority: Minor (was: Major) >

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertsions

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Description: {{TestZKFailoverController#testGracefulFailoverMultipleZKfcs}} uses fixed time

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertsions

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Summary: o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertsions

[jira] [Updated] (HDFS-10986) DFSAdmin should show detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Description: There are some subcommands in {{DFSAdmin}} that swallow IOException and give very

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Affects Version/s: (was: 2.8.0) Target Version/s: 3.0.0-alpha2 Description:

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Status: Patch Available (was: Open) > DFSAdmin should log detailed error message if any >

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556967#comment-15556967 ] Mingliang Liu commented on HDFS-10986: -- [~kihwal] and [~brahmareddy] does this make sense to you?

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Component/s: test > o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails >

[jira] [Created] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10985: Summary: o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently Key: HDFS-10985 URL: https://issues.apache.org/jira/browse/HDFS-10985

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Attachment: HDFS-10985.000.patch [~ste...@apache.org] and [~atm], does this makes sense to you?

[jira] [Created] (HDFS-10986) DFSAdmin should show detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10986: Summary: DFSAdmin should show detailed error message if any Key: HDFS-10986 URL: https://issues.apache.org/jira/browse/HDFS-10986 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553388#comment-15553388 ] Mingliang Liu commented on HDFS-10972: -- Thanks for the patch. I think this UT is useful. I'll confirm

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553400#comment-15553400 ] Mingliang Liu commented on HDFS-10965: -- Thanks for the patch, [~xiaobingo]. Can you update the patch

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Fix Version/s: 3.0.0-alpha2 > Refactor TestDFSShell by setting up MiniDFSCluser once for all

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552912#comment-15552912 ] Mingliang Liu commented on HDFS-10903: -- +1 pending on Jenkins. > Replace config key literal strings

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552909#comment-15552909 ] Mingliang Liu commented on HDFS-10903: -- {{dfs.namenode.fslock.fair}} is being tracked in [HDFS-5239].

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553439#comment-15553439 ] Mingliang Liu commented on HDFS-10972: -- I found most of my comments can be addressed if you refer the

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553665#comment-15553665 ] Mingliang Liu commented on HDFS-10903: -- Test failure {{hadoop.tools.TestHdfsConfigFields}} is

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Description: There are some subcommands in {{DFSAdmin}} that swallow IOException and give very

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Attachment: HDFS-10986.000.patch > DFSAdmin should log detailed error message if any >

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Created] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-22 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10893: Summary: Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test Key: HDFS-10893 URL: https://issues.apache.org/jira/browse/HDFS-10893 Project:

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail'

2016-09-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Component/s: shell fs > Add unit tests for HDFS command 'dfs -tail' >

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail'

2016-09-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Component/s: (was: hdfs) test > Add unit tests for HDFS command 'dfs -tail'

<    7   8   9   10   11   12   13   14   15   16   >