[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2015-12-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Status: Patch Available (was: Open) The failing tests can not re-produce locally and seem

[jira] [Commented] (HDFS-9588) DiskBalancer : Add submitDiskbalancer RPC

2015-12-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067446#comment-15067446 ] Mingliang Liu commented on HDFS-9588: - Thanks for working on this. {code} message

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Attachment: HDFS-9436.001.patch Thanks for your review and comment. No, the change was not

[jira] [Created] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-24 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9467: --- Summary: Fix data race accessing writeLockHeldTimeStamp in FSNamesystem Key: HDFS-9467 URL: https://issues.apache.org/jira/browse/HDFS-9467 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026129#comment-15026129 ] Mingliang Liu commented on HDFS-9145: - Sure. Nice catch! I filed [HDFS-9467] to track this. Thanks for

[jira] [Updated] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9467: Affects Version/s: 2.8.0 > Fix data race accessing writeLockHeldTimeStamp in FSNamesystem >

[jira] [Updated] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9467: Status: Patch Available (was: Open) > Fix data race accessing writeLockHeldTimeStamp in

[jira] [Updated] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9467: Attachment: HDFS-9467.000.patch > Fix data race accessing writeLockHeldTimeStamp in FSNamesystem >

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026158#comment-15026158 ] Mingliang Liu commented on HDFS-9457: - Thanks for your further effort. I meant to remove {{if

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9457: Assignee: BELUGA BEHR > Datanode Logging Improvement > > >

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9457: Priority: Minor (was: Trivial) > Datanode Logging Improvement > > >

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025772#comment-15025772 ] Mingliang Liu commented on HDFS-7435: - In {{NNThroughputBenchmark}} class, the change {code} void

[jira] [Commented] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027725#comment-15027725 ] Mingliang Liu commented on HDFS-9467: - Thank you for reviewing this patch again and committing it. >

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027834#comment-15027834 ] Mingliang Liu commented on HDFS-9457: - Thanks for updating the patch. Please refer to page at:

[jira] [Commented] (HDFS-6363) Improve concurrency while checking inclusion and exclusion of datanodes

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027921#comment-15027921 ] Mingliang Liu commented on HDFS-6363: - +1 (non-binding) > Improve concurrency while checking inclusion

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027919#comment-15027919 ] Mingliang Liu commented on HDFS-9214: - Overall looks good. Minor comments: # Any logging when

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.024.patch Per offline discussion with [~jingzhao], the v24 patch removes the

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027999#comment-15027999 ] Mingliang Liu commented on HDFS-9436: - Thank you very much for the detailed explanation. This is very

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027972#comment-15027972 ] Mingliang Liu commented on HDFS-9457: - Instead of deleting the previous patch and upload a new one with

[jira] [Updated] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9467: Attachment: HDFS-9467.001.patch The failing tests seem unrelated. Thanks [~jingzhao] for your

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026368#comment-15026368 ] Mingliang Liu commented on HDFS-9457: - Option 1 for sure. I think LOG.isTraceEnabled() is not needed

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025149#comment-15025149 ] Mingliang Liu commented on HDFS-9457: - Thanks for working on this. {{DataNode}} has adopted the slf4j

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032285#comment-15032285 ] Mingliang Liu commented on HDFS-7435: - Thanks for your comment, [~daryn] and [~shv]. I started to work

[jira] [Created] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2015-11-30 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9484: --- Summary: NNThroughputBenchmark$BlockReportStats should not send empty block reports Key: HDFS-9484 URL: https://issues.apache.org/jira/browse/HDFS-9484 Project: Hadoop

[jira] [Updated] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9484: Description: In {{NNThroughputBenchmark$BlockReportStats#formBlockReport()}}, the

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.004.patch Per offline discussion with [~wheat9] and [~jingzhao], the v4 patch

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.025.patch Thanks [~jingzhao] for the review. I revisited the TODO comment and

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032704#comment-15032704 ] Mingliang Liu commented on HDFS-9484: - Thanks [~cmccabe] for your confirmation. I updated the jira

[jira] [Updated] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9484: Description: In {{NNThroughputBenchmark$BlockReportStats#formBlockReport()}}, the

[jira] [Updated] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9485: Status: Patch Available (was: Open) > Make BlockManager#removeFromExcessReplicateMap accept

[jira] [Updated] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9484: Description: There are two potential bugs that make the {{NNThroughputBenchmark$BlockReportStats}}

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032708#comment-15032708 ] Mingliang Liu commented on HDFS-9436: - I updated the JIRA [HDFS-9484] to track the effort of fixing the

[jira] [Created] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

2015-11-30 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9485: --- Summary: Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block Key: HDFS-9485 URL: https://issues.apache.org/jira/browse/HDFS-9485 Project:

[jira] [Updated] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9485: Attachment: HDFS-9485.000.patch > Make BlockManager#removeFromExcessReplicateMap accept BlockInfo

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033170#comment-15033170 ] Mingliang Liu commented on HDFS-9129: - The _javac_ (both 1.7 and 1.8), _checkstyle_ and _asf license

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Component/s: namenode > Move the safemode block count into BlockManager >

[jira] [Commented] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

2015-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033048#comment-15033048 ] Mingliang Liu commented on HDFS-9485: - Thanks [~jingzhao] for reviewing this. Failing tests are

[jira] [Commented] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes

2015-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009393#comment-15009393 ] Mingliang Liu commented on HDFS-9379: - Thanks for your comment [~shv]. If the default value

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes

2015-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Component/s: (was: namenode) test > Make NNThroughputBenchmark$BlockReportStats

[jira] [Created] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-17 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9436: --- Summary: Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default Key: HDFS-9436 URL: https://issues.apache.org/jira/browse/HDFS-9436 Project:

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Description: This is a follow-up of [HDFS-9379]. Though for actual benchmarking the defaults are

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Hadoop Flags: (was: Reviewed) > Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Priority: Minor (was: Major) > Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by

[jira] [Commented] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes

2015-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009630#comment-15009630 ] Mingliang Liu commented on HDFS-9379: - Thanks for your confirmation. I filed [HDFS-9436] to track any

[jira] [Created] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-18 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9442: --- Summary: Move block replication logic from BlockManager to a new class ReplicationManager Key: HDFS-9442 URL: https://issues.apache.org/jira/browse/HDFS-9442 Project:

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012804#comment-15012804 ] Mingliang Liu commented on HDFS-9442: - I think we can work on {{trunk}} branch for this issue. As some

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.001.patch The v1 patch moves the {{neededReplication}} from {{BlockManager}}

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.001.patch > Move block replication logic from BlockManager to a new class >

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: (was: HDFS-9442.001.patch) > Move block replication logic from BlockManager to a new

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014354#comment-15014354 ] Mingliang Liu commented on HDFS-9407: - Thanks for your clarification. Yes, the intrinsic dependencies

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014210#comment-15014210 ] Mingliang Liu commented on HDFS-9407: - {quote} In TestFileTruncate we restart the whole cluster and

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Status: Patch Available (was: Open) > Move block replication logic from BlockManager to a new class

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.000.patch The v0 patch moves pending, over and mis-replicated blocks to

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.002.patch The v2 patch is to address the checkstyle, javac and findbugs

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023447#comment-15023447 ] Mingliang Liu commented on HDFS-9438: - Agreed. Ignoring the test instead of failing is preferred. >

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.003.patch > Move block replication logic from BlockManager to a new class >

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Attachment: HDFS-9436.000.patch The v0 patch makes number of datanodes in {{BlockReportStat}} 10 by

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020262#comment-15020262 ] Mingliang Liu commented on HDFS-9436: - Failing tests and ASF license warnings are not related to this

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Status: Patch Available (was: Open) > Make NNThroughputBenchmark$BlockReportStats run with 10

[jira] [Commented] (HDFS-845) Balancer documentation should not be in javadoc

2016-06-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312967#comment-15312967 ] Mingliang Liu commented on HDFS-845: [~szetszwo] Is this jira still valid? Thanks. Feel free to assign

[jira] [Updated] (HDFS-10220) A large number of expired leases can make namenode unresponsive and cause failover

2016-06-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10220: - Priority: Major (was: Minor) > A large number of expired leases can make namenode unresponsive

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2016-06-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Issue Type: New Feature (was: Task) > Logging HDFS operation's caller context into audit logs >

[jira] [Commented] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304931#comment-15304931 ] Mingliang Liu commented on HDFS-10415: -- {quote} I'm okay with reconciling with trunk if it fixes the

[jira] [Commented] (HDFS-10415) TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called

2016-05-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309023#comment-15309023 ] Mingliang Liu commented on HDFS-10415: -- Thank you [~cmccabe] for your review and commit! >

[jira] [Updated] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10415: - Affects Version/s: (was: 2.9.0) 2.8.0 Target Version/s: 2.8.0 >

[jira] [Updated] (HDFS-9343) Empty caller context considered invalid

2016-06-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9343: Issue Type: Sub-task (was: Task) Parent: HDFS-9184 > Empty caller context considered

[jira] [Created] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-21 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10556: Summary: DistCpOptions should be validated automatically Key: HDFS-10556 URL: https://issues.apache.org/jira/browse/HDFS-10556 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343858#comment-15343858 ] Mingliang Liu edited comment on HDFS-10556 at 6/22/16 7:47 AM: --- The v0 patch

[jira] [Updated] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10556: - Attachment: HDFS-10556-branch-2.000.patch The v0 patch simply calls the {{validate()}} private

[jira] [Updated] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10556: - Status: Patch Available (was: Open) > DistCpOptions should be validated automatically >

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344941#comment-15344941 ] Mingliang Liu commented on HDFS-10551: -- Thanks [~eddyxu]] for reporting this and [~anu] for the

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2016-06-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337675#comment-15337675 ] Mingliang Liu commented on HDFS-10533: -- Thanks [~cnauroth] and [~jingzhao] for the insights. I

[jira] [Commented] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345310#comment-15345310 ] Mingliang Liu commented on HDFS-10556: -- Thanks [~jingzhao] for the review and commit! >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-06-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.000.patch The v0 patch briefly explains our idea. Specially, the immutable

[jira] [Updated] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10556: - Attachment: HDFS-10556-branch-2.001.patch > DistCpOptions should be validated automatically >

[jira] [Commented] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345104#comment-15345104 ] Mingliang Liu commented on HDFS-10556: -- Per-offline discussion with [~jingzhao], we should keep the

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345017#comment-15345017 ] Mingliang Liu commented on HDFS-10551: -- [~anu] I've no strong preference about the above comments.

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-06-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Affects Version/s: (was: 3.0.0-alpha1) > Make DistCpOptions class immutable >

[jira] [Created] (HDFS-10533) Make DistCpOptions class immutable

2016-06-15 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10533: Summary: Make DistCpOptions class immutable Key: HDFS-10533 URL: https://issues.apache.org/jira/browse/HDFS-10533 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-06-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.000.patch Re-upload the same patch for triggering the Jenkins pre-commit

[jira] [Commented] (HDFS-9645) DiskBalancer : Add Query RPC

2016-01-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102911#comment-15102911 ] Mingliang Liu commented on HDFS-9645: - Thanks for working on this. The patch looks good to me overall.

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098637#comment-15098637 ] Mingliang Liu commented on HDFS-9652: - +1 (non-binding) > TestStartup.testImageChecksum is broken by

[jira] [Commented] (HDFS-8991) Provide information on BPOfferService in DN JMX

2016-06-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349760#comment-15349760 ] Mingliang Liu commented on HDFS-8991: - [HDFS-10572] tracks the known flaky test TestOfflineEditsViewer.

[jira] [Updated] (HDFS-8991) Provide information on BPOfferService in DN JMX

2016-06-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8991: Attachment: HDFS-8991.001.patch The v1 patch is to address the checkstyle warning. > Provide

[jira] [Updated] (HDFS-8991) Provide information on BPOfferService in DN JMX

2016-06-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8991: Summary: Provide information on BPOfferService in DN JMX (was: Provide information on

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-06-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Status: Patch Available (was: Open) > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-06-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.001.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-8991) Provide information on BPOfferService in DN JMX and UI

2016-06-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8991: Target Version/s: 3.0.0-alpha1 Component/s: datanode > Provide information on

[jira] [Updated] (HDFS-8991) Provide information on BPOfferService in DN JMX and UI

2016-06-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8991: Status: Patch Available (was: Open) > Provide information on BPOfferService in DN JMX and UI >

[jira] [Updated] (HDFS-8991) Provide information on BPOfferService in DN JMX and UI

2016-06-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8991: Attachment: HDFS-8991.000.patch Ping [~jnp]. > Provide information on BPOfferService in DN JMX and

[jira] [Commented] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133276#comment-15133276 ] Mingliang Liu commented on HDFS-9761: - Thanks for reporting this, [~abridgett] Seems the {{sleep()}}

[jira] [Assigned] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9761: --- Assignee: Mingliang Liu > Rebalancer sleeps too long between iterations >

[jira] [Commented] (HDFS-8890) Allow admin to specify which blockpools the balancer should run on

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133280#comment-15133280 ] Mingliang Liu commented on HDFS-8890: - Hi [~mingma] and [~ctrezzo], can you comment on [HDFS-9761]?

[jira] [Updated] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9761: Status: Patch Available (was: Open) > Rebalancer sleeps too long between iterations >

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133391#comment-15133391 ] Mingliang Liu commented on HDFS-9579: - The test results seem good to me. Specifically,

[jira] [Created] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9765: --- Summary: TestBlockScanner#testVolumeIteratorWithCaching fails intermittently Key: HDFS-9765 URL: https://issues.apache.org/jira/browse/HDFS-9765 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9755) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 2]

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133567#comment-15133567 ] Mingliang Liu commented on HDFS-9755: - {{TestDatanodeStartupFixesLegacyStorageIDs}} failed in trunk as

[jira] [Updated] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9765: Affects Version/s: 2.8.0 3.0.0 >

[jira] [Updated] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9761: Attachment: HDFS-9761.000.patch > Rebalancer sleeps too long between iterations >

[jira] [Commented] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

2016-02-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135248#comment-15135248 ] Mingliang Liu commented on HDFS-9765: - Increasing the time out seems fine to me. >

<    2   3   4   5   6   7   8   9   10   11   >