[jira] [Updated] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10415: - Attachment: HDFS-10415-branch-2.001.patch > TestDistributedFileSystem#testDFSCloseOrdering()

[jira] [Updated] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10415: - Attachment: HDFS-10415.000.patch > TestDistributedFileSystem#testDFSCloseOrdering() fails on

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Attachment: HDFS-10383.003.patch Thank you [~walter.k.su] for your helpful suggestion. Although

[jira] [Commented] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285043#comment-15285043 ] Mingliang Liu commented on HDFS-10383: -- Because of the recent JIRA update, I lost the permission to

[jira] [Updated] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10397: - Attachment: HDFS-10397.003.patch Thanks [~jingzhao] for the review. It makes sense to move the

[jira] [Commented] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285629#comment-15285629 ] Mingliang Liu commented on HDFS-10397: -- Thanks [~jingzhao] for the review. The latest build and test

[jira] [Commented] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285486#comment-15285486 ] Mingliang Liu commented on HDFS-10383: -- Test failure is not related. > Safely close resources in

[jira] [Commented] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285485#comment-15285485 ] Mingliang Liu commented on HDFS-10383: -- Thanks [~arpitagarwal] for taking care of it. Sorry I still

[jira] [Updated] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10397: - Attachment: HDFS-10397.001.patch As we {{setDeleteMissing}} before {{setUseDiff}}, the

[jira] [Commented] (HDFS-10400) hdfs dfs -put exits with zero on error

2016-05-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283293#comment-15283293 ] Mingliang Liu commented on HDFS-10400: -- Thanks for reporting this. Which version are you working on?

[jira] [Updated] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10397: - Attachment: HDFS-10397.002.patch Thanks [~yzhangal] for the insightful suggestion. This motivated

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282098#comment-15282098 ] Mingliang Liu commented on HDFS-8828: - Hi, I'm aware that {{-delete}} and {{-diff}} options are

[jira] [Commented] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282160#comment-15282160 ] Mingliang Liu commented on HDFS-10397: -- Sample error message: {code} 2016-05-05

[jira] [Created] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-12 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10397: Summary: Distcp should ignore -delete option if -diff option is provided instead of exiting Key: HDFS-10397 URL: https://issues.apache.org/jira/browse/HDFS-10397

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282142#comment-15282142 ] Mingliang Liu commented on HDFS-8828: - Thanks [~jingzhao], [~yzhangal] and [~jnp] for your prompt

[jira] [Updated] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10397: - Affects Version/s: 2.8.0 Target Version/s: 2.8.0 Status: Patch Available

[jira] [Updated] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10397: - Attachment: HDFS-10397.000.patch The v0 patch is to address this problem. Please kindly review.

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Attachment: HDFS-10383.000.patch The v0 patch is the first effort addressing this problem. Kindly

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Status: Patch Available (was: Open) > Safely close resources in DFSTestUtil >

[jira] [Commented] (HDFS-10347) Namenode report bad block method doesn't log the bad block or datanode.

2016-04-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264747#comment-15264747 ] Mingliang Liu commented on HDFS-10347: -- +1 (non-binding) as the patch is simple and clear. My minor

[jira] [Commented] (HDFS-10347) Namenode report bad block method doesn't log the bad block or datanode.

2016-04-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264785#comment-15264785 ] Mingliang Liu commented on HDFS-10347: -- If we are locking/unlocking for each reported block/node

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-05-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270026#comment-15270026 ] Mingliang Liu commented on HDFS-10220: -- I also think changing from {{Lease leaseToCheck =

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-05-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272889#comment-15272889 ] Mingliang Liu commented on HDFS-9732: - Thanks for the explanation. String concatenation in loop should

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-05-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274736#comment-15274736 ] Mingliang Liu commented on HDFS-10220: -- Hi [~nfraison.criteo], you don't have to change the jira

[jira] [Commented] (HDFS-10367) TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception.

2016-05-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271832#comment-15271832 ] Mingliang Liu commented on HDFS-10367: -- This is a workaround fix. I see no simple fix for this test

[jira] [Commented] (HDFS-10367) TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception.

2016-05-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271850#comment-15271850 ] Mingliang Liu commented on HDFS-10367: -- Thanks for your comment [~iwasakims]. I was fooled by the

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-05-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267782#comment-15267782 ] Mingliang Liu commented on HDFS-9732: - Thanks for the patch. May I ask why the {{StringBuilder}} is

[jira] [Created] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10293: Summary: StripedFileTestUtil#readAll flaky Key: HDFS-10293 URL: https://issues.apache.org/jira/browse/HDFS-10293 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10293: - Status: Patch Available (was: Open) > StripedFileTestUtil#readAll flaky >

[jira] [Commented] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241815#comment-15241815 ] Mingliang Liu commented on HDFS-10292: -- A space between "block" and {{last}} will be better, but it's

[jira] [Commented] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241859#comment-15241859 ] Mingliang Liu commented on HDFS-10281: -- Thanks for the review and commit, [~kihwal]. >

[jira] [Commented] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241802#comment-15241802 ] Mingliang Liu commented on HDFS-10281: -- Thanks for studying the pre-commit build issue. Let's wait

[jira] [Updated] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10293: - Issue Type: Sub-task (was: Bug) Parent: HDFS-8031 > StripedFileTestUtil#readAll flaky >

[jira] [Updated] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10293: - Attachment: HDFS-10293.000.patch The code is as following: {code} static int

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241806#comment-15241806 ] Mingliang Liu commented on HDFS-10284: -- [~brahmareddy], would you review this for me? Thanks. >

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Attachment: HDFS-10284.001.patch >

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241897#comment-15241897 ] Mingliang Liu commented on HDFS-10284: -- I found the {{BlockManagerSafeMode$SafeModeMonitor#canLeave}}

[jira] [Commented] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241932#comment-15241932 ] Mingliang Liu commented on HDFS-10283: -- Failing tests are not related as the changes are only for

[jira] [Commented] (HDFS-10291) TestShortCircuitLocalRead failing

2016-04-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243553#comment-15243553 ] Mingliang Liu commented on HDFS-10291: -- Thanks for the detailed investigation, [~ste...@apache.org].

[jira] [Commented] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243326#comment-15243326 ] Mingliang Liu commented on HDFS-10293: -- Thanks for your review and commit, [~jing9]. >

[jira] [Commented] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243319#comment-15243319 ] Mingliang Liu commented on HDFS-10283: -- Thank you [~jingzhao] for your review and commit. >

[jira] [Updated] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10175: - Attachment: HDFS-10175.005.patch > add per-operation stats to FileSystem.Statistics >

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243970#comment-15243970 ] Mingliang Liu commented on HDFS-10175: -- Thanks [~cmccabe] very much for the discussion. # The v5

[jira] [Created] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10306: Summary: SafeModeMonitor should not leave safe mode if name system is starting active service Key: HDFS-10306 URL: https://issues.apache.org/jira/browse/HDFS-10306

[jira] [Assigned] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-10306: Assignee: Mingliang Liu (was: Brahma Reddy Battula) > SafeModeMonitor should not leave

[jira] [Updated] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10306: - Hadoop Flags: (was: Reviewed) > SafeModeMonitor should not leave safe mode if name system is

[jira] [Updated] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10306: - Description: This is a follow-up of [HDFS-10192]. The

[jira] [Updated] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10306: - Fix Version/s: (was: 2.9.0) > SafeModeMonitor should not leave safe mode if name system is

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Attachment: HDFS-10284.002.patch Thank you [~walter.k.su] and [~vinayrpet] for your kind review.

[jira] [Commented] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246999#comment-15246999 ] Mingliang Liu commented on HDFS-10306: -- Thank you [~brahmareddy] for your review (and previous work).

[jira] [Commented] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246844#comment-15246844 ] Mingliang Liu commented on HDFS-10306: -- Test failures are not related. We don't add new test because

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Priority: Major (was: Minor) >

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247796#comment-15247796 ] Mingliang Liu commented on HDFS-10284: -- Thanks for the review [~brahmareddy]. Thanks for the review

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248792#comment-15248792 ] Mingliang Liu commented on HDFS-10175: -- Hi [~cmccabe], would you kindly have a look at the current

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

2016-04-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248807#comment-15248807 ] Mingliang Liu commented on HDFS-10312: -- Shall we create a new jira for this? > Large block reports

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

2016-04-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248713#comment-15248713 ] Mingliang Liu commented on HDFS-10312: -- +1 (non-binding) One nit is that, in the unit test

[jira] [Commented] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242189#comment-15242189 ] Mingliang Liu commented on HDFS-10293: -- I don't see related failing tests. Still, I'm surprised that

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242208#comment-15242208 ] Mingliang Liu commented on HDFS-10284: -- I see no related failing tests. >

[jira] [Updated] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10306: - Attachment: HDFS-10306.000.patch Thanks [~walter.k.su] for suggesting separating this code out of

[jira] [Updated] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10306: - Status: Patch Available (was: Open) > SafeModeMonitor should not leave safe mode if name system

[jira] [Updated] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10306: - Description: This is a follow-up of [HDFS-10192]. The

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Attachment: HDFS-10284.003.patch The v3 patch is to address [~brahmareddy]'s comment about code

[jira] [Commented] (HDFS-10305) Hdfs audit shouldn't log mkdir operaton if the directory already exists.

2016-04-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246710#comment-15246710 ] Mingliang Liu commented on HDFS-10305: -- Agreed. > Hdfs audit shouldn't log mkdir operaton if the

[jira] [Created] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10283: Summary: o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently Key: HDFS-10283 URL:

[jira] [Commented] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240097#comment-15240097 ] Mingliang Liu commented on HDFS-10283: -- It happens in our internal daily UT Jenkins, and recent

[jira] [Updated] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10281: - Status: Patch Available (was: Open) > o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages

[jira] [Updated] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10281: - Status: Open (was: Patch Available) > o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages

[jira] [Updated] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10283: - Attachment: HDFS-10283.000.patch A simple fix is to disable the replace-data-on-failure feature

[jira] [Updated] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10283: - Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241567#comment-15241567 ] Mingliang Liu commented on HDFS-10284: -- Failing tests are not related. >

[jira] [Created] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10284: Summary: o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently Key: HDFS-10284 URL: https://issues.apache.org/jira/browse/HDFS-10284

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Priority: Minor (was: Major) >

[jira] [Updated] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10281: - Attachment: HDFS-10281.001.patch Thanks [~jnp] for reviewing. Re-upload the patch for triggering

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241634#comment-15241634 ] Mingliang Liu commented on HDFS-10287: -- This will be a good improvement and users of

[jira] [Commented] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240458#comment-15240458 ] Mingliang Liu commented on HDFS-10282: -- Failing test

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Attachment: HDFS-10284.000.patch For testing the safe mode state machine transition

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-10381) DataNode exclusion log message should be a warning

2016-05-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276825#comment-15276825 ] Mingliang Liu commented on HDFS-10381: -- Is this for {{DataStreamer}}? Perhaps we can set the

[jira] [Created] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-09 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10383: Summary: Safely close resources in DFSTestUtil Key: HDFS-10383 URL: https://issues.apache.org/jira/browse/HDFS-10383 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394302#comment-15394302 ] Mingliang Liu commented on HDFS-9601: - +1 (non-binding) for [#HDFS-9601-branch-2.7.002.patch] >

[jira] [Updated] (HDFS-10668) Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10668: - Status: Patch Available (was: Reopened) > Fix intermittently failing UT

[jira] [Updated] (HDFS-10668) Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10668: - Attachment: HDFS-10668-branch-2.001.patch HDFS-10668.001.patch Thanks

[jira] [Updated] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10642: - Attachment: HDFS-10642.000.patch The root cause of the test (and related ones) is that, the tests

[jira] [Updated] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10642: - Status: Patch Available (was: Open) > Fix intermittently failing UT >

[jira] [Commented] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393048#comment-15393048 ] Mingliang Liu commented on HDFS-10678: -- Thanks for your prompt comment, [~shv]. Yes it's reasonable

[jira] [Updated] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10642: - Attachment: HDFS-10642.001.patch The v1 patch logs the exception while waiting for the storage

[jira] [Updated] (HDFS-10677) Über-jira: Enhancements to NNThroughputBenchmark tool

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10677: - Target Version/s: 2.8.0 (was: 3.0.0-alpha2) > Über-jira: Enhancements to NNThroughputBenchmark

[jira] [Commented] (HDFS-10642) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394513#comment-15394513 ] Mingliang Liu commented on HDFS-10642: -- Thanks for the review and commit, [~arpitagarwal]! The

[jira] [Updated] (HDFS-10641) Fix intermittently failing TestBlockManager#testBlockReportQueueing

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10641: - Issue Type: Sub-task (was: Bug) Parent: HDFS-10666 > Fix intermittently failing

[jira] [Updated] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10678: - Target Version/s: 2.8.0 > Documenting NNThroughputBenchmark tool >

[jira] [Updated] (HDFS-10641) TestBlockManager#testBlockReportQueueing fails intermittently

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10641: - Attachment: HDFS-10641.000.patch Thanks [~shahrs87] for helping us keep the full test logs. I

[jira] [Updated] (HDFS-10641) TestBlockManager#testBlockReportQueueing fails intermittently

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10641: - Status: Patch Available (was: Open) > TestBlockManager#testBlockReportQueueing fails

[jira] [Assigned] (HDFS-10641) Fix intermittently failing TestBlockManager#testBlockReportQueueing

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-10641: Assignee: Mingliang Liu > Fix intermittently failing

[jira] [Updated] (HDFS-10641) TestBlockManager#testBlockReportQueueing fails intermittently

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10641: - Summary: TestBlockManager#testBlockReportQueueing fails intermittently (was: Fix intermittently

[jira] [Updated] (HDFS-10641) Fix intermittently failing TestBlockManager#testBlockReportQueueing

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10641: - Target Version/s: 2.8.0 (was: 3.0.0-alpha2) > Fix intermittently failing

[jira] [Commented] (HDFS-10668) TestDataNodeMXBean#testDataNodeMXBeanBlockCount fails intermittently

2016-07-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15395119#comment-15395119 ] Mingliang Liu commented on HDFS-10668: -- Thanks [~brahmareddy] for review and commit. >

[jira] [Updated] (HDFS-10668) TestDataNodeMXBean#testDataNodeMXBeanBlockCount fails intermittently

2016-07-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10668: - Summary: TestDataNodeMXBean#testDataNodeMXBeanBlockCount fails intermittently (was: Fix

[jira] [Assigned] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-07-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-10326: Assignee: Mingliang Liu (was: Daryn Sharp) > Disable setting tcp socket send/receive

[jira] [Updated] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-07-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10326: - Attachment: HDFS-10326.000.patch > Disable setting tcp socket send/receive buffers for write

[jira] [Updated] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-07-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10326: - Status: Patch Available (was: Open) > Disable setting tcp socket send/receive buffers for write

<    5   6   7   8   9   10   11   12   13   14   >