[jira] [Commented] (HDFS-7695) Intermittent failures in TestOpenFilesWithSnapshot

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113947#comment-15113947 ] Mingliang Liu commented on HDFS-7695: - The {{MiniDFSCluster}} does not keep rpc port wh

[jira] [Updated] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9689: Status: Open (was: Patch Available) > Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently > --

[jira] [Commented] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114132#comment-15114132 ] Mingliang Liu commented on HDFS-9689: - If the port changes during {{MiniDFSCluster#rest

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114134#comment-15114134 ] Mingliang Liu commented on HDFS-9503: - The failing tests seem unrelated. [~shv] Would y

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114136#comment-15114136 ] Mingliang Liu commented on HDFS-9672: - Failing tests are not related. Specially, {{hado

[jira] [Commented] (HDFS-9476) TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115775#comment-15115775 ] Mingliang Liu commented on HDFS-9476: - It happens in recent build as well, see UT log a

[jira] [Commented] (HDFS-9691) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode#testCheckSafeMode fails intermittently

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115776#comment-15115776 ] Mingliang Liu commented on HDFS-9691: - The failing test is not related, and seems flaky

[jira] [Commented] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115838#comment-15115838 ] Mingliang Liu commented on HDFS-9689: - Thanks [~iwasakims] and [~vinayrpet] for your in

[jira] [Commented] (HDFS-9664) TestRollingUpgrade.testRollback failed frequently

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116320#comment-15116320 ] Mingliang Liu commented on HDFS-9664: - Perhaps there is a fundamental problem in the ro

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116366#comment-15116366 ] Mingliang Liu commented on HDFS-9677: - The v1 patch basically renames the {{generationS

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116387#comment-15116387 ] Mingliang Liu commented on HDFS-9503: - Thank you [~vinayrpet] for your kind comment. I

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116453#comment-15116453 ] Mingliang Liu commented on HDFS-9672: - Thanks for the discussion, review and commit, [~

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.002.patch > Replace -namenode option with -fs for NNThroughputBenchmark > -

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118239#comment-15118239 ] Mingliang Liu commented on HDFS-9708: - Will {{conf.getTrimmedStringCollection(DFS_NAMEN

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9708: Attachment: HDFS-9708.000.patch > FSNamesystem.initAuditLoggers() doesn't trim classnames > -

[jira] [Assigned] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9708: --- Assignee: Mingliang Liu > FSNamesystem.initAuditLoggers() doesn't trim classnames > --

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9708: Status: Patch Available (was: Open) > FSNamesystem.initAuditLoggers() doesn't trim classnames >

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118811#comment-15118811 ] Mingliang Liu commented on HDFS-9677: - This makes perfect sense to me. Thanks for your

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9708: Attachment: HDFS-9708.001.patch Thanks [~ste...@apache.org] for your suggestion. In v0 patch, I find

[jira] [Updated] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9677: Attachment: HDFS-9677-branch-2.000.patch Thanks for your review [~jingzhao]. Attached the patch for b

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120452#comment-15120452 ] Mingliang Liu commented on HDFS-9677: - Thanks for the commit, [~jingzhao]! > Rename ge

[jira] [Created] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-01-27 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9716: --- Summary: o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk Key: HDFS-9716 URL: https://issues.apache.org/jira/browse/HDFS-9716 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6183) TestWebHDFS may fail with "Namenode is in startup mode"

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120569#comment-15120569 ] Mingliang Liu commented on HDFS-6183: - Still happens intermittently in recent builds, e

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120586#comment-15120586 ] Mingliang Liu commented on HDFS-9708: - {{hadoop.hdfs.TestRecoverStripedFile}} is flaky

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-01-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15122295#comment-15122295 ] Mingliang Liu commented on HDFS-9700: - Nice. +1 (non-binding) > DFSClient and DFSOutp

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.003.patch Thanks for your kind remind, [~shv]. The v3 patch is the latest one r

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Component/s: test > Replace -namenode option with -fs for NNThroughputBenchmark > ---

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.004.patch Hi [~shv], Thanks for your insightful comments. 1. The previous patc

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124605#comment-15124605 ] Mingliang Liu commented on HDFS-9708: - Hi, [~ste...@apache.org], does the newly added u

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-01-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124672#comment-15124672 ] Mingliang Liu commented on HDFS-9724: - Thanks for working on this, [~ajisakaa]. Patch l

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15126802#comment-15126802 ] Mingliang Liu commented on HDFS-9708: - Thanks for the review and commit! We can resolve

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127378#comment-15127378 ] Mingliang Liu commented on HDFS-9503: - s/desirable/not desirable/ Sorry about this. >

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.005.patch Nice catch, [~shv]. The v5 patch is to address your latest two commen

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127498#comment-15127498 ] Mingliang Liu commented on HDFS-9716: - Sample *Error Message* is like: {code} expected:

[jira] [Commented] (HDFS-9727) Improve the exception's log output in DataXceiver

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127501#comment-15127501 ] Mingliang Liu commented on HDFS-9727: - Specifically, {{hadoop.hdfs.TestRecoverStripedFi

[jira] [Assigned] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9739: --- Assignee: Mingliang Liu > DatanodeStorage.isValidStorageId() is broken > -

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128939#comment-15128939 ] Mingliang Liu commented on HDFS-9739: - Thanks [~kihwal] for reporting this. The patch

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Attachment: HDFS-9739.000.patch The v0 patch simply adds the {{UUID.fromString}} back. I think we an

[jira] [Updated] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9689: Assignee: (was: Mingliang Liu) > Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently >

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129039#comment-15129039 ] Mingliang Liu commented on HDFS-9739: - Thanks for your prompt reply, [~kihwal]. I teste

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Component/s: hdfs-client > DatanodeStorage.isValidStorageId() is broken > ---

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Status: Patch Available (was: Open) > DatanodeStorage.isValidStorageId() is broken > ---

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129152#comment-15129152 ] Mingliang Liu commented on HDFS-9739: - {{TestDatanodeStartupFixesLegacyStorageIDs}} is

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129363#comment-15129363 ] Mingliang Liu commented on HDFS-9503: - Hi [~shv], I believe this is an independent issu

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129799#comment-15129799 ] Mingliang Liu commented on HDFS-9739: - Thanks for the verification, review and commit,

[jira] [Commented] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-02-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15131295#comment-15131295 ] Mingliang Liu commented on HDFS-9601: - Thanks [~shv], I also think we should commit thi

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Release Note: The patch replaces -namenode option with -fs for specifying the remote name node agains

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15131382#comment-15131382 ] Mingliang Liu commented on HDFS-9503: - Thank you [~shv] for your review and commit. Tha

[jira] [Commented] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133276#comment-15133276 ] Mingliang Liu commented on HDFS-9761: - Thanks for reporting this, [~abridgett] Seems t

[jira] [Commented] (HDFS-8890) Allow admin to specify which blockpools the balancer should run on

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133280#comment-15133280 ] Mingliang Liu commented on HDFS-8890: - Hi [~mingma] and [~ctrezzo], can you comment on

[jira] [Assigned] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9761: --- Assignee: Mingliang Liu > Rebalancer sleeps too long between iterations >

[jira] [Updated] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9761: Attachment: HDFS-9761.000.patch > Rebalancer sleeps too long between iterations > ---

[jira] [Updated] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9761: Status: Patch Available (was: Open) > Rebalancer sleeps too long between iterations > --

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133391#comment-15133391 ] Mingliang Liu commented on HDFS-9579: - The test results seem good to me. Specifically,

[jira] [Commented] (HDFS-9755) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 2]

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133567#comment-15133567 ] Mingliang Liu commented on HDFS-9755: - {{TestDatanodeStartupFixesLegacyStorageIDs}} fai

[jira] [Created] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9765: --- Summary: TestBlockScanner#testVolumeIteratorWithCaching fails intermittently Key: HDFS-9765 URL: https://issues.apache.org/jira/browse/HDFS-9765 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9765: Affects Version/s: 2.8.0 3.0.0 > TestBlockScanner#testVolumeIteratorWithCachin

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133596#comment-15133596 ] Mingliang Liu commented on HDFS-9139: - {code:title=org/apache/hadoop/hdfs/server/datano

[jira] [Created] (HDFS-9766) TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9766: --- Summary: TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently Key: HDFS-9766 URL: https://issues.apache.org/jira/browse/HDFS-9766 Project: Hadoop HDFS

[jira] [Created] (HDFS-9767) TestFileAppend# fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9767: --- Summary: TestFileAppend# fails intermittently Key: HDFS-9767 URL: https://issues.apache.org/jira/browse/HDFS-9767 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9767) TestFileAppend#testMultipleAppends fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9767: Summary: TestFileAppend#testMultipleAppends fails intermittently (was: TestFileAppend# fails intermi

[jira] [Commented] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133625#comment-15133625 ] Mingliang Liu commented on HDFS-9761: - {{hadoop.hdfs.TestRollingUpgrade}} seems flaky a

[jira] [Commented] (HDFS-9766) TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133685#comment-15133685 ] Mingliang Liu commented on HDFS-9766: - There is a 0.1 seconds sleep, which is placed wr

[jira] [Updated] (HDFS-9767) TestFileAppend#testMultipleAppends fails intermittently

2016-02-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9767: Affects Version/s: 2.8.0 > TestFileAppend#testMultipleAppends fails intermittently >

[jira] [Commented] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

2016-02-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15135248#comment-15135248 ] Mingliang Liu commented on HDFS-9765: - Increasing the time out seems fine to me. > Tes

[jira] [Commented] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15135339#comment-15135339 ] Mingliang Liu commented on HDFS-9761: - Thanks [~ctrezzo] for review and [~cnauroth] for

[jira] [Updated] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-7661: Attachment: HDFS-EC-file-flush-sync-design-V2.pdf > Erasure coding: support hflush and hsync > --

[jira] [Updated] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-7661: Attachment: (was: HDFS-EC-file-flush-sync-design-V2.pdf) > Erasure coding: support hflush and hsy

[jira] [Commented] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143844#comment-15143844 ] Mingliang Liu commented on HDFS-9794: - Thanks for working on this, [~jingzhao]. Determi

[jira] [Commented] (HDFS-9691) TestBlockManagerSafeMode#testCheckSafeMode fails intermittently

2016-02-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146949#comment-15146949 ] Mingliang Liu commented on HDFS-9691: - Thanks for your review and commit, [~ajisakaa]!

[jira] [Commented] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15149102#comment-15149102 ] Mingliang Liu commented on HDFS-9815: - The change is straightforward for me to +1 (non-

[jira] [Updated] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-7661: Attachment: HDFS-EC-file-flush-sync-design-version2.0.pdf Thanks for working on this [~demongaorui].

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151729#comment-15151729 ] Mingliang Liu commented on HDFS-7661: - Thanks [~drankye] and [~sinall] for your prompt

[jira] [Commented] (HDFS-9825) Balancer should not terminate if only one of the namenodes has error

2016-02-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153243#comment-15153243 ] Mingliang Liu commented on HDFS-9825: - The fix looks pretty good to me. +1 (non-binding

[jira] [Updated] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9716: Component/s: erasure-coding > o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk > -

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154840#comment-15154840 ] Mingliang Liu commented on HDFS-9716: - Is it my imagination or the test is missing in t

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157483#comment-15157483 ] Mingliang Liu commented on HDFS-7661: - Hi [~zhz], thanks for proposing to re-use trunca

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157533#comment-15157533 ] Mingliang Liu commented on HDFS-7661: - Hi [~demongaorui], Yes your example makes sense

[jira] [Created] (HDFS-9846) Make DelegationTokenFetcher a Tool

2016-02-22 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9846: --- Summary: Make DelegationTokenFetcher a Tool Key: HDFS-9846 URL: https://issues.apache.org/jira/browse/HDFS-9846 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15158246#comment-15158246 ] Mingliang Liu commented on HDFS-7661: - Hi [~sinall], {{upgrade/rollback}} seems too hea

[jira] [Updated] (HDFS-9846) Make DelegationTokenFetcher a Tool

2016-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9846: Component/s: tools > Make DelegationTokenFetcher a Tool > -- > >

[jira] [Commented] (HDFS-9851) Name node throws NPE when setPermission is called on a path that does not exist

2016-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15160296#comment-15160296 ] Mingliang Liu commented on HDFS-9851: - The expected exception should be {{java.io.FileN

[jira] [Resolved] (HDFS-9846) Make DelegationTokenFetcher a Tool

2016-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-9846. - Resolution: Won't Fix > Make DelegationTokenFetcher a Tool > -- > >

[jira] [Commented] (HDFS-9846) Make DelegationTokenFetcher a Tool

2016-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15163534#comment-15163534 ] Mingliang Liu commented on HDFS-9846: - Thanks for pointing out [HADOOP-12563] which I m

[jira] [Commented] (HDFS-9851) Name node throws NPE when setPermission is called on a path that does not exist

2016-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15163575#comment-15163575 ] Mingliang Liu commented on HDFS-9851: - Guarding in {{checkOwner}} seems ok to me. {cod

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15166613#comment-15166613 ] Mingliang Liu commented on HDFS-7661: - Thanks for you comments, [~drankye]. 1. Augment

[jira] [Commented] (HDFS-9766) TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently

2016-02-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15170122#comment-15170122 ] Mingliang Liu commented on HDFS-9766: - Using {{waitFor}} is much better than the fixed-

[jira] [Created] (HDFS-9002) Move o.a.h.hdfs.net/*Peer to client module

2015-09-01 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9002: --- Summary: Move o.a.h.hdfs.net/*Peer to client module Key: HDFS-9002 URL: https://issues.apache.org/jira/browse/HDFS-9002 Project: Hadoop HDFS Issue Type: Sub-ta

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer to client module

2015-09-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Attachment: HDFS-9002.000.patch > Move o.a.h.hdfs.net/*Peer to client module > --

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

2015-09-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Summary: Move o.a.h.hdfs.net/*Peer classes to client module (was: Move o.a.h.hdfs.net/*Peer to clien

[jira] [Commented] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

2015-09-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726249#comment-14726249 ] Mingliang Liu commented on HDFS-9002: - The v0 patch moves the {{Peer}} sub-classes to t

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

2015-09-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Description: This jira tracks the effort of moving the following two parts to {{hadoop-hdfs-client}}

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

2015-09-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Status: Patch Available (was: Open) > Move o.a.h.hdfs.net/*Peer classes to client module > -

[jira] [Updated] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2015-09-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8999: Description: This comes out of a discussion in HDFS-8763. Pasting [~jingzhao]'s comment from the jir

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

2015-09-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Attachment: HDFS-9002.001.patch The v1 patch addressed [~wheat9]'s comments about moving the static h

[jira] [Created] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

2015-09-02 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9010: --- Summary: Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key Key: HDFS-9010 URL: https://issues.apache.org/jira/browse/HDFS-9010

[jira] [Updated] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

2015-09-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9010: Attachment: HDFS-9010.000.patch The v0 patch replaced the {{NameNode.DEFAULT_PORT}} with the {{HdfsC

[jira] [Updated] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

2015-09-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9010: Status: Patch Available (was: Open) > Replace NameNode.DEFAULT_PORT with > HdfsClientConfigKeys.DFS

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

2015-09-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Attachment: HDFS-9002.002.patch The v002 patch rebases from trunk, fixes one javadoc warning, and res

[jira] [Created] (HDFS-9012) Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module

2015-09-02 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9012: --- Summary: Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module Key: HDFS-9012 URL: https://issues.apache.org/jira/browse/HDFS-9012 Projec

<    1   2   3   4   5   6   7   8   9   10   >