[jira] [Updated] (HDFS-9767) TestFileAppend#testMultipleAppends fails intermittently

2016-02-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9767: Affects Version/s: 2.8.0 > TestFileAppend#testMultipleAppends fails intermittently >

[jira] [Commented] (HDFS-9766) TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133685#comment-15133685 ] Mingliang Liu commented on HDFS-9766: - There is a 0.1 seconds sleep, which is placed wrongly as

[jira] [Created] (HDFS-9767) TestFileAppend# fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9767: --- Summary: TestFileAppend# fails intermittently Key: HDFS-9767 URL: https://issues.apache.org/jira/browse/HDFS-9767 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9767) TestFileAppend#testMultipleAppends fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9767: Summary: TestFileAppend#testMultipleAppends fails intermittently (was: TestFileAppend# fails

[jira] [Commented] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133625#comment-15133625 ] Mingliang Liu commented on HDFS-9761: - {{hadoop.hdfs.TestRollingUpgrade}} seems flaky and is tracked by

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2016-02-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133596#comment-15133596 ] Mingliang Liu commented on HDFS-9139: -

[jira] [Created] (HDFS-9766) TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently

2016-02-04 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9766: --- Summary: TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently Key: HDFS-9766 URL: https://issues.apache.org/jira/browse/HDFS-9766 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15143844#comment-15143844 ] Mingliang Liu commented on HDFS-9794: - Thanks for working on this, [~jingzhao]. Determined closing

[jira] [Commented] (HDFS-9761) Rebalancer sleeps too long between iterations

2016-02-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135339#comment-15135339 ] Mingliang Liu commented on HDFS-9761: - Thanks [~ctrezzo] for review and [~cnauroth] for review and

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-01-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122295#comment-15122295 ] Mingliang Liu commented on HDFS-9700: - Nice. +1 (non-binding) > DFSClient and DFSOutputStream do not

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120452#comment-15120452 ] Mingliang Liu commented on HDFS-9677: - Thanks for the commit, [~jingzhao]! > Rename

[jira] [Commented] (HDFS-6183) TestWebHDFS may fail with "Namenode is in startup mode"

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120569#comment-15120569 ] Mingliang Liu commented on HDFS-6183: - Still happens intermittently in recent builds, e.g.

[jira] [Updated] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9677: Attachment: HDFS-9677-branch-2.000.patch Thanks for your review [~jingzhao]. Attached the patch for

[jira] [Created] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-01-27 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9716: --- Summary: o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk Key: HDFS-9716 URL: https://issues.apache.org/jira/browse/HDFS-9716 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120586#comment-15120586 ] Mingliang Liu commented on HDFS-9708: - {{hadoop.hdfs.TestRecoverStripedFile}} is flaky and tracked by

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118811#comment-15118811 ] Mingliang Liu commented on HDFS-9677: - This makes perfect sense to me. Thanks for your comment and

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.002.patch > Replace -namenode option with -fs for NNThroughputBenchmark >

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126802#comment-15126802 ] Mingliang Liu commented on HDFS-9708: - Thanks for the review and commit! We can resolve this issue ? >

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128939#comment-15128939 ] Mingliang Liu commented on HDFS-9739: - Thanks [~kihwal] for reporting this. The patch [HDFS-8979]

[jira] [Assigned] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9739: --- Assignee: Mingliang Liu > DatanodeStorage.isValidStorageId() is broken >

[jira] [Commented] (HDFS-9727) Improve the exception's log output in DataXceiver

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127501#comment-15127501 ] Mingliang Liu commented on HDFS-9727: - Specifically, {{hadoop.hdfs.TestRecoverStripedFile}} seems flaky

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127498#comment-15127498 ] Mingliang Liu commented on HDFS-9716: - Sample *Error Message* is like: {code} expected:<131072> but

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.005.patch Nice catch, [~shv]. The v5 patch is to address your latest two

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127378#comment-15127378 ] Mingliang Liu commented on HDFS-9503: - s/desirable/not desirable/ Sorry about this. > Replace

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129152#comment-15129152 ] Mingliang Liu commented on HDFS-9739: - {{TestDatanodeStartupFixesLegacyStorageIDs}} is in

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Component/s: hdfs-client > DatanodeStorage.isValidStorageId() is broken >

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Status: Patch Available (was: Open) > DatanodeStorage.isValidStorageId() is broken >

[jira] [Updated] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9689: Assignee: (was: Mingliang Liu) > Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently >

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129039#comment-15129039 ] Mingliang Liu commented on HDFS-9739: - Thanks for your prompt reply, [~kihwal]. I tested locally and

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129363#comment-15129363 ] Mingliang Liu commented on HDFS-9503: - Hi [~shv], I believe this is an independent issue which was

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Attachment: HDFS-9739.000.patch The v0 patch simply adds the {{UUID.fromString}} back. I think we

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129799#comment-15129799 ] Mingliang Liu commented on HDFS-9739: - Thanks for the verification, review and commit, [~vinayrpet]! >

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.004.patch Hi [~shv], Thanks for your insightful comments. 1. The previous

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124605#comment-15124605 ] Mingliang Liu commented on HDFS-9708: - Hi, [~ste...@apache.org], does the newly added unit tests make

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131382#comment-15131382 ] Mingliang Liu commented on HDFS-9503: - Thank you [~shv] for your review and commit. Thanks [~vinayrpet]

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Release Note: The patch replaces -namenode option with -fs for specifying the remote name node

[jira] [Commented] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-02-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131295#comment-15131295 ] Mingliang Liu commented on HDFS-9601: - Thanks [~shv], I also think we should commit this to

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-01-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124672#comment-15124672 ] Mingliang Liu commented on HDFS-9724: - Thanks for working on this, [~ajisakaa]. Patch looks good to me.

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Component/s: test > Replace -namenode option with -fs for NNThroughputBenchmark >

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.003.patch Thanks for your kind remind, [~shv]. The v3 patch is the latest one

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9708: Attachment: HDFS-9708.001.patch Thanks [~ste...@apache.org] for your suggestion. In v0 patch, I find

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157483#comment-15157483 ] Mingliang Liu commented on HDFS-7661: - Hi [~zhz], thanks for proposing to re-use truncate code. I think

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157533#comment-15157533 ] Mingliang Liu commented on HDFS-7661: - Hi [~demongaorui], Yes your example makes sense to me. If the

[jira] [Commented] (HDFS-9851) Name node throws NPE when setPermission is called on a path that does not exist

2016-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15160296#comment-15160296 ] Mingliang Liu commented on HDFS-9851: - The expected exception should be

[jira] [Commented] (HDFS-9846) Make DelegationTokenFetcher a Tool

2016-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163534#comment-15163534 ] Mingliang Liu commented on HDFS-9846: - Thanks for pointing out [HADOOP-12563] which I missed it. >

[jira] [Resolved] (HDFS-9846) Make DelegationTokenFetcher a Tool

2016-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-9846. - Resolution: Won't Fix > Make DelegationTokenFetcher a Tool > -- >

[jira] [Commented] (HDFS-9851) Name node throws NPE when setPermission is called on a path that does not exist

2016-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163575#comment-15163575 ] Mingliang Liu commented on HDFS-9851: - Guarding in {{checkOwner}} seems ok to me. {code} 282

[jira] [Updated] (HDFS-9846) Make DelegationTokenFetcher a Tool

2016-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9846: Component/s: tools > Make DelegationTokenFetcher a Tool > -- > >

[jira] [Commented] (HDFS-9867) Missing block exception should carry locatedBlocks information

2016-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171253#comment-15171253 ] Mingliang Liu commented on HDFS-9867: - Thank you [~jingzhao] for your reviewing and committing the

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166613#comment-15166613 ] Mingliang Liu commented on HDFS-7661: - Thanks for you comments, [~drankye]. 1. Augmenting the crc

[jira] [Updated] (HDFS-9867) Missing block exception should carry locatedBlocks information

2016-02-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9867: Status: Patch Available (was: Open) > Missing block exception should carry locatedBlocks

[jira] [Created] (HDFS-9867) Missing block exception should carry locatedBlocks information

2016-02-26 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9867: --- Summary: Missing block exception should carry locatedBlocks information Key: HDFS-9867 URL: https://issues.apache.org/jira/browse/HDFS-9867 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9867) Missing block exception should carry locatedBlocks information

2016-02-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9867: Attachment: HDFS-9867.000.patch > Missing block exception should carry locatedBlocks information >

[jira] [Updated] (HDFS-9867) Missing block exception should carry locatedBlocks information

2016-02-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9867: Component/s: erasure-coding > Missing block exception should carry locatedBlocks information >

[jira] [Commented] (HDFS-9766) TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently

2016-02-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170122#comment-15170122 ] Mingliang Liu commented on HDFS-9766: - Using {{waitFor}} is much better than the fixed- time sleep,

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-02-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170428#comment-15170428 ] Mingliang Liu commented on HDFS-9579: - The latest patch looks pretty good to me overall. Nice work.

[jira] [Created] (HDFS-9846) Make DelegationTokenFetcher a Tool

2016-02-22 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9846: --- Summary: Make DelegationTokenFetcher a Tool Key: HDFS-9846 URL: https://issues.apache.org/jira/browse/HDFS-9846 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158246#comment-15158246 ] Mingliang Liu commented on HDFS-7661: - Hi [~sinall], {{upgrade/rollback}} seems too heavy for this

[jira] [Assigned] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9677: --- Assignee: Mingliang Liu > Rename generationStampV1/generationStampV2 to >

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Status: Patch Available (was: Open) > Replace -namenode option with -fs for NNThroughputBenchmark >

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Affects Version/s: (was: 2.8.0) Target Version/s: 3.0.0 (was: 2.8.0) Status:

[jira] [Assigned] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9672: --- Assignee: Mingliang Liu > o.a.h.hdfs.TestLeaseRecovery2 fails intermittently >

[jira] [Updated] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9672: Status: Patch Available (was: Open) > o.a.h.hdfs.TestLeaseRecovery2 fails intermittently >

[jira] [Updated] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9672: Attachment: HDFS-9672.000.patch > o.a.h.hdfs.TestLeaseRecovery2 fails intermittently >

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111693#comment-15111693 ] Mingliang Liu commented on HDFS-9672: - The test sets the lease period (which should not happen in real

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111745#comment-15111745 ] Mingliang Liu commented on HDFS-9672: - The mini cluster is reused for all the tests. If any of the test

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.001.patch > Replace -namenode option with -fs for NNThroughputBenchmark >

[jira] [Updated] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9672: Attachment: HDFS-9672.001.patch > o.a.h.hdfs.TestLeaseRecovery2 fails intermittently >

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113229#comment-15113229 ] Mingliang Liu commented on HDFS-9672: - Suppose the {{LeaseManager$Monitor}} is doing blocking I/O via:

[jira] [Updated] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9677: Attachment: HDFS-9677.001.patch The v1 patch fixes the failing test by reverting changes that may

[jira] [Commented] (HDFS-9691) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode#testCheckSafeMode fails intermittently

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115776#comment-15115776 ] Mingliang Liu commented on HDFS-9691: - The failing test is not related, and seems flaky which is

[jira] [Commented] (HDFS-9476) TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115775#comment-15115775 ] Mingliang Liu commented on HDFS-9476: - It happens in recent build as well, see UT log at:

[jira] [Commented] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115838#comment-15115838 ] Mingliang Liu commented on HDFS-9689: - Thanks [~iwasakims] and [~vinayrpet] for your insightful

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116453#comment-15116453 ] Mingliang Liu commented on HDFS-9672: - Thanks for the discussion, review and commit, [~jnp]! >

[jira] [Commented] (HDFS-9664) TestRollingUpgrade.testRollback failed frequently

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116320#comment-15116320 ] Mingliang Liu commented on HDFS-9664: - Perhaps there is a fundamental problem in the rolling upgrade.

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116366#comment-15116366 ] Mingliang Liu commented on HDFS-9677: - The v1 patch basically renames the {{generationStampV1}} =>

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116387#comment-15116387 ] Mingliang Liu commented on HDFS-9503: - Thank you [~vinayrpet] for your kind comment. I totally agree

[jira] [Created] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-20 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9672: --- Summary: o.a.h.hdfs.TestLeaseRecovery2 fails intermittently Key: HDFS-9672 URL: https://issues.apache.org/jira/browse/HDFS-9672 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109798#comment-15109798 ] Mingliang Liu commented on HDFS-9669: - +1 (non-binding) Default backlog value should be used here.

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109801#comment-15109801 ] Mingliang Liu commented on HDFS-9669: - I mean *configured value*. Sorry. > TcpPeerServer should

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109759#comment-15109759 ] Mingliang Liu commented on HDFS-9672: - The detailed exception message is like: {code} Running

[jira] [Updated] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9672: Description: It fails in recent builds, see:

[jira] [Updated] (HDFS-9691) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode#testCheckSafeMode fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9691: Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-9691) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode#testCheckSafeMode fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9691: Attachment: HDFS-9691.000.patch >

[jira] [Commented] (HDFS-9691) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode#testCheckSafeMode fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113905#comment-15113905 ] Mingliang Liu commented on HDFS-9691: - The monitor thread {{smmthread}} in {{BlockManagerSafeMode}}

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113911#comment-15113911 ] Mingliang Liu commented on HDFS-9677: - The failing tests seem unrelated. Specially, the

[jira] [Created] (HDFS-9691) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9691: --- Summary: o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently Key: HDFS-9691 URL: https://issues.apache.org/jira/browse/HDFS-9691

[jira] [Updated] (HDFS-9691) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode#testCheckSafeMode fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9691: Summary: o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode#testCheckSafeMode fails

[jira] [Updated] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9689: Status: Open (was: Patch Available) > Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently >

[jira] [Commented] (HDFS-7695) Intermittent failures in TestOpenFilesWithSnapshot

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113947#comment-15113947 ] Mingliang Liu commented on HDFS-7695: - The {{MiniDFSCluster}} does not keep rpc port when restarting

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114136#comment-15114136 ] Mingliang Liu commented on HDFS-9672: - Failing tests are not related. Specially,

[jira] [Commented] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114132#comment-15114132 ] Mingliang Liu commented on HDFS-9689: - If the port changes during {{MiniDFSCluster#restartNameNode()}},

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114134#comment-15114134 ] Mingliang Liu commented on HDFS-9503: - The failing tests seem unrelated. [~shv] Would you kindly

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118239#comment-15118239 ] Mingliang Liu commented on HDFS-9708: - Will

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9708: Attachment: HDFS-9708.000.patch > FSNamesystem.initAuditLoggers() doesn't trim classnames >

[jira] [Assigned] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9708: --- Assignee: Mingliang Liu > FSNamesystem.initAuditLoggers() doesn't trim classnames >

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9708: Status: Patch Available (was: Open) > FSNamesystem.initAuditLoggers() doesn't trim classnames >

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1583#comment-1583 ] Mingliang Liu commented on HDFS-9677: - The "legacy" is along with the old name e.g.

[jira] [Commented] (HDFS-7101) Potential null dereference in DFSck#doWork()

2016-01-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113530#comment-15113530 ] Mingliang Liu commented on HDFS-7101: - This is a good catch, and the initial value makes sense to me.

[jira] [Updated] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9677: Attachment: HDFS-9677.000.patch The v0 patch is to rename the variables and methods according to the

<    3   4   5   6   7   8   9   10   11   12   >