[jira] [Commented] (HDFS-6524) Cdecides retry times considering with block replica number

2019-08-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915127#comment-16915127 ] Lisheng Sun commented on HDFS-6524: --- hi [~elgoiri] [~xkrogen]  Could you help take a review for this

[jira] [Updated] (HDFS-6524) Cdecides retry times considering with block replica number

2019-08-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-6524: -- Summary: Cdecides retry times considering with block replica number (was: chooseDataNode decides retry

[jira] [Assigned] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2019-08-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-12904: -- Assignee: Lisheng Sun (was: Íñigo Goiri) > Add DataTransferThrottler to the Datanode

[jira] [Commented] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915124#comment-16915124 ] Lisheng Sun commented on HDFS-14769: [~elgoiri] I would like do as your suggestion. marked this

[jira] [Updated] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14769: --- Resolution: Duplicate Status: Resolved (was: Patch Available) > Add throttler for

[jira] [Updated] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14769: --- Attachment: HDFS-14769.003.patch > Add throttler for DataNode#DataTransfer >

[jira] [Commented] (HDFS-14748) Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

2019-08-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914931#comment-16914931 ] Lisheng Sun commented on HDFS-14748: I confirmed the two UT are ok in my local. So the UT failures

[jira] [Commented] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914772#comment-16914772 ] Lisheng Sun commented on HDFS-12904: [~elgoiri] I think when the stage is

[jira] [Commented] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914771#comment-16914771 ] Lisheng Sun commented on HDFS-14769: Thank [~elgoiri] for your good suggestion.I must pay attention

[jira] [Updated] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14769: --- Status: Patch Available (was: Open) > Add throttler for DataNode#DataTransfer >

[jira] [Updated] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14769: --- Attachment: HDFS-14769.002.patch > Add throttler for DataNode#DataTransfer >

[jira] [Commented] (HDFS-14748) Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914766#comment-16914766 ] Lisheng Sun commented on HDFS-14748: Thank [~xkrogen] for your suggetions. I updated this patch and

[jira] [Updated] (HDFS-14748) Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14748: --- Attachment: HDFS-14748.003.patch > Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

[jira] [Assigned] (HDFS-6524) chooseDataNode decides retry times considering with block replica number

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-6524: - Assignee: Lisheng Sun (was: Liang Xie) > chooseDataNode decides retry times considering with

[jira] [Updated] (HDFS-6524) chooseDataNode decides retry times considering with block replica number

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-6524: -- Attachment: HDFS-6524.001.patch > chooseDataNode decides retry times considering with block replica

[jira] [Updated] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14769: --- Attachment: HDFS-14769.001.patch > Add throttler for DataNode#DataTransfer >

[jira] [Updated] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14769: --- Description: When a amount of block replicas are moving, the bandwidth will be full without

[jira] [Updated] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14769: --- Description: {code:java} /** * Do the deed, write the bytes */ @Override public void run() {

[jira] [Updated] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14769: --- Description: {code:java} /** * Do the deed, write the bytes */ @Override public void run() {

[jira] [Updated] (HDFS-14769) Add throttler for DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14769: --- Summary: Add throttler for DataNode#DataTransfer (was: DataNode#DataTransfer) > Add throttler for

[jira] [Created] (HDFS-14769) DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14769: -- Summary: DataNode#DataTransfer Key: HDFS-14769 URL: https://issues.apache.org/jira/browse/HDFS-14769 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Assigned] (HDFS-4916) DataTransfer may mask the IOException during block transfering

2019-08-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-4916: - Assignee: Lisheng Sun > DataTransfer may mask the IOException during block transfering >

[jira] [Commented] (HDFS-12241) HttpFS to support overloaded FileSystem#rename API

2019-08-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913905#comment-16913905 ] Lisheng Sun commented on HDFS-12241: hi [~jojochuang] If Httpfs implement {{FileSystem#rename(final

[jira] [Updated] (HDFS-14648) DeadNodeDetector basic model

2019-08-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Summary: DeadNodeDetector basic model (was: DeadNodeDetector state machine model) >

[jira] [Commented] (HDFS-14748) Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

2019-08-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913839#comment-16913839 ] Lisheng Sun commented on HDFS-14748: hi [~jojochuang] [~xkrogen] [~elgoiri] [~ayushtkn] Could you

[jira] [Updated] (HDFS-14648) DeadNodeDetector state machine model

2019-08-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Attachment: HDFS-14648.004.patch > DeadNodeDetector state machine model >

[jira] [Commented] (HDFS-14648) DeadNodeDetector state machine model

2019-08-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913532#comment-16913532 ] Lisheng Sun commented on HDFS-14648: uploaded the v004 patch. > DeadNodeDetector state machine model

[jira] [Commented] (HDFS-14648) DeadNodeDetector state machine model

2019-08-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913093#comment-16913093 ] Lisheng Sun commented on HDFS-14648: ping [~jojochuang] [~elgoiri]  Could you mind you help review

[jira] [Commented] (HDFS-14751) TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk

2019-08-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912454#comment-16912454 ] Lisheng Sun commented on HDFS-14751: [~jojochuang] This problem is since that two threads call

[jira] [Commented] (HDFS-14748) Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

2019-08-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912422#comment-16912422 ] Lisheng Sun commented on HDFS-14748: [~jojochuang]  Could you help review this patch? Thank you. >

[jira] [Commented] (HDFS-14751) TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk

2019-08-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912417#comment-16912417 ] Lisheng Sun commented on HDFS-14751: [~jojochuang] [~seanlook] Could you pay attention to this jira?

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2019-08-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912414#comment-16912414 ] Lisheng Sun commented on HDFS-14476: [~jojochuang] . I am my problem.  The Jira is HDFS-14751. The

[jira] [Comment Edited] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2019-08-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912397#comment-16912397 ] Lisheng Sun edited comment on HDFS-14476 at 8/21/19 3:33 PM: - [~seanlook]

[jira] [Updated] (HDFS-14751) TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk

2019-08-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14751: --- Status: Patch Available (was: Open) > TestNameNodeMetadataConsistency#testGenerationStampInFuture

[jira] [Updated] (HDFS-14751) TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk

2019-08-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14751: --- Attachment: HDFS-14751.001.patch > TestNameNodeMetadataConsistency#testGenerationStampInFuture fail

[jira] [Commented] (HDFS-14751) TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk

2019-08-20 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911412#comment-16911412 ] Lisheng Sun commented on HDFS-14751:  This issue is caused by HDFS-14476.  I revert HDFS-14476 in my

[jira] [Assigned] (HDFS-14751) TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk

2019-08-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14751: -- Assignee: Lisheng Sun > TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in

[jira] [Created] (HDFS-14751) TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk

2019-08-19 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14751: -- Summary: TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk Key: HDFS-14751 URL: https://issues.apache.org/jira/browse/HDFS-14751 Project: Hadoop

[jira] [Updated] (HDFS-14748) Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

2019-08-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14748: --- Attachment: HDFS-14748.002.patch > Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

[jira] [Commented] (HDFS-14648) DeadNodeDetector state machine model

2019-08-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910858#comment-16910858 ] Lisheng Sun commented on HDFS-14648: hi [~linyiqun] [~jojochuang], [~hexiaoqiao] [~xkrogen]

[jira] [Assigned] (HDFS-12241) HttpFS to support overloaded FileSystem#rename API

2019-08-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-12241: -- Assignee: Lisheng Sun (was: Wei-Chiu Chuang) > HttpFS to support overloaded

[jira] [Commented] (HDFS-14648) DeadNodeDetector state machine model

2019-08-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910091#comment-16910091 ] Lisheng Sun commented on HDFS-14648: Hi [~linyiqun]. Sorry, this JIRA has been off for so long. I

[jira] [Updated] (HDFS-14648) DeadNodeDetector state machine model

2019-08-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Attachment: HDFS-14648.003.patch > DeadNodeDetector state machine model >

[jira] [Commented] (HDFS-14648) DeadNodeDetector state machine model

2019-08-17 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909855#comment-16909855 ] Lisheng Sun commented on HDFS-14648: uploaded the v002 patch. > DeadNodeDetector state machine model

[jira] [Updated] (HDFS-14648) DeadNodeDetector state machine model

2019-08-17 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Status: Patch Available (was: Open) > DeadNodeDetector state machine model >

[jira] [Updated] (HDFS-14648) DeadNodeDetector state machine model

2019-08-17 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Attachment: HDFS-14648.002.patch > DeadNodeDetector state machine model >

[jira] [Updated] (HDFS-14648) DeadNodeDetector state machine model

2019-08-17 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Attachment: HDFS-14648.001.patch > DeadNodeDetector state machine model >

[jira] [Updated] (HDFS-14648) DeadNodeDetector state machine model

2019-08-17 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Description: This Jira constructs DeadNodeDetector state machine model. The function it implements

[jira] [Updated] (HDFS-14648) DeadNodeDetector state machine model

2019-08-17 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Description: This Jira constructs HADOOP-16351. (was: This Jira constructs  ) > DeadNodeDetector

[jira] [Updated] (HDFS-14648) DeadNodeDetector state machine model

2019-08-17 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Description: This Jira constructs  > DeadNodeDetector state machine model >

[jira] [Updated] (HDFS-14648) DeadNodeDetector state machine model

2019-08-17 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14648: --- Summary: DeadNodeDetector state machine model (was: Create DeadNodeDetector state machine model) >

[jira] [Assigned] (HDFS-14283) DFSInputStream to prefer cached replica

2019-08-14 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14283: -- Assignee: Lisheng Sun > DFSInputStream to prefer cached replica >

[jira] [Commented] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-12 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904915#comment-16904915 ] Lisheng Sun commented on HDFS-14708: Thank [~ayushtkn] for your reminder.  I updated the v2 patch

[jira] [Updated] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-11 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14708: --- Attachment: HDFS-14708-002.patch > TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit

[jira] [Commented] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-11 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904793#comment-16904793 ] Lisheng Sun commented on HDFS-14708: hi [~ayushtkn], [~jojochuang]  Could you help review this patch?

[jira] [Commented] (HDFS-12243) Trash emptier should use Time.monotonicNow()

2019-08-11 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904696#comment-16904696 ] Lisheng Sun commented on HDFS-12243: Hi [~jojochuang]. I see this Jira has been not updated for a

[jira] [Updated] (HDFS-12243) Trash emptier should use Time.monotonicNow()

2019-08-11 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-12243: --- Attachment: HDFS-12243.001.patch > Trash emptier should use Time.monotonicNow() >

[jira] [Assigned] (HDFS-12243) Trash emptier should use Time.monotonicNow()

2019-08-11 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-12243: -- Assignee: Lisheng Sun (was: Wei-Chiu Chuang) > Trash emptier should use Time.monotonicNow()

[jira] [Commented] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-11 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904634#comment-16904634 ] Lisheng Sun commented on HDFS-14708: Attached the v1 patch and uploaded it.   >

[jira] [Updated] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-11 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14708: --- Attachment: HDFS-14708-001.patch > TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit

[jira] [Commented] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-11 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904632#comment-16904632 ] Lisheng Sun commented on HDFS-14708: [~ayushtkn] Since  HADOOP-16452 update Increase

[jira] [Commented] (HDFS-13571) Dead DataNode Detector

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902631#comment-16902631 ] Lisheng Sun commented on HDFS-13571: Sorry [~linyiqun], I have been working on this JIRA. Recently,

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902154#comment-16902154 ] Lisheng Sun commented on HDFS-14313: the branch-2.v2 for patch fixes unchecked issue in javac. It can

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313-branch-2.v2.patch > Get hdfs used space from

[jira] [Commented] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901929#comment-16901929 ] Lisheng Sun commented on HDFS-14701: Thanx [~jojochuang] for you suggestion. I updated the patch as

[jira] [Updated] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14701: --- Attachment: HDFS-14701.002.patch > Change Log Level to warn in SlotReleaser >

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.branch-3.0.v2.patch > Get hdfs used space from

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313-branch-2.v1.patch > Get hdfs used space from

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901783#comment-16901783 ] Lisheng Sun commented on HDFS-14313: Thank [~linyiqun] for your suggestion. I rename patch for

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.branch-3.0.v1.patch > Get hdfs used space from

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901778#comment-16901778 ] Lisheng Sun commented on HDFS-14313: I attached patch for branch-3.  you hope I attach patch for 

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.branch-3.v1.patch > Get hdfs used space from

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901736#comment-16901736 ] Lisheng Sun commented on HDFS-14313: Thanx [~linyiqun] for all your work for this patch. I will 

[jira] [Assigned] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14708: -- Assignee: Lisheng Sun > TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit

[jira] [Updated] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14708: --- Description: {code:java} [ERROR]

[jira] [Created] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-06 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14708: -- Summary: TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk Key: HDFS-14708 URL: https://issues.apache.org/jira/browse/HDFS-14708 Project:

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901146#comment-16901146 ] Lisheng Sun commented on HDFS-14313: Fix UT in hadoop.conf.TestCommonConfigurationFields and other

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.014.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900863#comment-16900863 ] Lisheng Sun commented on HDFS-14313: Thank [~linyiqun] for your reminder. I rebased the code, updated

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.013.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900753#comment-16900753 ] Lisheng Sun commented on HDFS-14313: {quote} HDFS-14313 does not apply to trunk. Rebase required?

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Status: Patch Available (was: Open) > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Status: Open (was: Patch Available) > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900724#comment-16900724 ] Lisheng Sun commented on HDFS-14313: Thanx [~linyiqun] [~jojochuang] for your good suggestions.  I

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.012.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900563#comment-16900563 ] Lisheng Sun commented on HDFS-14313: Thank [~jojochuang] for your suggestion.   {quote}One thing

[jira] [Comment Edited] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900515#comment-16900515 ] Lisheng Sun edited comment on HDFS-14313 at 8/6/19 1:37 AM: Thanx  

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900515#comment-16900515 ] Lisheng Sun commented on HDFS-14313: Thanx  [~linyiqun] for your deep review. I updated this patch

[jira] [Comment Edited] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900119#comment-16900119 ] Lisheng Sun edited comment on HDFS-14701 at 8/5/19 2:32 PM: hi [~ayushtkn] 

[jira] [Commented] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900119#comment-16900119 ] Lisheng Sun commented on HDFS-14701: hi [~ayushtkn] Could you mind help review this patch? Thank

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.011.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Updated] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14701: --- Assignee: Lisheng Sun Attachment: HDFS-14701.001.patch Status: Patch Available (was:

[jira] [Updated] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14701: --- Description:  if the corresponding DataNode has been stopped or restarted and DFSClient close 

[jira] [Updated] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14701: --- Description: {code:java} // @Override public void run() { LOG.trace("{}: about to release {}",

[jira] [Updated] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14701: --- Description: {code:java} // @Override public void run() { LOG.trace("{}: about to release {}",

[jira] [Created] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-05 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14701: -- Summary: Change Log Level to warn in SlotReleaser Key: HDFS-14701 URL: https://issues.apache.org/jira/browse/HDFS-14701 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-13700) The process of loading image can be done in a pipeline model

2019-08-04 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13700: --- Description: The process of loading a file system image involves reading inodes section,

[jira] [Updated] (HDFS-13700) The process of loading image can be done in a pipeline model

2019-08-04 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13700: --- Attachment: HDFS-13700.002.patch > The process of loading image can be done in a pipeline model >

[jira] [Updated] (HDFS-13700) The process of loading image can be done in a pipeline model

2019-08-04 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13700: --- Description: The process of loading a file system image involves reading inodes section,

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-03 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899565#comment-16899565 ] Lisheng Sun commented on HDFS-14313: ping [~linyiqun] Could you mind taking a review for this patch?

<    2   3   4   5   6   7   8   9   10   >