[jira] [Commented] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873435#comment-16873435 ] He Xiaoqiao commented on HDFS-14429: Thanks [~caiyicong], I try to verify at local, it runs as

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873368#comment-16873368 ] He Xiaoqiao commented on HDFS-12703: re-upload patch [^HDFS-12703.003.patch] and try to fix

[jira] [Updated] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12703: --- Attachment: HDFS-12703.003.patch > Exceptions are fatal to decommissioning monitor >

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873332#comment-16873332 ] He Xiaoqiao commented on HDFS-11246: rebase trunk and re-upload patch [^HDFS-11246.006.patch] which

[jira] [Updated] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-11246: --- Attachment: HDFS-11246.006.patch > FSNameSystem#logAuditEvent should be called outside the read or

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873185#comment-16873185 ] He Xiaoqiao commented on HDFS-12703: re-submit patch same as [^HDFS-12703.001.patch] via [~xuel1] and

[jira] [Updated] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12703: --- Attachment: HDFS-12703.002.patch > Exceptions are fatal to decommissioning monitor >

[jira] [Comment Edited] (HDFS-12862) CacheDirective may invalidata,when NN restart or make a transition to Active.

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873175#comment-16873175 ] He Xiaoqiao edited comment on HDFS-12862 at 6/26/19 10:00 AM: -- Thanks [~Wang

[jira] [Commented] (HDFS-12862) CacheDirective may invalidata,when NN restart or make a transition to Active.

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873175#comment-16873175 ] He Xiaoqiao commented on HDFS-12862: Thanks [~Wang XL] for reporting and working on this issue. The

[jira] [Commented] (HDFS-14586) Trash missing delete the folder which near timeout checkpoint

2019-06-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872976#comment-16872976 ] He Xiaoqiao commented on HDFS-14586: Thanks [~huyongfa], some minor comment, a. Please update patch

[jira] [Updated] (HDFS-14598) Findbugs warning caused by HDFS-12487

2019-06-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14598: --- Assignee: He Xiaoqiao Attachment: HDFS-14598.001.patch Status: Patch Available (was:

[jira] [Commented] (HDFS-14586) Trash missing delete the folder which near timeout checkpoint

2019-06-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871095#comment-16871095 ] He Xiaoqiao commented on HDFS-14586: One thought about this issue. As you said, it still may be late

[jira] [Commented] (HDFS-12862) CacheDirective may invalidata,when NN restart or make a transition to Active.

2019-06-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871090#comment-16871090 ] He Xiaoqiao commented on HDFS-12862: [~Wang XL], Thanks for your report and patch. a. Please fix

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870867#comment-16870867 ] He Xiaoqiao commented on HDFS-12914: [~jojochuang] Thanks for your reviews and commit. It seems that

[jira] [Comment Edited] (HDFS-14586) Trash missing delete the folder which near timeout checkpoint

2019-06-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870863#comment-16870863 ] He Xiaoqiao edited comment on HDFS-14586 at 6/24/19 7:01 AM: - It makes sense

[jira] [Commented] (HDFS-14586) Trash missing delete the folder which near timeout checkpoint

2019-06-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870863#comment-16870863 ] He Xiaoqiao commented on HDFS-14586: It makes sense at first sight. But I am also going to concern if

[jira] [Commented] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870846#comment-16870846 ] He Xiaoqiao commented on HDFS-14429: Thanks [~caiyicong] for your report and patch, this is good

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870574#comment-16870574 ] He Xiaoqiao commented on HDFS-11242: Thanks [~larsfrancke] for your doubt and the detailed comments.

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870558#comment-16870558 ] He Xiaoqiao commented on HDFS-12914: I found failed unit tests also failed before patch. Any changes

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870557#comment-16870557 ] He Xiaoqiao commented on HDFS-11242: Thanks [~larsfrancke] for your quick response. IIUC, namenode

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870542#comment-16870542 ] He Xiaoqiao commented on HDFS-11242: It looks like a good idea in some ways. But I do not think we

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2019-06-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870292#comment-16870292 ] He Xiaoqiao commented on HDFS-11246: Thanks [~kshukla] for your great work. do you still work on this

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870289#comment-16870289 ] He Xiaoqiao commented on HDFS-12914: submit [^HDFS-12914.branch-3.1.002.patch] for branch-3.1 and

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Attachment: HDFS-12914.branch-3.1.002.patch > Block report leases cause missing blocks until next

[jira] [Commented] (HDFS-14586) Trash missing delete the folder which near timeout checkpoint

2019-06-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870157#comment-16870157 ] He Xiaoqiao commented on HDFS-14586: [~jojochuang] Thanks for involving. I believe they are the same

[jira] [Commented] (HDFS-14587) Support fail fast when client wait ACK by pipeline over threshold

2019-06-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869184#comment-16869184 ] He Xiaoqiao commented on HDFS-14587: Thanks [~jojochuang] for the helpful information, I will check

[jira] [Created] (HDFS-14587) Support fail fast when client wait ACK by pipeline over threshold

2019-06-20 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14587: -- Summary: Support fail fast when client wait ACK by pipeline over threshold Key: HDFS-14587 URL: https://issues.apache.org/jira/browse/HDFS-14587 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14584) Namenode crashes with "RedundancyMonitor thread received Runtime exception"

2019-06-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868804#comment-16868804 ] He Xiaoqiao commented on HDFS-14584: {quote}Are you pointing to something fixed in HADOOP-16028

[jira] [Commented] (HDFS-14584) Namenode crashes with "RedundancyMonitor thread received Runtime exception"

2019-06-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868746#comment-16868746 ] He Xiaoqiao commented on HDFS-14584: I found the following code will run unexpected, and I will

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868698#comment-16868698 ] He Xiaoqiao commented on HDFS-14563: Thanks for the warm discussion. I would like to summarize the

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868612#comment-16868612 ] He Xiaoqiao commented on HDFS-12914: [~jojochuang] Submit [^HDFS-12914.branch-3.1.001.patch] for

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Attachment: HDFS-12914.branch-3.1.001.patch > Block report leases cause missing blocks until next

[jira] [Commented] (HDFS-14584) Namenode crashes with "RedundancyMonitor thread received Runtime exception"

2019-06-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868604#comment-16868604 ] He Xiaoqiao commented on HDFS-14584: Thanks [~ayushtkn] for your digs. I think it's better to involve

[jira] [Commented] (HDFS-14584) Namenode went down with error "RedundancyMonitor thread received Runtime exception"

2019-06-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868268#comment-16868268 ] He Xiaoqiao commented on HDFS-14584: [~mkris.re...@gmail.com], Thanks for your report, this is

[jira] [Commented] (HDFS-12862) CacheDirective may invalidata,when NN restart or make a transition to Active.

2019-06-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867911#comment-16867911 ] He Xiaoqiao commented on HDFS-12862: Thanks [~jojochuang] for your comments. I have sync the info to

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867909#comment-16867909 ] He Xiaoqiao commented on HDFS-14201: Thanks [~elgoiri] for your help and commit. It's OK that keep

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867908#comment-16867908 ] He Xiaoqiao commented on HDFS-12914: [~jojochuang] Thanks for pushing this forward, I would like to

[jira] [Commented] (HDFS-14579) In refreshNodes, avoid performing a DNS lookup while holding the write lock

2019-06-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867902#comment-16867902 ] He Xiaoqiao commented on HDFS-14579: Sorry for the late comments. To [~sodonnell] {quote}Can you

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867899#comment-16867899 ] He Xiaoqiao commented on HDFS-14563: Upload draft patch version 0.2 with maintenance interface. In

[jira] [Updated] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14563: --- Attachment: HDFS-14563.002.patch > Enhance interface about recommissioning/decommissioning >

[jira] [Comment Edited] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866538#comment-16866538 ] He Xiaoqiao edited comment on HDFS-14563 at 6/18/19 1:23 PM: - Thanks

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866547#comment-16866547 ] He Xiaoqiao commented on HDFS-14201: Run failed unit test local and both {{TestSafeMode}} and

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866538#comment-16866538 ] He Xiaoqiao commented on HDFS-14563: Thanks [~sodonnell]. {quote}If we are adding decommission /

[jira] [Commented] (HDFS-14576) Avoid block report retry and slow down namenode startup

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866216#comment-16866216 ] He Xiaoqiao commented on HDFS-14576: Thanks [~sodonnell] for your comments. {quote}we used to see a

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866154#comment-16866154 ] He Xiaoqiao commented on HDFS-14201: Thanks [~elgoiri],[~surmountian]. [^HDFS-14201.009.patch] fi the

[jira] [Updated] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14201: --- Attachment: HDFS-14201.009.patch > Ability to disallow safemode NN to become active >

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865869#comment-16865869 ] He Xiaoqiao commented on HDFS-14201: Thanks [~elgoiri] for your comment. [^HDFS-14201.008.patch]

[jira] [Updated] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14201: --- Attachment: HDFS-14201.008.patch > Ability to disallow safemode NN to become active >

[jira] [Comment Edited] (HDFS-14576) Avoid block report retry and slow down namenode startup

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865718#comment-16865718 ] He Xiaoqiao edited comment on HDFS-14576 at 6/17/19 3:56 PM: - Thanks

[jira] [Commented] (HDFS-14576) Avoid block report retry and slow down namenode startup

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865718#comment-16865718 ] He Xiaoqiao commented on HDFS-14576: Thanks [~jojochuang],[~dineshchitlangia] for your quick

[jira] [Created] (HDFS-14576) Avoid block report retry and slow down namenode startup

2019-06-17 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14576: -- Summary: Avoid block report retry and slow down namenode startup Key: HDFS-14576 URL: https://issues.apache.org/jira/browse/HDFS-14576 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865654#comment-16865654 ] He Xiaoqiao commented on HDFS-14547: +1 for [^HDFS-14547.005.patch], Please pending [~xkrogen] give

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865624#comment-16865624 ] He Xiaoqiao commented on HDFS-14201: update patch [^HDFS-14201.007.patch] and fix checkstyle. check

[jira] [Updated] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14201: --- Attachment: HDFS-14201.007.patch > Ability to disallow safemode NN to become active >

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865045#comment-16865045 ] He Xiaoqiao commented on HDFS-14201: Just rebase and re-upload [^HDFS-14201.006.patch], pending

[jira] [Updated] (HDFS-14201) Ability to disallow safemode NN to become active

2019-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14201: --- Attachment: HDFS-14201.006.patch > Ability to disallow safemode NN to become active >

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865029#comment-16865029 ] He Xiaoqiao commented on HDFS-14547: [~LiJinglun] Please notice report via HadoopQA. {code:java}

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865025#comment-16865025 ] He Xiaoqiao commented on HDFS-12914: Thanks [~jojochuang], Please feel free to decide if rebase and

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Attachment: HDFS-12914.utfix.patch > Block report leases cause missing blocks until next report >

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Attachment: HDFS-12914.009.patch > Block report leases cause missing blocks until next report >

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864571#comment-16864571 ] He Xiaoqiao commented on HDFS-12914: Thanks for your quick feedback and report, I will check this

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864565#comment-16864565 ] He Xiaoqiao commented on HDFS-14563: Thanks [~elgoiri] for your comments. I will update with your

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864562#comment-16864562 ] He Xiaoqiao commented on HDFS-12914: Thanks [~jojochuang], it seems to miss #TestBlockReportLease

[jira] [Comment Edited] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864352#comment-16864352 ] He Xiaoqiao edited comment on HDFS-14563 at 6/14/19 6:50 PM: - Thanks

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864352#comment-16864352 ] He Xiaoqiao commented on HDFS-14563: Thanks [~sodonnell] for your detailed analysis. I believe that

[jira] [Updated] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14563: --- Attachment: HDFS-14563.001.patch Status: Patch Available (was: Open) > Enhance interface

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864224#comment-16864224 ] He Xiaoqiao commented on HDFS-14563: [~sodonnell],[~elgoiri] thanks for your discussion and sorry

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863688#comment-16863688 ] He Xiaoqiao commented on HDFS-14547: Thanks [~LiJinglun] for the great work.

[jira] [Commented] (HDFS-14562) The behaviour of getContentSummaryInt() in getQuotaUsage() should be configurable.

2019-06-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862808#comment-16862808 ] He Xiaoqiao commented on HDFS-14562: hi [~LiJinglun], thanks for your reports. it seems that there

[jira] [Commented] (HDFS-14559) Optimizing safemode leave mechanism

2019-06-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862335#comment-16862335 ] He Xiaoqiao commented on HDFS-14559: Thanks [~jojochuang]. Actually I configure the threshold 100%.

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862328#comment-16862328 ] He Xiaoqiao commented on HDFS-12914: [~elgoiri],[~jojochuang] any furthermore comments about

[jira] [Commented] (HDFS-14560) Allow block replication parameters to be refreshable

2019-06-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862326#comment-16862326 ] He Xiaoqiao commented on HDFS-14560: +1 for [^HDFS-14560.004.patch]. Thanks [~sodonnell] for your

[jira] [Comment Edited] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862322#comment-16862322 ] He Xiaoqiao edited comment on HDFS-14563 at 6/12/19 5:58 PM: - Thanks

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862322#comment-16862322 ] He Xiaoqiao commented on HDFS-14563: Thanks [~elgoiri],[~kihwal] for your valuable comments. I am

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862226#comment-16862226 ] He Xiaoqiao commented on HDFS-14547: [~LiJinglun], Thanks for your ping. just quick review

[jira] [Updated] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14547: --- Status: Patch Available (was: Open) > DirectoryWithQuotaFeature.quota costs additional memory even

[jira] [Created] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-12 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14563: -- Summary: Enhance interface about recommissioning/decommissioning Key: HDFS-14563 URL: https://issues.apache.org/jira/browse/HDFS-14563 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14560) Allow block replication parameters to be refreshable

2019-06-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861224#comment-16861224 ] He Xiaoqiao commented on HDFS-14560: another thought based on this issue: there are many parameters

[jira] [Commented] (HDFS-14553) Make queue size of BlockReportProcessingThread configurable

2019-06-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860925#comment-16860925 ] He Xiaoqiao commented on HDFS-14553: {quote}Worth noting that we had a few experience with "Block

[jira] [Created] (HDFS-14559) Optimizing safemode leave mechanism

2019-06-11 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14559: -- Summary: Optimizing safemode leave mechanism Key: HDFS-14559 URL: https://issues.apache.org/jira/browse/HDFS-14559 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-14303) chek block directory logic not correct when there is only meta file, print no meaning warn log

2019-06-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860726#comment-16860726 ] He Xiaoqiao commented on HDFS-14303: Thanks [~iamgd67] for the ping. It looks that failed when

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860702#comment-16860702 ] He Xiaoqiao commented on HDFS-12914: Thanks [~elgoiri]. [~jojochuang] do you mind give another

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860696#comment-16860696 ] He Xiaoqiao commented on HDFS-14513: Thanks [~elgoiri], do we need any other guys reviews? > FSImage

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860216#comment-16860216 ] He Xiaoqiao commented on HDFS-12914: Thanks [~elgoiri], [^HDFS-12914.008.patch] fix fail about check

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Attachment: HDFS-12914.008.patch > Block report leases cause missing blocks until next report >

[jira] [Updated] (HDFS-14554) Avoid to process duplicate blockreport of datanode when namenode in startup safemode

2019-06-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14554: --- Resolution: Implemented Status: Resolved (was: Patch Available) This feature has

[jira] [Comment Edited] (HDFS-14554) Avoid to process duplicate blockreport of datanode when namenode in startup safemode

2019-06-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859397#comment-16859397 ] He Xiaoqiao edited comment on HDFS-14554 at 6/9/19 8:04 AM: submit initial

[jira] [Updated] (HDFS-14554) Avoid to process duplicate blockreport of datanode when namenode in startup safemode

2019-06-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14554: --- Attachment: HDFS-14554.001.patch Status: Patch Available (was: Open) submit initial patch

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859357#comment-16859357 ] He Xiaoqiao commented on HDFS-12914: Thanks [~jojochuang],[~starphin] for reviews. check the failed

[jira] [Updated] (HDFS-14553) Make queue size of BlockReportProcessingThread configurable

2019-06-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14553: --- Attachment: HDFS-14553.001.patch Status: Patch Available (was: Open) submit the

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859273#comment-16859273 ] He Xiaoqiao commented on HDFS-12914: {quote}No need to register again just in case of full block

[jira] [Updated] (HDFS-14554) Avoid to process duplicate blockreport of datanode when namenode in startup safemode

2019-06-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14554: --- Summary: Avoid to process duplicate blockreport of datanode when namenode in startup safemode (was:

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859264#comment-16859264 ] He Xiaoqiao commented on HDFS-12914: Thanks [~elgoiri],[~starphin] for your reviews. To [~elgoiri],

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Attachment: HDFS-12914.007.patch > Block report leases cause missing blocks until next report >

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Target Version/s: (was: 2.8.6, 2.9.3) > Block report leases cause missing blocks until next report

[jira] [Created] (HDFS-14554) Avoid to process duplicate blockreport of when namenode in startup safemode

2019-06-07 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14554: -- Summary: Avoid to process duplicate blockreport of when namenode in startup safemode Key: HDFS-14554 URL: https://issues.apache.org/jira/browse/HDFS-14554 Project:

[jira] [Created] (HDFS-14553) Make queue size of BlockReportProcessingThread configurable

2019-06-07 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14553: -- Summary: Make queue size of BlockReportProcessingThread configurable Key: HDFS-14553 URL: https://issues.apache.org/jira/browse/HDFS-14553 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858574#comment-16858574 ] He Xiaoqiao commented on HDFS-12914: Test TestClientProtocolForPipelineRecovery,

[jira] [Commented] (HDFS-14550) RBF: Failed to get statistics from NameNodes before 2.9.0

2019-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858394#comment-16858394 ] He Xiaoqiao commented on HDFS-14550: Thanks everyone [~aajisaka],[~elgoiri],[~crh], [~ayushtkn] for

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858392#comment-16858392 ] He Xiaoqiao commented on HDFS-12914: [^HDFS-12914.006.patch] fix checkstyle only. Test

<    1   2   3   4   5   6   7   8   9   >