[jira] [Issue Comment Deleted] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Comment: was deleted (was: Thanks [~ayushtkn] pick up this JIRA. {quote}If the immediate parent

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064243#comment-17064243 ] Xiaoqiao He commented on HDFS-15075: Thanks [~elgoiri] for your comments, v006 try to update

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.008.patch > RBF: Propose to revoke WRITE MountTableEntry privilege to super

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064253#comment-17064253 ] Xiaoqiao He commented on HDFS-12733: Hi [~shv],[~brahmareddy],[~elgoiri],[~ayushtkn], Sorry for

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064245#comment-17064245 ] Xiaoqiao He commented on HDFS-15051: v008 change permission check logic just EXECUTE if immediate

[jira] [Commented] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064569#comment-17064569 ] Xiaoqiao He commented on HDFS-15169: Attach Jenkins result link

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064506#comment-17064506 ] Xiaoqiao He commented on HDFS-15113: Thanks [~weichiu]. Please refer Yetus result:

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064541#comment-17064541 ] Xiaoqiao He commented on HDFS-15075: Thanks [~elgoiri] for your good catches, v007 try to update the

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.007.patch > Remove process command timing from BPServiceActor >

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: (was: HDFS-13183.addendum.patch) > Standby NameNode process getBlocks request to

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.addendum.patch > Standby NameNode process getBlocks request to reduce Active

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112463#comment-17112463 ] Xiaoqiao He commented on HDFS-13183: Thanks [~Jim_Brennan] for your information. I think TestBalancer

[jira] [Commented] (HDFS-15366) Active NameNode went down with NPE

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112485#comment-17112485 ] Xiaoqiao He commented on HDFS-15366: HDFS-12832 could solve this issue. The root cause is that access

[jira] [Updated] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15280: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) > Datanode delay random time

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.addendum.patch > Standby NameNode process getBlocks request to reduce Active

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112468#comment-17112468 ] Xiaoqiao He commented on HDFS-15280: Hi [~hadoop_yangyun], I will close this JIRA if HDFS-7923 could

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1770#comment-1770 ] Xiaoqiao He commented on HDFS-12733: Hi [~ayushtkn] [~elgoiri], [^HDFS-12733.009.patch] I try to add

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: (was: HDFS-12733.009.patch) > Option to disable to namenode local edits >

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: HDFS-12733.009.patch > Option to disable to namenode local edits >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112857#comment-17112857 ] Xiaoqiao He commented on HDFS-13183: After dig deep about BalancerWithObserver, the root cause of

[jira] [Created] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-21 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15368: -- Summary: TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally Key: HDFS-15368 URL: https://issues.apache.org/jira/browse/HDFS-15368 Project: Hadoop

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15368: --- Attachment: HDFS-15368.001.patch Status: Patch Available (was: Open) submit demo patch and

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111707#comment-17111707 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] and [~Jim_Brennan] for your reminder, I will

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111722#comment-17111722 ] Xiaoqiao He commented on HDFS-15280: Thanks [~weichiu] involve me here. [~hadoop_yangyun], Just have

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113748#comment-17113748 ] Xiaoqiao He commented on HDFS-15368: Thanks [~vagarychen] for your information, it is easy to

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15368: --- Attachment: TestBalancerWithHANameNodes.testBalancerObserver.log >

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115332#comment-17115332 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn] for your information. Just check the changes

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15368: --- Attachment: HDFS-15368.002.patch > TestBalancerWithHANameNodes#testBalancerWithObserver failed

[jira] [Commented] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190102#comment-17190102 ] Xiaoqiao He commented on HDFS-15556: [~haiyang Hu] Great catch here. v001 is fair for me, it will be

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190162#comment-17190162 ] Xiaoqiao He commented on HDFS-14694: Thanks [~leosun08] for your continued patches. I will give my +1

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190102#comment-17190102 ] Xiaoqiao He edited comment on HDFS-15556 at 9/3/20, 12:30 PM: -- [~haiyang Hu]

[jira] [Assigned] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15551: -- Assignee: dark_num > Tiny Improve for DeadNode detector > --

[jira] [Assigned] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15551: -- Assignee: imbajin (was: dark_num) > Tiny Improve for DeadNode detector >

[jira] [Commented] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190526#comment-17190526 ] Xiaoqiao He commented on HDFS-15551: Thanks [~imbajin] involve me here. Add [~imbajin] to contributor

[jira] [Commented] (HDFS-15550) Remove unused imports from TestFileTruncate.java

2020-08-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187453#comment-17187453 ] Xiaoqiao He commented on HDFS-15550: [^HDFS-15550.001.patch] LGTM. +1 from my side. Will commit to

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2020-08-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187451#comment-17187451 ] Xiaoqiao He commented on HDFS-14703: cc [~shv]. {quote}I want to do some work on this issue ,could

[jira] [Updated] (HDFS-15550) Remove unused imports from TestFileTruncate.java

2020-08-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15550: --- Issue Type: Improvement (was: Bug) > Remove unused imports from TestFileTruncate.java >

[jira] [Updated] (HDFS-15550) Remove unused imports from TestFileTruncate.java

2020-08-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15550: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189013#comment-17189013 ] Xiaoqiao He commented on HDFS-14694: Thanks [~leosun08], [^HDFS-14694.008.patch] seems better, some

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14694: --- Fix Version/s: 3.4.0 > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14694: --- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Resolved] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15551. Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thanks [~imbajin] for your

[jira] [Commented] (HDFS-15560) The getMaxNodesPerRack May Cause "Failed to place enough replicas"

2020-09-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194073#comment-17194073 ] Xiaoqiao He commented on HDFS-15560: Thanks [~wzx513] for your report, any idea to improve it? > The

[jira] [Commented] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194072#comment-17194072 ] Xiaoqiao He commented on HDFS-15559: [~leosun08] Please rebase code, it seems that patch does not

[jira] [Commented] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194071#comment-17194071 ] Xiaoqiao He commented on HDFS-15559: Thanks [~leosun08], it makes sense to me. +1 for

[jira] [Commented] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192891#comment-17192891 ] Xiaoqiao He commented on HDFS-15516: [~jianghuazhu] Thanks for involve me here. Actually, I do not

[jira] [Updated] (HDFS-15565) Remove the invalid code in the Balancer#doBalance() method.

2020-09-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15565: --- Resolution: Not A Problem Status: Resolved (was: Patch Available) [~jianghuazhu] Thanks for

[jira] [Commented] (HDFS-15564) Add Test annotation for TestPersistBlocks#testRestartDfsWithSync

2020-09-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193346#comment-17193346 ] Xiaoqiao He commented on HDFS-15564: +1 on [^HDFS-15564.001.patch]. > Add Test annotation for

[jira] [Resolved] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15556. Resolution: Duplicate Close this issue and linked to HDFS-14042. [~haiyang Hu] Please feel free to

[jira] [Commented] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193366#comment-17193366 ] Xiaoqiao He commented on HDFS-15559: Hi [~leosun08], it seems that missed to add config for

[jira] [Updated] (HDFS-14084) Need for more stats in DFSClient

2020-09-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14084: --- Target Version/s: 3.2.3 (was: 3.2.2) Updated the target version to 3.2.3 for preparing 3.2.2

[jira] [Updated] (HDFS-14571) Command line to force volume failures

2020-09-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14571: --- Target Version/s: 3.2.3 (was: 3.2.2) Updated the target version to 3.2.3 for preparing 3.2.2

[jira] [Updated] (HDFS-14349) Edit log may be rolled more frequently than necessary with multiple Standby nodes

2020-09-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14349: --- Target Version/s: 3.2.3 (was: 3.2.2) Updated the target version to 3.2.3 for preparing 3.2.2

[jira] [Commented] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

2020-09-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194692#comment-17194692 ] Xiaoqiao He commented on HDFS-15289: [~umamaheswararao] Thanks for your great works here. we are

[jira] [Updated] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15559: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194774#comment-17194774 ] Xiaoqiao He commented on HDFS-15559: Thanks [~leosun08], [^HDFS-15559.002.patch] LGTM. Considering

[jira] [Commented] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195487#comment-17195487 ] Xiaoqiao He commented on HDFS-15559: [~leosun08] Try to run failed unit tests at local, most of them

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188476#comment-17188476 ] Xiaoqiao He commented on HDFS-15553: Thanks [~suxingfate] for your quick response. It makes sense to

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188406#comment-17188406 ] Xiaoqiao He commented on HDFS-15553: It seems to improve NameNode performance based on the proposal.

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188422#comment-17188422 ] Xiaoqiao He commented on HDFS-15553: Thanks [~suxingfate] for your interesting proposal. The initial

[jira] [Moved] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He moved HADOOP-17237 to HDFS-15553: - Component/s: (was: rpc-server) namenode

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192656#comment-17192656 ] Xiaoqiao He commented on HDFS-14694: +1, Thanks [~leosun08] and [~ayushtkn]. Try to run all failed

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2020-10-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15641: --- Target Version/s: 3.2.2, 3.3.1, 3.4.0, 3.2.3 (was: 3.2.2, 3.2.3) > DataNode could meet deadlock if

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2020-10-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15641: --- Target Version/s: 3.2.2, 3.2.3 > DataNode could meet deadlock if invoke refreshNameNode >

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

2020-10-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216705#comment-17216705 ] Xiaoqiao He commented on HDFS-15640: Thanks [~LiJinglun] involve me here. [~linyiqun] would be more

[jira] [Commented] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2020-10-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216703#comment-17216703 ] Xiaoqiao He commented on HDFS-15641: Thanks [~wanghongbing] for your report. Great catch here! mark

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2020-10-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15641: --- Status: Patch Available (was: Open) > DataNode could meet deadlock if invoke refreshNameNode >

[jira] [Commented] (HDFS-11546) Federation Router RPC server

2020-10-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217606#comment-17217606 ] Xiaoqiao He commented on HDFS-11546: [~elgoiri] Hi elgoiri, when trace RouterRpcClient source code, I

[jira] [Commented] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

2020-08-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184920#comment-17184920 ] Xiaoqiao He commented on HDFS-14997: Thanks [~Captainhzy], In my experience, process cmds async can

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186931#comment-17186931 ] Xiaoqiao He commented on HDFS-14694: Thanks [~zhangchen] and [~leosun08] for your continued works

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-08-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182340#comment-17182340 ] Xiaoqiao He commented on HDFS-15448: Thanks [~jianghuazhu] for your works here. Failed unit tested

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2020-08-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182337#comment-17182337 ] Xiaoqiao He commented on HDFS-14852: Thanks [~ferhui] for your works here. For v006, it seems not

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2020-08-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182374#comment-17182374 ] Xiaoqiao He commented on HDFS-15175: After a deep dig, I believe this case is related to async edit

[jira] [Commented] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

2020-08-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181643#comment-17181643 ] Xiaoqiao He commented on HDFS-14997: Thanks [~Captainhzy] for your comments. This improvement try to

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-08-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181660#comment-17181660 ] Xiaoqiao He commented on HDFS-15448: Hi [~jianghuazhu], Please check the failed unit tests if it is

[jira] [Updated] (HDFS-15448) Remove duplicate BlockPoolManager starting when run DataNode

2020-08-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15448: --- Summary: Remove duplicate BlockPoolManager starting when run DataNode (was: When starting a

[jira] [Updated] (HDFS-15448) Remove duplicate BlockPoolManager starting when run DataNode

2020-08-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15448: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15603) RBF: Fix getLocationsForPath twice in create operation

2020-09-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203199#comment-17203199 ] Xiaoqiao He commented on HDFS-15603: [~wangzhaohui] Great catch here. Would you like to add unit test

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204434#comment-17204434 ] Xiaoqiao He commented on HDFS-15382: Thanks [~sodonnell],[~Jiang Xin] for your comments. HDFS-15150

[jira] [Updated] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15382: --- Fix Version/s: (was: 3.2.1) > Split FsDatasetImpl from blockpool lock to blockpool volume lock

[jira] [Commented] (HDFS-14553) Make queue size of BlockReportProcessingThread configurable

2020-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204447#comment-17204447 ] Xiaoqiao He commented on HDFS-14553: Hi [~xyao], IIRC I use HDFS-5153 feature by default set

[jira] [Comment Edited] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-09-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204434#comment-17204434 ] Xiaoqiao He edited comment on HDFS-15382 at 9/30/20, 8:40 AM: -- Thanks

[jira] [Commented] (HDFS-15589) Huge PostponedMisreplicatedBlocks can't decrease immediately when start namenode after datanode

2020-09-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199870#comment-17199870 ] Xiaoqiao He commented on HDFS-15589: Thanks [~zhengchenyu] for your report. Just wonder if any impact

[jira] [Commented] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201259#comment-17201259 ] Xiaoqiao He commented on HDFS-15594: Thanks [~NickyYe] and [~elgoiri], it is useful works IMO. Just

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-09-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200157#comment-17200157 ] Xiaoqiao He commented on HDFS-15382: [~weichiu],[~sodonnell],[~linyiqun] do you have time to review

[jira] [Commented] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

2020-09-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203015#comment-17203015 ] Xiaoqiao He commented on HDFS-14997: [~Captainhzy][~sodonnell] Thanks for your comments.

[jira] [Commented] (HDFS-14553) Make queue size of BlockReportProcessingThread configurable

2020-09-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203018#comment-17203018 ] Xiaoqiao He commented on HDFS-14553: [~xyao] Thanks for your comments. {quote}does the new

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115791#comment-17115791 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn] for your confirm. Sorry not attach the result

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-05-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116541#comment-17116541 ] Xiaoqiao He commented on HDFS-15180: [~sodonnell],[~weichiu],[~junping_du] are you interested in the

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-05-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118797#comment-17118797 ] Xiaoqiao He commented on HDFS-15180: Thanks [~sodonnell] for your positive feedback. {quote} we were

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118835#comment-17118835 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn] for your help and review to fix this failed

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118784#comment-17118784 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn],

[jira] [Commented] (HDFS-15366) Active NameNode went down with NPE

2020-05-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118831#comment-17118831 ] Xiaoqiao He commented on HDFS-15366: [~saruntek] Please help to check if HDFS-12832 could solve your

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123392#comment-17123392 ] Xiaoqiao He commented on HDFS-15382: Thanks [~Aiphag0] for your proposal here. The performance

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111744#comment-17111744 ] Xiaoqiao He commented on HDFS-13183: Hi [~weichiu],[~Jim_Brennan] I am sure the failed unit test

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114287#comment-17114287 ] Xiaoqiao He commented on HDFS-15368: Thanks [~vagarychen], I try to revert

[jira] [Reopened] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reopened HDFS-13183: > Standby NameNode process getBlocks request to reduce Active load >

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.addendum.patch Status: Patch Available (was: Reopened)

[jira] [Commented] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197337#comment-17197337 ] Xiaoqiao He commented on HDFS-15548: Thanks [~LeonG] involve me here. I would like to take a look in

[jira] [Commented] (HDFS-15654) TestBPOfferService#testMissBlocksWhenReregister is flaky

2020-10-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221146#comment-17221146 ] Xiaoqiao He commented on HDFS-15654: Thanks [~ahussein] for your dig and detailed description. Would

<    1   2   3   4   5   6   7   8   9   10   >