[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355605#comment-17355605 ] Xiaoqiao He commented on HDFS-16044: {quote}IMO, unless it's a regression only in 3.3.1 or 3.3.0, we

[jira] [Commented] (HDFS-16045) FileSystem.CACHE memory leak

[ https://issues.apache.org/jira/browse/HDFS-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352527#comment-17352527 ] Xiaoqiao He commented on HDFS-16045: Thanks [~zhuxiangyi] raise this issue here. I think it could be

[jira] [Commented] (HDFS-16043) HDFS : Delete performance optimization

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355104#comment-17355104 ] Xiaoqiao He commented on HDFS-16043: Thanks [~zhuxiangyi] for your works. It is interesting

[jira] [Resolved] (HDFS-15998) Fix NullPointException In listOpenFiles

[ https://issues.apache.org/jira/browse/HDFS-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15998. Fix Version/s: 3.3.2 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355123#comment-17355123 ] Xiaoqiao He commented on HDFS-16044: [~pilchard] Thanks for your report. Would you mind to offer

[jira] [Commented] (HDFS-16115) Asynchronously handle BPServiceActor command mechanism may result in BPServiceActor never fails even CommandProcessingThread is closed with fatal error.

[ https://issues.apache.org/jira/browse/HDFS-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376556#comment-17376556 ] Xiaoqiao He commented on HDFS-16115: I agree with you that HDFS-15651 is rough solution for this

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17374323#comment-17374323 ] Xiaoqiao He commented on HDFS-16100: Thanks [~ayushtkn] for your comments. IMO, it is safe to to

[jira] [Commented] (HDFS-16095) Add lsQuotaList command and getQuotaListing api for hdfs quota

[ https://issues.apache.org/jira/browse/HDFS-16095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375756#comment-17375756 ] Xiaoqiao He commented on HDFS-16095: [~zhuxiangyi] Thanks for involving me here. {quote}It has a

[jira] [Commented] (HDFS-16115) Asynchronously handle BPServiceActor command mechanism may result in BPServiceActor never fails even CommandProcessingThread is closed with fatal error.

[ https://issues.apache.org/jira/browse/HDFS-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375741#comment-17375741 ] Xiaoqiao He commented on HDFS-16115: [~Daniel Ma] Thanks for your report. I am not sure if HDFS-15651

[jira] [Assigned] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16100: -- Assignee: wudeyu > HA: Improve performance of Standby node transition to Active >

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372103#comment-17372103 ] Xiaoqiao He commented on HDFS-16100: Thanks [~g20141821] for your report. Add [~g20141821] to

[jira] [Commented] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372105#comment-17372105 ] Xiaoqiao He commented on HDFS-16097: Thanks [~lei w] for your report. It is good improvement! Do you

[jira] [Assigned] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16097: -- Assignee: lei w > Datanode receives ipc requests will throw NPE when datanode quickly restart

[jira] [Updated] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16097: --- Status: Patch Available (was: Open) > Datanode receives ipc requests will throw NPE when datanode

[jira] [Resolved] (HDFS-16099) Make bpServiceToActive to be volatile

[ https://issues.apache.org/jira/browse/HDFS-16099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16099. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372912#comment-17372912 ] Xiaoqiao He commented on HDFS-16100: I am not familiar to this logic, but it sounds reasonable at

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376251#comment-17376251 ] Xiaoqiao He commented on HDFS-16100: [^HDFS-16100.001.patch] it is safe to checkin and improve it for

[jira] [Commented] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause bad

[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372116#comment-17372116 ] Xiaoqiao He commented on HDFS-16093: -1 to remove DECOMMISSIONING state node from `LocatedBlocks`

[jira] [Commented] (HDFS-16102) Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to save time

[ https://issues.apache.org/jira/browse/HDFS-16102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372114#comment-17372114 ] Xiaoqiao He commented on HDFS-16102: Thanks [~lei w] for your report, It seems that your codebase is

[jira] [Commented] (HDFS-16088) Standby NameNode process getLiveDatanodeStorageReport request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372119#comment-17372119 ] Xiaoqiao He commented on HDFS-16088: Thanks [~tomscut] involve me here. It makes sense to me at first

[jira] [Commented] (HDFS-16000) HDFS : Rename performance optimization

[ https://issues.apache.org/jira/browse/HDFS-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335450#comment-17335450 ] Xiaoqiao He commented on HDFS-16000: [~zhuxiangyi] Thanks for your report and contribution. It is

[jira] [Resolved] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15561. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Updated] (HDFS-16003) ProcessReport print invalidatedBlocks should judge debug level at first

[ https://issues.apache.org/jira/browse/HDFS-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16003: --- Fix Version/s: (was: 3.3.0) > ProcessReport print invalidatedBlocks should judge debug level at

[jira] [Updated] (HDFS-16003) ProcessReport print invalidatedBlocks should judge debug level at first

[ https://issues.apache.org/jira/browse/HDFS-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16003: --- Assignee: lei w Status: Patch Available (was: Open) Add [~lei w] to contributor list and

[jira] [Commented] (HDFS-16003) ProcessReport print invalidatedBlocks should judge debug level at first

[ https://issues.apache.org/jira/browse/HDFS-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335201#comment-17335201 ] Xiaoqiao He commented on HDFS-16003: Thanks [~lei w] for your proposal. It makes sense to me. But I

[jira] [Resolved] (HDFS-15978) Solve DatanodeManager#getBlockRecoveryCommand() printing IOException

[ https://issues.apache.org/jira/browse/HDFS-15978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15978. Resolution: Fixed > Solve DatanodeManager#getBlockRecoveryCommand() printing IOException >

[jira] [Updated] (HDFS-15978) Solve DatanodeManager#getBlockRecoveryCommand() printing IOException

[ https://issues.apache.org/jira/browse/HDFS-15978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15978: --- Component/s: namanode Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Issue Type:

[jira] [Commented] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331428#comment-17331428 ] Xiaoqiao He commented on HDFS-15561: Thanks [~fengnanli] involve me here. Will have a review shortly.

[jira] [Commented] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280750#comment-17280750 ] Xiaoqiao He commented on HDFS-14575: Thanks [~Tao Yang] for your report and patch. I just find that

[jira] [Commented] (HDFS-15815) if required storageType are unavailable, log the failed reason during choosing Datanode

[ https://issues.apache.org/jira/browse/HDFS-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280742#comment-17280742 ] Xiaoqiao He commented on HDFS-15815: Hi [~hadoop_yangyun], it makes sense to me. Would you mind to

[jira] [Updated] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15792: --- Attachment: HDFS-15792-branch-2.10.003.patch > ClasscastException while loading FSImage >

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279626#comment-17279626 ] Xiaoqiao He commented on HDFS-15792: Hi [~prasad-acit], I upload 003 following your initial patch and

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275921#comment-17275921 ] Xiaoqiao He commented on HDFS-15792: [~sodonnell], Thanks for your quick response. I try to dig this

[jira] [Updated] (HDFS-15863) RBF: Validation message to be corrected in FairnessPolicyController

[ https://issues.apache.org/jira/browse/HDFS-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15863: --- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-15863) RBF: Validation message to be corrected in FairnessPolicyController

[ https://issues.apache.org/jira/browse/HDFS-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15863: --- Fix Version/s: 3.4.0 > RBF: Validation message to be corrected in FairnessPolicyController >

[jira] [Commented] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17313597#comment-17313597 ] Xiaoqiao He commented on HDFS-15942: BTW, I just found that there are many failed unit tests for HDFS

[jira] [Commented] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17313594#comment-17313594 ] Xiaoqiao He commented on HDFS-15942: +1 on [^HDFS-15942.001.patch] . Thanks [~sodonnell]. >

[jira] [Commented] (HDFS-15953) DUMMY_CLIENT_ID's verification may be invalid

[ https://issues.apache.org/jira/browse/HDFS-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315945#comment-17315945 ] Xiaoqiao He commented on HDFS-15953: Thanks [~daryn] for your kindly reminder. I try to review code

[jira] [Resolved] (HDFS-15953) DUMMY_CLIENT_ID's verification may be invalid

[ https://issues.apache.org/jira/browse/HDFS-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15953. Resolution: Not A Bug > DUMMY_CLIENT_ID's verification may be invalid >

[jira] [Updated] (HDFS-15921) Improve the log for the Storage Policy Operations

[ https://issues.apache.org/jira/browse/HDFS-15921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15921: --- Fix Version/s: 3.3.1 [~bpatel] backport to branch-3.3. Thanks. > Improve the log for the Storage

[jira] [Updated] (HDFS-15921) Improve the log for the Storage Policy Operations

[ https://issues.apache.org/jira/browse/HDFS-15921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15921: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15932) Improve the balancer error message when process exits abnormally.

[ https://issues.apache.org/jira/browse/HDFS-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15932: --- Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Updated] (HDFS-15932) Improve the balancer error message when process exits abnormally.

[ https://issues.apache.org/jira/browse/HDFS-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15932: --- Issue Type: Improvement (was: Bug) > Improve the balancer error message when process exits

[jira] [Updated] (HDFS-15863) RBF: Validation message to be corrected in FairnessPolicyController

[ https://issues.apache.org/jira/browse/HDFS-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15863: --- Issue Type: Improvement (was: Bug) > RBF: Validation message to be corrected in

[jira] [Commented] (HDFS-15863) RBF: Validation message to be corrected in FairnessPolicyController

[ https://issues.apache.org/jira/browse/HDFS-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311999#comment-17311999 ] Xiaoqiao He commented on HDFS-15863: +1 on [^HDFS-15863.005.patch]. Thanks [~prasad-acit]. > RBF:

[jira] [Commented] (HDFS-15932) Improve the balancer error message when process exits abnormally.

[ https://issues.apache.org/jira/browse/HDFS-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312004#comment-17312004 ] Xiaoqiao He commented on HDFS-15932: Trigger Jenkins manually:

[jira] [Commented] (HDFS-15921) Improve the log for the Storage Policy Operations

[ https://issues.apache.org/jira/browse/HDFS-15921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312011#comment-17312011 ] Xiaoqiao He commented on HDFS-15921: +1 on [^HDFS-15921.001.patch]. Thanks [~bpatel] for your works.

[jira] [Updated] (HDFS-15919) BlockPoolManager should log stack trace if unable to get Namenode addresses

[ https://issues.apache.org/jira/browse/HDFS-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15919: --- Fix Version/s: 3.2.3 3.4.0 3.3.1 Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-15919) BlockPoolManager should log stack trace if unable to get Namenode addresses

[ https://issues.apache.org/jira/browse/HDFS-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15919: --- Fix Version/s: 3.1.5 > BlockPoolManager should log stack trace if unable to get Namenode addresses >

[jira] [Commented] (HDFS-15919) BlockPoolManager should log stack trace if unable to get Namenode addresses

[ https://issues.apache.org/jira/browse/HDFS-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308352#comment-17308352 ] Xiaoqiao He commented on HDFS-15919: + cherry-pick to branch-3.1 > BlockPoolManager should log stack

[jira] [Updated] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15942: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300749#comment-17300749 ] Xiaoqiao He commented on HDFS-15816: Thanks [~hadoop_yangyun] for your works. Please fix the

[jira] [Resolved] (HDFS-15882) Fix incorrectly initializing RandomAccessFile based on configuration options

[ https://issues.apache.org/jira/browse/HDFS-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15882. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Updated] (HDFS-15816) Fix shouldAvoidStaleDataNodesForWrite returns when no stale node in cluster.

[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15816: --- Summary: Fix shouldAvoidStaleDataNodesForWrite returns when no stale node in cluster. (was: If NO

[jira] [Updated] (HDFS-15816) Fix shouldAvoidStaleDataNodesForWrite returns when no stale node in cluster.

[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15816: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301445#comment-17301445 ] Xiaoqiao He commented on HDFS-15868: Assign this issue to [~NargesShadab]. > Possible Resource Leak

[jira] [Assigned] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15868: -- Assignee: Narges Shadab > Possible Resource Leak in EditLogFileOutputStream >

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299258#comment-17299258 ] Xiaoqiao He commented on HDFS-15764: {quote}Does having an upper-bound on the number of replicas

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305856#comment-17305856 ] Xiaoqiao He commented on HDFS-15907: Thanks [~sodonnell] for your proposal and dig deeply. +1 from my

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305857#comment-17305857 ] Xiaoqiao He commented on HDFS-15792: Thanks [~shv] for your comments and sorry for late response.

[jira] [Updated] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15787: --- Issue Type: Improvement (was: Bug) > Remove unnecessary Lease Renew in

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306082#comment-17306082 ] Xiaoqiao He commented on HDFS-15907: [^HDFS-15907.001.patch] LGTM. +1 from my side. Will commit it

[jira] [Commented] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306081#comment-17306081 ] Xiaoqiao He commented on HDFS-15787: Thanks [~leosun08], I think it is safe to push into codebase

[jira] [Comment Edited] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306096#comment-17306096 ] Xiaoqiao He edited comment on HDFS-15787 at 3/22/21, 10:42 AM: --- Committed

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306102#comment-17306102 ] Xiaoqiao He commented on HDFS-15907: [~ayushtkn] would you mind give another checks? I just notice

[jira] [Updated] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15787: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15901) Solve the problem of DN repeated block reports occupying too many RPCs during Safemode

[ https://issues.apache.org/jira/browse/HDFS-15901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304722#comment-17304722 ] Xiaoqiao He commented on HDFS-15901: Thanks for involving me here. IIRC, we have discussed many times

[jira] [Commented] (HDFS-15894) Trace Time-consuming RPC response of certain threshold.

[ https://issues.apache.org/jira/browse/HDFS-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304740#comment-17304740 ] Xiaoqiao He commented on HDFS-15894: Thanks [~prasad-acit] for your proposal. It is useful to track

[jira] [Resolved] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15868. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk!

[jira] [Commented] (HDFS-15885) RBF: Data loss when Router setup connection timeout

[ https://issues.apache.org/jira/browse/HDFS-15885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301080#comment-17301080 ] Xiaoqiao He commented on HDFS-15885: {quote}This issue surfaced because the call from Router A

[jira] [Created] (HDFS-15885) RBF: Data loss when Router setup connection timeout

Xiaoqiao He created HDFS-15885: -- Summary: RBF: Data loss when Router setup connection timeout Key: HDFS-15885 URL: https://issues.apache.org/jira/browse/HDFS-15885 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-15856) Make write pipeline retry times configurable.

[ https://issues.apache.org/jira/browse/HDFS-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15856: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Summary: Make write pipeline retry times

[jira] [Resolved] (HDFS-15856) Make write pipeline retry times configurable.

[ https://issues.apache.org/jira/browse/HDFS-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15856. Resolution: Fixed > Make write pipeline retry times configurable. >

[jira] [Commented] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296788#comment-17296788 ] Xiaoqiao He commented on HDFS-15384: {quote}If you find any place, you can improve the documentation,

[jira] [Updated] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15384: --- Issue Type: Improvement (was: Bug) > Method getLocatedBlocks(String src, long start) of DFSClient

[jira] [Comment Edited] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296813#comment-17296813 ] Xiaoqiao He edited comment on HDFS-15384 at 3/7/21, 9:43 AM: -

[jira] [Updated] (HDFS-15882) Fix incorrectly initializing RandomAccessFile based on configuration options

[ https://issues.apache.org/jira/browse/HDFS-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15882: --- Description: `rw` Open for reading and writing. If the file does not already exist then an attempt

[jira] [Commented] (HDFS-15882) Fix incorrectly initializing RandomAccessFile based on configuration options

[ https://issues.apache.org/jira/browse/HDFS-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296816#comment-17296816 ] Xiaoqiao He commented on HDFS-15882: Thanks [~lamberken] for your report and patch. Add to

[jira] [Resolved] (HDFS-15881) Fix incorrectly initializing RandomAccessFile based on configuration options

[ https://issues.apache.org/jira/browse/HDFS-15881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15881. Resolution: Duplicate Close this issue as it is duplicated by HDFS-15882. > Fix incorrectly

[jira] [Commented] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296813#comment-17296813 ] Xiaoqiao He commented on HDFS-15384: [^HDFS-15384.004.patch] LGTM. +1 from my side. Pending

[jira] [Assigned] (HDFS-15882) Fix incorrectly initializing RandomAccessFile based on configuration options

[ https://issues.apache.org/jira/browse/HDFS-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15882: -- Assignee: Xie Lei > Fix incorrectly initializing RandomAccessFile based on configuration

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296826#comment-17296826 ] Xiaoqiao He commented on HDFS-15764: Thanks [~hadoop_yangyun] for your ping, TBH, I agree that we

[jira] [Updated] (HDFS-15384) Document getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15384: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290648#comment-17290648 ] Xiaoqiao He commented on HDFS-15715: Thanks [~zhengchenyu] involve me here. Do you mind to attach

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290654#comment-17290654 ] Xiaoqiao He commented on HDFS-15180: Thanks [~zhuqi] for your pings. This improvement has deployed in

[jira] [Commented] (HDFS-15756) RBF: Cannot get updated delegation token from zookeeper

[ https://issues.apache.org/jira/browse/HDFS-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322113#comment-17322113 ] Xiaoqiao He commented on HDFS-15756: [~zhangxiping] I am not familiar with Spark code. But I think it

[jira] [Commented] (HDFS-15985) Incorrect sorting will cause failure to load an FsImage file

[ https://issues.apache.org/jira/browse/HDFS-15985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324670#comment-17324670 ] Xiaoqiao He commented on HDFS-15985: {quote}We use Hadoop-2.9. HDFS-14617 or HDFS-14771 was

[jira] [Commented] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17325472#comment-17325472 ] Xiaoqiao He commented on HDFS-15963: [~zhangshuyan] would you like to offer another patch for

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15963: --- Fix Version/s: 3.3.1 > Unreleased volume references cause an infinite loop >

[jira] [Commented] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326431#comment-17326431 ] Xiaoqiao He commented on HDFS-15963: Committed to branch-3.3 via

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15963: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15985) Incorrect sorting will cause failure to load an FsImage file

[ https://issues.apache.org/jira/browse/HDFS-15985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17323944#comment-17323944 ] Xiaoqiao He commented on HDFS-15985: I am also concerned that how to catch the exception here. which

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15963: --- Status: Patch Available (was: Open) > Unreleased volume references cause an infinite loop >

[jira] [Assigned] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15963: -- Assignee: Shuyan Zhang > Unreleased volume references cause an infinite loop >

[jira] [Commented] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318645#comment-17318645 ] Xiaoqiao He commented on HDFS-15963: Add [~zhangshuyan] as contributor and trigger ci building. >

[jira] [Commented] (HDFS-14698) Upgrade OfflineImageViewer to be compatible with new FSImage format

[ https://issues.apache.org/jira/browse/HDFS-14698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324219#comment-17324219 ] Xiaoqiao He commented on HDFS-14698: [~jianghuazhu] Please feel free to go ahead. BTW, I do not think

[jira] [Updated] (HDFS-15987) Improve oiv tool to parse fsimage file in parallel with delimited format

[ https://issues.apache.org/jira/browse/HDFS-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15987: --- Parent: HDFS-14617 Issue Type: Sub-task (was: Improvement) > Improve oiv tool to parse

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324224#comment-17324224 ] Xiaoqiao He commented on HDFS-15175: [~kihwal], [~daryn], [~ahussein] any ideas about this corner

[jira] [Assigned] (HDFS-15869) Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

[ https://issues.apache.org/jira/browse/HDFS-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15869: -- Assignee: Haoze Wu > Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify

[jira] [Commented] (HDFS-15987) Improve oiv tool to parse fsimage file in parallel with delimited format

[ https://issues.apache.org/jira/browse/HDFS-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324222#comment-17324222 ] Xiaoqiao He commented on HDFS-15987: move this JIRA to sub-task of HDFS-14617. > Improve oiv tool to

<    2   3   4   5   6   7   8   9   10   11   >