[jira] [Comment Edited] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324224#comment-17324224 ] Xiaoqiao He edited comment on HDFS-15175 at 4/17/21, 10:17 AM: --- [~kihwal],

[jira] [Updated] (HDFS-15869) Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

[ https://issues.apache.org/jira/browse/HDFS-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15869: --- Issue Type: Improvement (was: Bug) Priority: Major (was: Critical) Add [~functioner] to the

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280404#comment-17280404 ] Xiaoqiao He commented on HDFS-15757: {quote}proxy time, this is directly impacted since the change

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280399#comment-17280399 ] Xiaoqiao He commented on HDFS-15792: Thanks [~prasad-acit] and [~sodonnell] for your continued works

[jira] [Updated] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15792: --- Fix Version/s: 2.10.2 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-16196) Namesystem#completeFile method will log incorrect path information when router to access

[ https://issues.apache.org/jira/browse/HDFS-16196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410484#comment-17410484 ] Xiaoqiao He commented on HDFS-16196: Thanks [~lei w] for your report. It is confused log for users. I

[jira] [Resolved] (HDFS-16223) AvailableSpaceRackFaultTolerantBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance.

[ https://issues.apache.org/jira/browse/HDFS-16223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16223. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Updated] (HDFS-15457) TestFsDatasetImpl fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15457: --- Fix Version/s: 3.2.4 > TestFsDatasetImpl fails intermittently >

[jira] [Updated] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15160: --- Fix Version/s: 3.2.3 > ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl >

[jira] [Updated] (HDFS-15818) Fix TestFsDatasetImpl.testReadLockCanBeDisabledByConfig

[ https://issues.apache.org/jira/browse/HDFS-15818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15818: --- Fix Version/s: 3.2.4 > Fix TestFsDatasetImpl.testReadLockCanBeDisabledByConfig >

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414794#comment-17414794 ] Xiaoqiao He commented on HDFS-15160: Thanks [~brahmareddy] for your information. I have cherry-pick

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15150: --- Fix Version/s: 3.2.4 > Introduce read write lock to Datanode > -

[jira] [Commented] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416630#comment-17416630 ] Xiaoqiao He commented on HDFS-14997: Failed unit tests seems not related to this changes. Will commit

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416727#comment-17416727 ] Xiaoqiao He commented on HDFS-15113: Cherry-pick to branch-3.2. > Missing IBR when NameNode restart

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Fix Version/s: 3.2.4 > Missing IBR when NameNode restart if open processCommand async feature >

[jira] [Updated] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Fix Version/s: 3.2.4 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416724#comment-17416724 ] Xiaoqiao He commented on HDFS-15075: Cherry-pick to branch-3.2 > Remove process command timing from

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Fix Version/s: 3.2.4 > Remove process command timing from BPServiceActor >

[jira] [Commented] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416722#comment-17416722 ] Xiaoqiao He commented on HDFS-14997: [~brahmareddy] This patch is ready now, less conflict and verify

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15651: --- Fix Version/s: 3.2.4 > Client could not obtain block when DN CommandProcessingThread exit >

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416725#comment-17416725 ] Xiaoqiao He commented on HDFS-15651: Cherry-pick to branch-3.2. > Client could not obtain block when

[jira] [Updated] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Attachment: HDFS-14997-branch-3.2.001.patch Status: Patch Available (was: Reopened) submit

[jira] [Reopened] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reopened HDFS-14997: > BPServiceActor processes commands from NameNode asynchronously >

[jira] [Updated] (HDFS-15457) TestFsDatasetImpl fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15457: --- Fix Version/s: 3.2.3 > TestFsDatasetImpl fails intermittently >

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15150: --- Fix Version/s: 3.2.3 > Introduce read write lock to Datanode > -

[jira] [Resolved] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15160. Fix Version/s: 3.2.3 Resolution: Fixed > ReplicaMap, Disk Balancer, Directory Scanner and

[jira] [Updated] (HDFS-15818) Fix TestFsDatasetImpl.testReadLockCanBeDisabledByConfig

[ https://issues.apache.org/jira/browse/HDFS-15818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15818: --- Fix Version/s: 3.2.3 > Fix TestFsDatasetImpl.testReadLockCanBeDisabledByConfig >

[jira] [Resolved] (HDFS-16194) Simplify the code with DatanodeID#getXferAddrWithHostname

[ https://issues.apache.org/jira/browse/HDFS-16194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16194. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Updated] (HDFS-16138) BlockReportProcessingThread exit doesn't print the actual stack

[ https://issues.apache.org/jira/browse/HDFS-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16138: --- Summary: BlockReportProcessingThread exit doesn't print the actual stack (was:

[jira] [Updated] (HDFS-16138) BlockReportProcessingThread exit doesn't print the actual stack

[ https://issues.apache.org/jira/browse/HDFS-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16138: --- Issue Type: Improvement (was: Bug) > BlockReportProcessingThread exit doesn't print the actual

[jira] [Resolved] (HDFS-16138) BlockReportProcessingThread exit doesn't print the actual stack

[ https://issues.apache.org/jira/browse/HDFS-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16138. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Thanks [~prasad-acit]

[jira] [Updated] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16044: --- Attachment: HDFS-16044.05.patch Hadoop Flags: (was: Reviewed) Affects

[jira] [Commented] (HDFS-16196) Namesystem#completeFile method will log incorrect path information when router to access

[ https://issues.apache.org/jira/browse/HDFS-16196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410147#comment-17410147 ] Xiaoqiao He commented on HDFS-16196: [~lei w], Thanks for you report. Which version do you deploy?

[jira] [Commented] (HDFS-16200) Improve NameNode failover

[ https://issues.apache.org/jira/browse/HDFS-16200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410148#comment-17410148 ] Xiaoqiao He commented on HDFS-16200: Thanks [~aihuaxu] for your report. I think the best way is to

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381178#comment-17381178 ] Xiaoqiao He commented on HDFS-16067: Thanks [~prasad-acit] for your update. {code:java} } + /**

[jira] [Commented] (HDFS-16146) All three replicas are lost due to not adding a new DataNode in time

[ https://issues.apache.org/jira/browse/HDFS-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389769#comment-17389769 ] Xiaoqiao He commented on HDFS-16146: Great catch here! LGTM. Thanks [~zhangshuyan] for your report

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389820#comment-17389820 ] Xiaoqiao He commented on HDFS-15175: Thanks [~sodonnell] for your reminder. cherry-pick-ed to

[jira] [Updated] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15175: --- Fix Version/s: 3.3.2 > Multiple CloseOp shared block instance causes the standby namenode to crash

[jira] [Updated] (HDFS-16146) All three replicas are lost due to not adding a new DataNode in time

[ https://issues.apache.org/jira/browse/HDFS-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16146: --- Issue Type: Improvement (was: Bug) > All three replicas are lost due to not adding a new DataNode

[jira] [Resolved] (HDFS-16146) All three replicas are lost due to not adding a new DataNode in time

[ https://issues.apache.org/jira/browse/HDFS-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16146. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Updated] (HDFS-16146) All three replicas are lost due to not adding a new DataNode in time

[ https://issues.apache.org/jira/browse/HDFS-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16146: --- Component/s: (was: hdfs) (was: datanode) dfsclient > All

[jira] [Updated] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15175: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Comment Edited] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389225#comment-17389225 ] Xiaoqiao He edited comment on HDFS-15175 at 7/29/21, 3:23 AM: -- Committed to

[jira] [Updated] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15175: --- Fix Version/s: 3.2.4 3.2.3 > Multiple CloseOp shared block instance causes the

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389232#comment-17389232 ] Xiaoqiao He commented on HDFS-15175: Backport to branch-3.2 first considering 3.2.3 is pending

[jira] [Comment Edited] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389232#comment-17389232 ] Xiaoqiao He edited comment on HDFS-15175 at 7/29/21, 3:30 AM: -- Backport to

[jira] [Assigned] (HDFS-16155) Allow configurable exponential backoff in DFSInputStream refetchLocations

[ https://issues.apache.org/jira/browse/HDFS-16155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16155: -- Assignee: Bryan Beaudreault > Allow configurable exponential backoff in DFSInputStream

[jira] [Commented] (HDFS-16155) Allow configurable exponential backoff in DFSInputStream refetchLocations

[ https://issues.apache.org/jira/browse/HDFS-16155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395135#comment-17395135 ] Xiaoqiao He commented on HDFS-16155: Thanks [~bbeaudreault] for your report and works. Add to

[jira] [Comment Edited] (HDFS-16155) Allow configurable exponential backoff in DFSInputStream refetchLocations

[ https://issues.apache.org/jira/browse/HDFS-16155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395135#comment-17395135 ] Xiaoqiao He edited comment on HDFS-16155 at 8/7/21, 7:00 AM: - Thanks

[jira] [Commented] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422055#comment-17422055 ] Xiaoqiao He commented on HDFS-14575: Thanks for reminder. Cherry-pick to branch-3.3 and

[jira] [Updated] (HDFS-16235) Deadlock in LeaseRenewer for static remove method

[ https://issues.apache.org/jira/browse/HDFS-16235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16235: --- Fix Version/s: 3.2.4 3.3.2 3.2.3 > Deadlock in LeaseRenewer

[jira] [Updated] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14575: --- Fix Version/s: 3.2.4 3.3.2 3.2.3 > LeaseRenewer#daemon threads

[jira] [Commented] (HDFS-16235) Deadlock in LeaseRenewer for static remove method

[ https://issues.apache.org/jira/browse/HDFS-16235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422054#comment-17422054 ] Xiaoqiao He commented on HDFS-16235: Cherry-pick to branch-3.3 and branch-3.2(include branch-3.2.3)

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15651: --- Fix Version/s: 3.2.3 cherry-pick to branch-3.2.3. > Client could not obtain block when DN

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Fix Version/s: 3.2.3 cherry-pick to branch-3.2.3. > Missing IBR when NameNode restart if open

[jira] [Updated] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Fix Version/s: 3.2.3 > BPServiceActor processes commands from NameNode asynchronously >

[jira] [Commented] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418516#comment-17418516 ] Xiaoqiao He commented on HDFS-14997: cherry-pick to branch-3.2 and branch-3.2.3. > BPServiceActor

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Fix Version/s: 3.2.3 cherry-pick to branch-3.2.3. > Remove process command timing from

[jira] [Resolved] (HDFS-16352) return the real datanode numBlocks in #getDatanodeStorageReport

[ https://issues.apache.org/jira/browse/HDFS-16352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16352. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443263#comment-17443263 ] Xiaoqiao He commented on HDFS-16322: Thanks [~Nsupyq] for your report. It is interesting case. I am

[jira] [Commented] (HDFS-16318) Add exception blockinfo

[ https://issues.apache.org/jira/browse/HDFS-16318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443273#comment-17443273 ] Xiaoqiao He commented on HDFS-16318: [~philipse] would you mind to add some information about

[jira] [Commented] (HDFS-16320) Datanode retrieve slownode information from NameNode

[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443283#comment-17443283 ] Xiaoqiao He commented on HDFS-16320: Thanks [~Symious] for your quick response. It is reasonable case

[jira] [Commented] (HDFS-16320) Datanode retrieve slownode information from NameNode

[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443268#comment-17443268 ] Xiaoqiao He commented on HDFS-16320: Thanks [~Symious] for your report and patch. IMO it is a little

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443550#comment-17443550 ] Xiaoqiao He commented on HDFS-16322: Thanks [~szetszwo] for your response. Considering the following

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445627#comment-17445627 ] Xiaoqiao He commented on HDFS-16322: Great, it is graceful solution to enable RetryCache for truncate

[jira] [Commented] (HDFS-16261) Configurable grace period around invalidation of replaced blocks

[ https://issues.apache.org/jira/browse/HDFS-16261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457543#comment-17457543 ] Xiaoqiao He commented on HDFS-16261: Thanks [~bbeaudreault] for your detailed analysis and

[jira] [Commented] (HDFS-16379) Reset fullBlockReportLeaseId after any exceptions

[ https://issues.apache.org/jira/browse/HDFS-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457537#comment-17457537 ] Xiaoqiao He commented on HDFS-16379: Thanks [~tomscut] involve me here. I am not sure if this is

[jira] [Resolved] (HDFS-16378) Add datanode address to BlockReportLeaseManager logs

[ https://issues.apache.org/jira/browse/HDFS-16378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16378. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Assigned] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16087: -- Assignee: Eric Yin > RBF balance process is stuck at DisableWrite stage >

[jira] [Resolved] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16087. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Commented] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383264#comment-17383264 ] Xiaoqiao He commented on HDFS-15942: cherry-pick to branch-3.2. > Increase Quota initialization

[jira] [Updated] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15942: --- Fix Version/s: 3.2.3 > Increase Quota initialization threads > -

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383261#comment-17383261 ] Xiaoqiao He commented on HDFS-15651: Thanks [~hemanthboyina] for your information. I just found that

[jira] [Updated] (HDFS-16067) Support Append API in NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16067: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-16139) Update BPServiceActor Scheduler's nextBlockReportTime atomically

[ https://issues.apache.org/jira/browse/HDFS-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386822#comment-17386822 ] Xiaoqiao He commented on HDFS-16139: Thanks [~vjasani] for your report and contributions.

[jira] [Commented] (HDFS-16138) BlockReportProcessingThread exit doesnt print the acutal stack

[ https://issues.apache.org/jira/browse/HDFS-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386824#comment-17386824 ] Xiaoqiao He commented on HDFS-16138: Thanks [~prasad-acit] involve me here. Which version do you

[jira] [Commented] (HDFS-16137) Improve the comments related to FairCallQueue#queues

[ https://issues.apache.org/jira/browse/HDFS-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386825#comment-17386825 ] Xiaoqiao He commented on HDFS-16137: +1. Thanks. > Improve the comments related to

[jira] [Assigned] (HDFS-16134) Optimize RPC throughput

[ https://issues.apache.org/jira/browse/HDFS-16134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16134: -- Assignee: JiangHua Zhu > Optimize RPC throughput > --- > >

[jira] [Commented] (HDFS-16134) Optimize RPC throughput

[ https://issues.apache.org/jira/browse/HDFS-16134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386828#comment-17386828 ] Xiaoqiao He commented on HDFS-16134: Thanks [~jianghuazhu] involve me here. HDFS-15486, HDFS-15869

[jira] [Commented] (HDFS-16139) Update BPServiceActor Scheduler's nextBlockReportTime atomically

[ https://issues.apache.org/jira/browse/HDFS-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386833#comment-17386833 ] Xiaoqiao He commented on HDFS-16139: Make sense to me. +1 from my side. > Update BPServiceActor

[jira] [Commented] (HDFS-16118) Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer

[ https://issues.apache.org/jira/browse/HDFS-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386831#comment-17386831 ] Xiaoqiao He commented on HDFS-16118: Thanks [~jianghuazhu] involve me here. IMO it is not necessary

[jira] [Updated] (HDFS-16139) Update BPServiceActor Scheduler's nextBlockReportTime atomically

[ https://issues.apache.org/jira/browse/HDFS-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16139: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Resolved] (HDFS-16131) Show storage type for failed volumes on namenode web

[ https://issues.apache.org/jira/browse/HDFS-16131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16131. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Updated] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15289: --- Target Version/s: 3.4.0, 3.3.2, 3.2.4 (was: 3.4.0, 3.2.3, 3.3.2) ===Bulk update=== planning to cut

[jira] [Updated] (HDFS-16014) Issue in checking native pmdk lib by 'hadoop checknative' command

[ https://issues.apache.org/jira/browse/HDFS-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16014: --- Target Version/s: 3.4.0, 3.2.4 (was: 3.4.0, 3.2.3) ===Bulk update=== planning to cut the branch

[jira] [Updated] (HDFS-16022) matlab mapreduce v95 demos can't run hadoop-3.2.2 run time

[ https://issues.apache.org/jira/browse/HDFS-16022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16022: --- Target Version/s: 3.2.4 (was: 3.2.2) ===Bulk update=== planning to cut the branch for Hadoop 3.2.3

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17388639#comment-17388639 ] Xiaoqiao He commented on HDFS-15175: LGTM. +1. > Multiple CloseOp shared block instance causes the

[jira] [Commented] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471308#comment-17471308 ] Xiaoqiao He commented on HDFS-16044: Thanks [~ayushtkn] for your comments. This is valuable

[jira] [Resolved] (HDFS-16418) task

[ https://issues.apache.org/jira/browse/HDFS-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16418. Resolution: Invalid Close as it is invalid JIRA. [~sundasibrar] Please feel free to reopen it if

[jira] [Updated] (HDFS-16404) Fix typo for CachingGetSpaceUsed

[ https://issues.apache.org/jira/browse/HDFS-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16404: --- Issue Type: Improvement (was: Bug) > Fix typo for CachingGetSpaceUsed >

[jira] [Resolved] (HDFS-16404) Fix typo for CachingGetSpaceUsed

[ https://issues.apache.org/jira/browse/HDFS-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16404. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Resolved] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16043. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Will

[jira] [Commented] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472752#comment-17472752 ] Xiaoqiao He commented on HDFS-16043: Thanks [~mofei] for your information. Not sure if the case is

[jira] [Commented] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476645#comment-17476645 ] Xiaoqiao He commented on HDFS-16043: Committed to branch-3.3. {quote}Now it is preliminarily

[jira] [Updated] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16043: --- Fix Version/s: 3.3.2 > Add markedDeleteBlockScrubberThread to delete blocks asynchronously >

[jira] [Resolved] (HDFS-16494) Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks()

[ https://issues.apache.org/jira/browse/HDFS-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16494. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Updated] (HDFS-16494) Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks()

[ https://issues.apache.org/jira/browse/HDFS-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16494: --- Affects Version/s: (was: 2.9.2) (was: 3.4.0) > Removed reuse of

[jira] [Resolved] (HDFS-15382) Split one FsDatasetImpl lock to block pool grain locks.

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15382. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Updated] (HDFS-15382) Split one FsDatasetImpl lock to block pool grain locks.

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15382: --- Summary: Split one FsDatasetImpl lock to block pool grain locks. (was: Split FsDatasetImpl from

[jira] [Commented] (HDFS-16214) Asynchronously collect blocks and update quota when deleting

[ https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17505255#comment-17505255 ] Xiaoqiao He commented on HDFS-16214: Thanks [~zhuxiangyi] for your proposal. It is a great idea. This

<    3   4   5   6   7   8   9   10   11   >