[jira] [Updated] (HDFS-17117) Print reconstructionQueuesInitProgress periodically when BlockManager processMisReplicatesAsync.

2023-07-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17117: --- Summary: Print reconstructionQueuesInitProgress periodically when BlockManager processMisReplicatesAs

[jira] [Updated] (HDFS-17117) Print reconstructionQueuesInitProgress periodically when BlockManager processMisReplicatesAsync.

2023-07-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17117: --- Component/s: namenode > Print reconstructionQueuesInitProgress periodically when BlockManager > proc

[jira] [Resolved] (HDFS-17117) Print reconstructionQueuesInitProgress periodically when BlockManager processMisReplicatesAsync.

2023-07-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17117. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Print reconstructionQue

[jira] [Resolved] (HDFS-17116) RBF: Update invoke millisecond time as monotonicNow() in RouterSafemodeService.

2023-07-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17116. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Update invoke mill

[jira] [Updated] (HDFS-17116) RBF: Update invoke millisecond time as monotonicNow() in RouterSafemodeService.

2023-07-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17116: --- Summary: RBF: Update invoke millisecond time as monotonicNow() in RouterSafemodeService. (was: Reset

[jira] [Resolved] (HDFS-17134) RBF: Fix duplicate results of getListing through Router.

2023-08-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17134. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Fix duplicate resu

[jira] [Updated] (HDFS-17134) RBF: Fix duplicate results of getListing through Router.

2023-08-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17134: --- Component/s: rbf > RBF: Fix duplicate results of getListing through Router. > ---

[jira] [Commented] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working

2023-08-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750537#comment-17750537 ] Xiaoqiao He commented on HDFS-17138: Thanks. IMO, it may be one common issue, not aff

[jira] [Assigned] (HDFS-17140) Optimize the BPOfferService.reportBadBlocks() method

2023-08-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17140: -- Assignee: Liangjun He > Optimize the BPOfferService.reportBadBlocks() method > ---

[jira] [Assigned] (HDFS-17141) Optimize the default parameters for the FileUtil.isRegularFile() method

2023-08-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17141: -- Assignee: Liangjun He > Optimize the default parameters for the FileUtil.isRegularFile() metho

[jira] [Commented] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working

2023-08-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17751456#comment-17751456 ] Xiaoqiao He commented on HDFS-17138: {quote}Other modules are also using subclasses o

[jira] [Updated] (HDFS-17137) Standby/Observer NameNode skip to handle redundant replica block logic when set decrease replication.

2023-08-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17137: --- Summary: Standby/Observer NameNode skip to handle redundant replica block logic when set decrease rep

[jira] [Resolved] (HDFS-17137) Standby/Observer NameNode skip to handle redundant replica block logic when set decrease replication.

2023-08-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17137. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Standby/Observer NameNo

[jira] [Updated] (HDFS-17137) Standby/Observer NameNode skip to handle redundant replica block logic when set decrease replication.

2023-08-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17137: --- Component/s: namenode > Standby/Observer NameNode skip to handle redundant replica block logic when

[jira] [Commented] (HDFS-17149) getBlockLocations RPC should use actual client ip to compute network distance when using RBF.

2023-08-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752284#comment-17752284 ] Xiaoqiao He commented on HDFS-17149: Hi [~zhanghaobo], Please check if HDFS-15079 can

[jira] [Commented] (HDFS-17149) getBlockLocations RPC should use actual client ip to compute network distance when using RBF.

2023-08-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753895#comment-17753895 ] Xiaoqiao He commented on HDFS-17149: [~zhanghaobo], Thanks, IIRC, there are many and

[jira] [Resolved] (HDFS-17150) EC: Fix the bug of failed lease recovery.

2023-08-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17150. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > EC: Fix the bug of fail

[jira] [Assigned] (HDFS-17150) EC: Fix the bug of failed lease recovery.

2023-08-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17150: -- Assignee: Shuyan Zhang > EC: Fix the bug of failed lease recovery. > -

[jira] [Resolved] (HDFS-17154) EC: Fix bug in updateBlockForPipeline after failover

2023-08-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17154. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > EC: Fix bug in updateBl

[jira] [Assigned] (HDFS-17151) EC: Fix wrong metadata in BlockInfoStriped after recovery

2023-08-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17151: -- Assignee: Shuyan Zhang > EC: Fix wrong metadata in BlockInfoStriped after recovery > -

[jira] [Resolved] (HDFS-17151) EC: Fix wrong metadata in BlockInfoStriped after recovery

2023-08-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17151. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > EC: Fix wrong metadata

[jira] [Updated] (HDFS-17093) Fix block report lease issue to avoid missing some storages report.

2023-08-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17093: --- Summary: Fix block report lease issue to avoid missing some storages report. (was: In the case of al

[jira] [Assigned] (HDFS-17093) Fix block report lease issue to avoid missing some storages report.

2023-08-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17093: -- Assignee: Yanlei Yu > Fix block report lease issue to avoid missing some storages report. > --

[jira] [Resolved] (HDFS-17093) Fix block report lease issue to avoid missing some storages report.

2023-08-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17093. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix block report lease

[jira] [Commented] (HDFS-17175) setOwner maybe set any user due to HDFS-16798

2023-08-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17761148#comment-17761148 ] Xiaoqiao He commented on HDFS-17175: Thanks [~Linwood] for your report. It is true fo

[jira] [Commented] (HDFS-17175) setOwner maybe set any user due to HDFS-16798

2023-09-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17761615#comment-17761615 ] Xiaoqiao He commented on HDFS-17175: Great, let's try to push this bugfix to checkin.

[jira] [Updated] (HDFS-16933) A race in SerialNumberMap will cause wrong owner, group and XATTR

2023-09-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16933: --- Summary: A race in SerialNumberMap will cause wrong owner, group and XATTR (was: A race in SerialNum

[jira] [Resolved] (HDFS-16933) A race in SerialNumberMap will cause wrong owner, group and XATTR

2023-09-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16933. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > A race in SerialNumberM

[jira] [Resolved] (HDFS-17140) Revisit the BPOfferService.reportBadBlocks() method.

2023-09-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17140. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Revisit the BPOfferServ

[jira] [Updated] (HDFS-17140) Revisit the BPOfferService.reportBadBlocks() method.

2023-09-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17140: --- Summary: Revisit the BPOfferService.reportBadBlocks() method. (was: Optimize the BPOfferService.repo

[jira] [Resolved] (HDFS-17190) EC: Fix bug of OIV processing XAttr.

2023-09-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17190. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Assignee: Shuyan Zhang Resolution:

[jira] [Resolved] (HDFS-17192) Add bock info when constructing remote block reader meets IOException

2023-09-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17192. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add bock info when cons

[jira] [Resolved] (HDFS-17105) mistakenly purge editLogs even after it is empty in NNStorageRetentionManager

2023-09-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17105. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Assignee: ConfX Resolution: Fixed

[jira] [Updated] (HDFS-17105) mistakenly purge editLogs even after it is empty in NNStorageRetentionManager

2023-09-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17105: --- Priority: Minor (was: Critical) > mistakenly purge editLogs even after it is empty in NNStorageRete

[jira] [Resolved] (HDFS-17184) Improve BlockReceiver to throws DiskOutOfSpaceException when initialize

2023-09-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17184. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Improve BlockReceiver t

[jira] [Updated] (HDFS-17184) Improve BlockReceiver to throws DiskOutOfSpaceException when initialize

2023-09-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17184: --- Summary: Improve BlockReceiver to throws DiskOutOfSpaceException when initialize (was: In BlockRecei

[jira] [Assigned] (HDFS-17197) Show file replication when listing corrupt files.

2023-09-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17197: -- Assignee: Shuyan Zhang > Show file replication when listing corrupt files. > -

[jira] [Resolved] (HDFS-17197) Show file replication when listing corrupt files.

2023-09-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17197. Fix Version/s: 3.4.0 Hadoop Flags: Incompatible change,Reviewed Resolution: Fixed > Sho

[jira] [Updated] (HDFS-17204) EC: Reduce unnecessary log when processing excess redundancy.

2023-09-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17204: --- Component/s: ec > EC: Reduce unnecessary log when processing excess redundancy. > ---

[jira] [Resolved] (HDFS-17204) EC: Reduce unnecessary log when processing excess redundancy.

2023-09-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17204. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > EC: Reduce unnecessary

[jira] [Commented] (HDFS-17218) NameNode should remove its excess blocks from the ExcessRedundancyMap When a DN registers

2023-10-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773095#comment-17773095 ] Xiaoqiao He commented on HDFS-17218: Thanks for your report. {quote}it causes some bl

[jira] [Commented] (HDFS-17218) NameNode should remove its excess blocks from the ExcessRedundancyMap When a DN registers

2023-10-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773523#comment-17773523 ] Xiaoqiao He commented on HDFS-17218: {quote}6. dn restarts will FBR is executed (proc

[jira] [Resolved] (HDFS-17208) Add the metrics PendingAsyncDiskOperations in datanode

2023-10-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17208. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add the metrics Pending

[jira] [Resolved] (HDFS-17217) Add lifeline RPC start up log when NameNode#startCommonServices

2023-10-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17217. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Marked Resolution/Fix Ver

[jira] [Assigned] (HDFS-17231) HA: Safemode should exit when resources are from low to available

2023-10-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17231: -- Assignee: kuper > HA: Safemode should exit when resources are from low to available >

[jira] [Commented] (HDFS-17231) HA: Safemode should exit when resources are from low to available

2023-10-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778520#comment-17778520 ] Xiaoqiao He commented on HDFS-17231: Add [~kuper] to contributor list and assign this

[jira] [Resolved] (HDFS-17231) HA: Safemode should exit when resources are from low to available

2023-10-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17231. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > HA: Safemode should exi

[jira] [Commented] (HDFS-17241) long write lock on active NN from rollEditLog()

2023-10-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780797#comment-17780797 ] Xiaoqiao He commented on HDFS-17241: Hi [~shuaiqi.guo], Thanks for your report and co

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2023-11-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783162#comment-17783162 ] Xiaoqiao He commented on HDFS-16016: [~yuanbo] Thanks involve me here again. IIRC, we

[jira] [Updated] (HDFS-17063) Support to configure different capacity reserved for each disk of DataNode.

2023-11-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17063: --- Summary: Support to configure different capacity reserved for each disk of DataNode. (was: Datanode

[jira] [Resolved] (HDFS-17172) Support FSNamesystemLock Parameters reconfigurable

2023-11-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17172. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Support FSNamesystemLoc

[jira] [Resolved] (HDFS-17063) Support to configure different capacity reserved for each disk of DataNode.

2023-11-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17063. Fix Version/s: 3.4.0 Resolution: Fixed > Support to configure different capacity reserved fo

[jira] [Updated] (HDFS-17269) RBF: Listing trash directory should return subdirs from all subclusters.

2023-12-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17269: --- Summary: RBF: Listing trash directory should return subdirs from all subclusters. (was: [RBF] Make l

[jira] [Resolved] (HDFS-17218) NameNode should process time out excess redundancy blocks

2023-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17218. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > NameNode should process

[jira] [Resolved] (HDFS-17250) EditLogTailer#triggerActiveLogRoll should handle thread Interrupted

2023-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17250. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > EditLogTailer#triggerAc

[jira] [Updated] (HDFS-17270) RBF: Fix ZKDelegationTokenSecretManagerImpl use closed zookeeper client to get token in some case

2023-12-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17270: --- Summary: RBF: Fix ZKDelegationTokenSecretManagerImpl use closed zookeeper client to get token in som

[jira] [Resolved] (HDFS-17270) RBF: Fix ZKDelegationTokenSecretManagerImpl use closed zookeeper client to get token in some case

2023-12-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17270. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Fix ZKDelegationTo

[jira] [Updated] (HDFS-17270) RBF: Fix ZKDelegationTokenSecretManagerImpl use closed zookeeper client to get token in some case

2023-12-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17270: --- Component/s: rbf > RBF: Fix ZKDelegationTokenSecretManagerImpl use closed zookeeper client to > get

[jira] [Resolved] (HDFS-17262) Transfer rate metric warning log is too verbose

2023-12-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17262. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Transfer rate metric wa

[jira] [Updated] (HDFS-17262) Fixed the verbose log.warn in DFSUtil.addTransferRateMetric()

2023-12-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17262: --- Summary: Fixed the verbose log.warn in DFSUtil.addTransferRateMetric() (was: Transfer rate metric wa

[jira] [Assigned] (HDFS-17262) Fixed the verbose log.warn in DFSUtil.addTransferRateMetric()

2023-12-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17262: -- Assignee: Ravindra Dingankar (was: Xing Lin) > Fixed the verbose log.warn in DFSUtil.addTrans

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800046#comment-17800046 ] Xiaoqiao He commented on HDFS-17299: Thanks involve me here. This is one corner case

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800241#comment-17800241 ] Xiaoqiao He commented on HDFS-17299: [~shahrs87] Please reference here: https://gith

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800243#comment-17800243 ] Xiaoqiao He commented on HDFS-17299: Connection meet some issues? Seems we both have

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800309#comment-17800309 ] Xiaoqiao He commented on HDFS-17299: {quote}Maybe we should consider dropping the dat

[jira] [Resolved] (HDFS-17182) DataSetLockManager.lockLeakCheck() is not thread-safe.

2024-01-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17182. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > DataSetLockManager.lock

[jira] [Commented] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807972#comment-17807972 ] Xiaoqiao He commented on HDFS-17341: Thanks [~Lei Yang] for your Great proposal! One

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17346: --- Fix Version/s: (was: 3.5.0) > Fix DirectoryScanner check mark the normal blocks as corrupt. > ---

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809224#comment-17809224 ] Xiaoqiao He commented on HDFS-17346: [~haiyang Hu] Thanks for your contributions. The

[jira] [Updated] (HDFS-16663) EC: Allow block reconstruction pending timeout refreshable to increase decommission performance

2024-01-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16663: --- Summary: EC: Allow block reconstruction pending timeout refreshable to increase decommission performa

[jira] [Updated] (HDFS-17357) EC: NioInetPeer.close() should close socket connection.

2024-01-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17357: --- Summary: EC: NioInetPeer.close() should close socket connection. (was: NioInetPeer.close() should cl

[jira] [Commented] (HDFS-17357) EC: NioInetPeer.close() should close socket connection.

2024-01-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17811172#comment-17811172 ] Xiaoqiao He commented on HDFS-17357: cc [~zhangshuyan] > EC: NioInetPeer.close() sho

[jira] [Updated] (HDFS-17356) RBF Add Configuration dfs.federation.router.ns.name Optimization

2024-01-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17356: --- Fix Version/s: (was: 3.3.0) > RBF Add Configuration dfs.federation.router.ns.name Optimization >

[jira] [Updated] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17356: --- Summary: RBF: Add Configuration dfs.federation.router.ns.name Optimization (was: RBF Add Configurati

[jira] [Commented] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17811183#comment-17811183 ] Xiaoqiao He commented on HDFS-17356: [~hiwangzhihui] Thanks for your report and invol

[jira] [Commented] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17811213#comment-17811213 ] Xiaoqiao He commented on HDFS-17356: It seems I misunderstand this issue at first. Th

[jira] [Updated] (HDFS-17631) RedundantEditLogInputStream.nextOp() will be State.STREAM_FAILED when EditLogInputStream.skipUntil() throw IOException

2024-09-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17631: --- Description: Now when EditLogInputStream.skipUntil() throw IOException in RedundantEditLogInputStrea

[jira] [Resolved] (HDFS-17624) Fix DFSNetworkTopology#chooseRandomWithStorageType() availableCount when excluded node is not in selected scope.

2024-09-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17624. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix DFSNetworkTopology#

[jira] [Updated] (HDFS-17624) Fix DFSNetworkTopology#chooseRandomWithStorageType() availableCount when excluded node is not in selected scope.

2024-09-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17624: --- Summary: Fix DFSNetworkTopology#chooseRandomWithStorageType() availableCount when excluded node is no

[jira] [Updated] (HDFS-17376) Distcp creates Factor 1 replication file on target if Source is EC

2024-09-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17376: --- Fix Version/s: 3.4.1 > Distcp creates Factor 1 replication file on target if Source is EC > -

[jira] [Updated] (HDFS-17376) Distcp creates Factor 1 replication file on target if Source is EC

2024-09-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17376: --- Fix Version/s: 3.4.2 (was: 3.4.1) > Distcp creates Factor 1 replication file o

[jira] [Resolved] (HDFS-17626) Reduce lock contention at datanode startup

2024-09-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17626. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Reduce lock contention

<    6   7   8   9   10   11