[jira] [Updated] (HDFS-17309) RBF: Fix Router Safemode check contidition error

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17309: -- Affects Version/s: 3.4.0 > RBF: Fix Router Safemode check contidition error > -

[jira] [Updated] (HDFS-17325) Doc: Fix the documentation of fs expunge command in FileSystemShell.md

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17325: -- Component/s: documentation fs > Doc: Fix the documentation of fs expunge command in Fi

[jira] [Updated] (HDFS-17310) DiskBalancer: Enhance the log message for submitPlan

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17310: -- Affects Version/s: 3.4.0 > DiskBalancer: Enhance the log message for submitPlan > -

[jira] [Updated] (HDFS-17310) DiskBalancer: Enhance the log message for submitPlan

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17310: -- Component/s: datanode > DiskBalancer: Enhance the log message for submitPlan >

[jira] [Updated] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17312: -- Hadoop Flags: Reviewed > packetsReceived metric should ignore heartbeat packet > --

[jira] [Updated] (HDFS-17325) Doc: Fix the documentation of fs expunge command in FileSystemShell.md

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17325: -- Affects Version/s: 3.4.0 > Doc: Fix the documentation of fs expunge command in FileSystemShell.md > ---

[jira] [Updated] (HDFS-16511) Improve lock type for ReplicaMap under fine-grain lock mode.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16511: -- Affects Version/s: 3.4.0 > Improve lock type for ReplicaMap under fine-grain lock mode. > -

[jira] [Updated] (HDFS-16534) Split datanode block pool locks to volume grain.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16534: -- Affects Version/s: 3.4.0 > Split datanode block pool locks to volume grain. > -

[jira] [Updated] (HDFS-16534) Split datanode block pool locks to volume grain.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16534: -- Component/s: datanode > Split datanode block pool locks to volume grain. >

[jira] [Updated] (HDFS-17311) RBF: ConnectionManager creatorQueue should offer a pool that is not already in creatorQueue.

2024-01-19 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17311: -- Affects Version/s: 3.5.0 > RBF: ConnectionManager creatorQueue should offer a pool that is not already

[jira] [Resolved] (HDFS-17311) RBF: ConnectionManager creatorQueue should offer a pool that is not already in creatorQueue.

2024-01-19 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17311. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0 Resolutio

[jira] [Resolved] (HDFS-17343) Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR

2024-01-19 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17343. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Revert HDFS-16016. BPServ

[jira] [Created] (HDFS-17343) Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR

2024-01-17 Thread Shilun Fan (Jira)
Shilun Fan created HDFS-17343: - Summary: Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR Key: HDFS-17343 URL: https://issues.apache.org/jira/browse/HDFS-17343 Project: Hadoop HDFS

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-17 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808024#comment-17808024 ] Shilun Fan commented on HDFS-16016: --- Reset HDFS-16016 status to Resolved. I will create

[jira] [Resolved] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-17 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-16016. --- Resolution: Fixed > BPServiceActor add a new thread to handle IBR > -

[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16016: -- Fix Version/s: (was: 3.4.0) > BPServiceActor add a new thread to handle IBR > -

[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16016: -- Target Version/s: 3.5.0 (was: 3.4.0) > BPServiceActor add a new thread to handle IBR > ---

[jira] [Reopened] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reopened HDFS-16016: --- > BPServiceActor add a new thread to handle IBR > - > >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14694: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > Call recoverLease on DFSOutputStream close exception > -

[jira] [Updated] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15344: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > DataNode#checkSuperuserPrivilege should use UGI#getGroup

[jira] [Updated] (HDFS-15345) RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15345: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > RBF: RouterPermissionChecker#checkSuperuserPrivilege sho

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15359: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > EC: Allow closing a file with committed blocks > ---

[jira] [Updated] (HDFS-15371) Nonstandard characters exist in NameNode.java

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15371: -- Target Version/s: 3.1.0, 3.4.0 (was: 3.1.0) > Nonstandard characters exist in NameNode.java >

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15492: -- Target Version/s: 3.3.1, 3.4.0 (was: 3.3.1) > Make trash root inside each snapshottable directory > --

[jira] [Updated] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15545: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > (S)Webhdfs will not use updated delegation tokens availa

[jira] [Updated] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15561: -- Target Version/s: 3.3.1, 3.4.0 (was: 3.3.1) > RBF: Fix NullPointException when start dfsrouter > -

[jira] [Updated] (HDFS-15608) Rename variable DistCp#CLEANUP

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15608: -- Target Version/s: 3.3.0, 3.4.0 (was: 3.3.0) > Rename variable DistCp#CLEANUP > ---

[jira] [Updated] (HDFS-15596) ViewHDFS#create(f, permission, cflags, bufferSize, replication, blockSize, progress, checksumOpt) should not be restricted to DFS only.

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15596: -- Target Version/s: 3.3.1, 3.4.0 (was: 3.3.1) > ViewHDFS#create(f, permission, cflags, bufferSize, repli

[jira] [Updated] (HDFS-15684) EC: Call recoverLease on DFSStripedOutputStream close exception

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15684: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > EC: Call recoverLease on DFSStripedOutputStream close ex

[jira] [Updated] (HDFS-15850) Superuser actions should be reported to external enforcers

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15850: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > Superuser actions should be reported to external enforce

[jira] [Updated] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16422: -- Target Version/s: 3.3.3, 3.4.0 (was: 3.3.3) > Fix thread safety of EC decoding during concurrent pread

[jira] [Updated] (HDFS-16652) Upgrade jquery datatable version references to v1.10.19

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16652: -- Target Version/s: 3.4.0, 3.3.9 (was: 3.3.9) > Upgrade jquery datatable version references to v1.10.19

[jira] [Updated] (HDFS-16740) Mini cluster test flakiness

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16740: -- Target Version/s: 3.4.0, 3.3.9 (was: 3.3.9) > Mini cluster test flakiness > --

[jira] [Updated] (HDFS-16761) Namenode UI for Datanodes page not loading if any data node is down

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16761: -- Target Version/s: 3.2.2, 3.4.0 (was: 3.2.2) > Namenode UI for Datanodes page not loading if any data n

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17024: -- Target Version/s: 3.4.0, 3.3.9 (was: 3.3.9) > Potential data race introduced by HDFS-15865 > -

[jira] [Updated] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17312: -- Target Version/s: 3.4.0, 3.5.0 (was: 3.5.0) > packetsReceived metric should ignore heartbeat packet >

[jira] [Commented] (HDFS-15552) Let DeadNode Detector also work for EC cases

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807097#comment-17807097 ] Shilun Fan commented on HDFS-15552: --- We don't need to set a fix version. We can only co

[jira] [Updated] (HDFS-15980) Fix tests for HDFS-15754 Create packet metrics for DataNode

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15980: -- Fix Version/s: (was: 3.4.0) > Fix tests for HDFS-15754 Create packet metrics for DataNode > ---

[jira] [Commented] (HDFS-15980) Fix tests for HDFS-15754 Create packet metrics for DataNode

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807096#comment-17807096 ] Shilun Fan commented on HDFS-15980: --- We don't need to set a fix version. We can only co

[jira] [Updated] (HDFS-15552) Let DeadNode Detector also work for EC cases

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15552: -- Fix Version/s: (was: 3.4.0) > Let DeadNode Detector also work for EC cases > --

[jira] [Commented] (HDFS-16905) Provide default hadoop.log.dir for tests

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807095#comment-17807095 ] Shilun Fan commented on HDFS-16905: --- We don't need to set a fix version. We can only co

[jira] [Updated] (HDFS-16905) Provide default hadoop.log.dir for tests

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16905: -- Fix Version/s: (was: 3.4.0) (was: 3.3.9) > Provide default hadoop.log.dir fo

[jira] [Updated] (HDFS-16970) EC: client copy wrong buffer from decode output during pread

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16970: -- Fix Version/s: (was: 3.4.0) (was: 3.3.5) > EC: client copy wrong buffer from

[jira] [Resolved] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17290. --- Hadoop Flags: Reviewed Resolution: Fixed > HDFS: add client rpc backoff metrics due to disconne

[jira] [Updated] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17290: -- Fix Version/s: 3.4.0 Target Version/s: 3.4.0 > HDFS: add client rpc backoff metrics due to disco

[jira] [Updated] (HDFS-17201) some methods in FsDatasetImpl should acquire readLock with LockLevel.VOLUME

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17201: -- Fix Version/s: (was: 3.4.0) > some methods in FsDatasetImpl should acquire readLock with LockLevel.

[jira] [Updated] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17290: -- Fix Version/s: (was: 3.4.0) > HDFS: add client rpc backoff metrics due to disconnection from lowest

[jira] [Commented] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-14 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17806621#comment-17806621 ] Shilun Fan commented on HDFS-17312: --- [~tasanuma] Thank you for backporting this pr! >

[jira] [Updated] (HDFS-17284) EC: Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery

2024-01-13 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17284: -- Summary: EC: Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block

[jira] [Resolved] (HDFS-17128) RBF: SQLDelegationTokenSecretManager should use version of tokens updated by other routers

2024-01-13 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17128. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 Assigne

[jira] [Resolved] (HDFS-17326) Fix NameNode Spotbug

2024-01-06 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17326. --- Target Version/s: 3.3.6, 3.4.0 (was: 3.4.0, 3.3.6) Resolution: Duplicate > Fix NameNode Sp

[jira] [Updated] (HDFS-17326) Fix NameNode Spotbug

2024-01-05 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17326: -- Summary: Fix NameNode Spotbug (was: Fix NameNode Spotbugs) > Fix NameNode Spotbug > --

[jira] [Created] (HDFS-17326) Fix NameNode Spotbugs

2024-01-05 Thread Shilun Fan (Jira)
Shilun Fan created HDFS-17326: - Summary: Fix NameNode Spotbugs Key: HDFS-17326 URL: https://issues.apache.org/jira/browse/HDFS-17326 Project: Hadoop HDFS Issue Type: Improvement Compone

[jira] [Updated] (HDFS-17325) Doc: Fix the documentation of fs expunge command in FileSystemShell.md

2024-01-05 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17325: -- Priority: Minor (was: Major) > Doc: Fix the documentation of fs expunge command in FileSystemShell.md

[jira] [Resolved] (HDFS-17325) Doc: Fix the documentation of fs expunge command in FileSystemShell.md

2024-01-05 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17325. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 Resolutio

[jira] [Updated] (HDFS-17325) Doc: Fix the documentation of fs expunge command in FileSystemShell.md

2024-01-05 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17325: -- Target Version/s: 3.3.6, 3.4.0 (was: 3.4.0) > Doc: Fix the documentation of fs expunge command in File

[jira] [Resolved] (HDFS-17309) RBF: Fix Router Safemode check contidition error

2024-01-05 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17309. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Re

[jira] [Assigned] (HDFS-17309) RBF: Fix Router Safemode check contidition error

2024-01-05 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-17309: - Assignee: liuguanghua > RBF: Fix Router Safemode check contidition error > -

[jira] [Resolved] (HDFS-17322) RetryCache#MAX_CAPACITY seems to be MIN_CAPACITY

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17322. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17306) RBF:Router should not return nameservices that does not enable observer nodes in RpcResponseHeaderProto

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17306. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Re

[jira] [Updated] (HDFS-14261) Kerberize JournalNodeSyncer unit test

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14261: -- Target Version/s: 3.5.0 (was: 3.4.1) > Kerberize JournalNodeSyncer unit test > ---

[jira] [Commented] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause bad

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802633#comment-17802633 ] Shilun Fan commented on HDFS-16093: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Comment Edited] (HDFS-14038) Expose HdfsDataOutputStreamBuilder to include Spark in LimitedPrivate

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802440#comment-17802440 ] Shilun Fan edited comment on HDFS-14038 at 1/4/24 8:18 AM: --- Bul

[jira] [Updated] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause badly

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16093: -- Target Version/s: 3.5.0 (was: 3.4.1) > DataNodes under decommission will still be returned to the clie

[jira] [Updated] (HDFS-14038) Expose HdfsDataOutputStreamBuilder to include Spark in LimitedPrivate

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14038: -- Target Version/s: 3.5.0 (was: 3.4.1) > Expose HdfsDataOutputStreamBuilder to include Spark in LimitedP

[jira] [Updated] (HDFS-14194) Mention HDFS ACL incompatible changes more explicitly

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14194: -- Target Version/s: 3.5.0 (was: 3.4.1) > Mention HDFS ACL incompatible changes more explicitly > ---

[jira] [Comment Edited] (HDFS-14261) Kerberize JournalNodeSyncer unit test

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802437#comment-17802437 ] Shilun Fan edited comment on HDFS-14261 at 1/4/24 8:17 AM: --- Bul

[jira] [Updated] (HDFS-14312) KMS-o-meter: Scale test KMS using kms audit log

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14312: -- Target Version/s: 3.5.0 (was: 3.4.1) > KMS-o-meter: Scale test KMS using kms audit log > -

[jira] [Comment Edited] (HDFS-14312) KMS-o-meter: Scale test KMS using kms audit log

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802434#comment-17802434 ] Shilun Fan edited comment on HDFS-14312 at 1/4/24 8:17 AM: --- Bul

[jira] [Updated] (HDFS-13928) Add the corner case testings for log roll

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13928: -- Target Version/s: 3.5.0 (was: 3.4.1) > Add the corner case testings for log roll > ---

[jira] [Comment Edited] (HDFS-13928) Add the corner case testings for log roll

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802441#comment-17802441 ] Shilun Fan edited comment on HDFS-13928 at 1/4/24 8:17 AM: --- Bul

[jira] [Comment Edited] (HDFS-14528) Failover from Active to Standby Failed

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802433#comment-17802433 ] Shilun Fan edited comment on HDFS-14528 at 1/4/24 8:17 AM: --- Bul

[jira] [Updated] (HDFS-14528) Failover from Active to Standby Failed

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14528: -- Target Version/s: 3.5.0 (was: 3.4.1) > Failover from Active to Standby Failed >

[jira] [Updated] (HDFS-14607) Support OpenTracing in WebHDFS

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14607: -- Target Version/s: 3.5.0 (was: 3.4.1) > Support OpenTracing in WebHDFS > --

[jira] [Comment Edited] (HDFS-14606) Support OpenTracing in HDFS

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802432#comment-17802432 ] Shilun Fan edited comment on HDFS-14606 at 1/4/24 8:16 AM: --- Bul

[jira] [Updated] (HDFS-14606) Support OpenTracing in HDFS

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14606: -- Target Version/s: 3.5.0 (was: 3.4.1) > Support OpenTracing in HDFS > --- > >

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14305: -- Target Version/s: 3.5.0 (was: 3.4.1) > Serial number in BlockTokenSecretManager could overlap between

[jira] [Comment Edited] (HDFS-14607) Support OpenTracing in WebHDFS

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802431#comment-17802431 ] Shilun Fan edited comment on HDFS-14607 at 1/4/24 8:16 AM: --- Bul

[jira] [Comment Edited] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802435#comment-17802435 ] Shilun Fan edited comment on HDFS-14305 at 1/4/24 8:16 AM: --- Bul

[jira] [Updated] (HDFS-14626) Decommission all nodes hosting last block of open file succeeds unexpectedly

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14626: -- Target Version/s: 3.5.0 (was: 3.4.1) > Decommission all nodes hosting last block of open file succeeds

[jira] [Comment Edited] (HDFS-14626) Decommission all nodes hosting last block of open file succeeds unexpectedly

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802430#comment-17802430 ] Shilun Fan edited comment on HDFS-14626 at 1/4/24 8:15 AM: --- Bul

[jira] [Updated] (HDFS-15357) Do not trust bad block reports from clients

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15357: -- Target Version/s: 2.10.3, 3.5.0 (was: 2.10.3, 3.4.1) > Do not trust bad block reports from clients > -

[jira] [Comment Edited] (HDFS-15357) Do not trust bad block reports from clients

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802416#comment-17802416 ] Shilun Fan edited comment on HDFS-15357 at 1/4/24 8:15 AM: --- Bul

[jira] [Updated] (HDFS-15686) Provide documentation for ViewHDFS

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15686: -- Target Version/s: 3.5.0 (was: 3.4.1) > Provide documentation for ViewHDFS > --

[jira] [Commented] (HDFS-15388) DFS cacheadmin, ECAdmin, StoragePolicyAdmin commands should handle ViewFSOverloadScheme

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802626#comment-17802626 ] Shilun Fan commented on HDFS-15388: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Comment Edited] (HDFS-14978) In-place Erasure Coding Conversion

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802423#comment-17802423 ] Shilun Fan edited comment on HDFS-14978 at 1/4/24 8:14 AM: --- Bul

[jira] [Updated] (HDFS-15609) Implement hdfs getconf -serverDefaults

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15609: -- Target Version/s: 3.5.0 (was: 3.4.1) > Implement hdfs getconf -serverDefaults > --

[jira] [Commented] (HDFS-15609) Implement hdfs getconf -serverDefaults

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802627#comment-17802627 ] Shilun Fan commented on HDFS-15609: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-14978) In-place Erasure Coding Conversion

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14978: -- Target Version/s: 3.5.0 (was: 3.4.1) > In-place Erasure Coding Conversion > --

[jira] [Updated] (HDFS-15388) DFS cacheadmin, ECAdmin, StoragePolicyAdmin commands should handle ViewFSOverloadScheme

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15388: -- Target Version/s: 3.5.0 (was: 3.4.1) > DFS cacheadmin, ECAdmin, StoragePolicyAdmin commands should han

[jira] [Comment Edited] (HDFS-15042) Add more tests for ByteBufferPositionedReadable

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802422#comment-17802422 ] Shilun Fan edited comment on HDFS-15042 at 1/4/24 8:14 AM: --- Bul

[jira] [Updated] (HDFS-15042) Add more tests for ByteBufferPositionedReadable

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15042: -- Target Version/s: 3.5.0 (was: 3.4.1) > Add more tests for ByteBufferPositionedReadable >

[jira] [Updated] (HDFS-15337) Support available space choosing policy in HDFS Persistent Memory Cache

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15337: -- Target Version/s: 3.5.0 (was: 3.4.1) > Support available space choosing policy in HDFS Persistent Memo

[jira] [Comment Edited] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802419#comment-17802419 ] Shilun Fan edited comment on HDFS-15329 at 1/4/24 8:13 AM: --- Bul

[jira] [Updated] (HDFS-15354) clearCorruptLazyPersistFiles incrementalBlock removal should be out side write lock

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15354: -- Target Version/s: 3.5.0 (was: 3.4.1) > clearCorruptLazyPersistFiles incrementalBlock removal should be

[jira] [Comment Edited] (HDFS-15274) NN doesn't remove the blocks from the failed DatanodeStorageInfo

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802420#comment-17802420 ] Shilun Fan edited comment on HDFS-15274 at 1/4/24 8:13 AM: --- Bul

[jira] [Comment Edited] (HDFS-15354) clearCorruptLazyPersistFiles incrementalBlock removal should be out side write lock

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802417#comment-17802417 ] Shilun Fan edited comment on HDFS-15354 at 1/4/24 8:13 AM: --- Bul

[jira] [Updated] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15329: -- Target Version/s: 3.5.0 (was: 3.4.1) > Provide FileContext based ViewFSOverloadScheme implementation >

[jira] [Updated] (HDFS-15274) NN doesn't remove the blocks from the failed DatanodeStorageInfo

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15274: -- Target Version/s: 3.5.0 (was: 3.4.1) > NN doesn't remove the blocks from the failed DatanodeStorageInf

[jira] [Comment Edited] (HDFS-14897) [hadoop-hdfs] Fix order of actual and expected expression in assert statements

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802425#comment-17802425 ] Shilun Fan edited comment on HDFS-14897 at 1/4/24 8:13 AM: --- Bul

<    6   7   8   9   10   11   12   13   14   15   >