[jira] [Resolved] (HDFS-17506) [FGL] Performance for phase 1

2024-05-12 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17506. Resolution: Fixed > [FGL] Performance for phase 1 > - > > Key:

[jira] [Updated] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-04-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-17384: --- Target Version/s: 3.5.0 > [FGL] Replace the global lock with global FS Lock and global BM lock >

[jira] [Resolved] (HDFS-17457) [FGL] UTs support fine-grained locking

2024-04-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17457. Resolution: Fixed > [FGL] UTs support fine-grained locking > -- > >

[jira] [Commented] (HDFS-17366) NameNode Fine-Grained Locking via Namespace Tree

2024-04-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839450#comment-17839450 ] Hui Fei commented on HDFS-17366: [~brahmareddy] Thanks for your interest in this improvement. > is it

[jira] [Resolved] (HDFS-17459) [FGL] Summarize this feature

2024-04-19 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17459. Resolution: Fixed > [FGL] Summarize this feature > - > > Key:

[jira] [Resolved] (HDFS-17472) [FGL] gcDeletedSnapshot and getDelegationToken support FGL

2024-04-17 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17472. Resolution: Fixed > [FGL] gcDeletedSnapshot and getDelegationToken support FGL >

[jira] [Resolved] (HDFS-17424) [FGL] DelegationTokenSecretManager supports fine-grained lock

2024-04-15 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17424. Resolution: Fixed > [FGL] DelegationTokenSecretManager supports fine-grained lock >

[jira] [Resolved] (HDFS-17445) [FGL] All remaining operations support fine-grained locking

2024-04-09 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17445. Resolution: Fixed > [FGL] All remaining operations support fine-grained locking >

[jira] [Commented] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-04-08 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835093#comment-17835093 ] Hui Fei commented on HDFS-17384: [~xuzq_zander] Seems we also need a task to add document for this

[jira] [Resolved] (HDFS-17411) [FGL] Client RPCs involving snapshot support fine-grained lock

2024-04-08 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17411. Resolution: Fixed > [FGL] Client RPCs involving snapshot support fine-grained lock >

[jira] [Resolved] (HDFS-17389) [FGL] Client RPCs involving read process supports fine-grained lock

2024-03-29 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17389. Resolution: Fixed > [FGL] Client RPCs involving read process supports fine-grained lock >

[jira] [Resolved] (HDFS-17388) [FGL] Client RPCs involving write process supports fine-grained lock

2024-03-29 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17388. Resolution: Fixed > [FGL] Client RPCs involving write process supports fine-grained lock >

[jira] [Resolved] (HDFS-17420) [FGL] FSEditLogLoader supports fine-grained lock

2024-03-27 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17420. Resolution: Fixed > [FGL] FSEditLogLoader supports fine-grained lock >

[jira] [Resolved] (HDFS-17412) [FGL] Client RPCs involving maintenance supports fine-grained lock

2024-03-27 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17412. Resolution: Fixed > [FGL] Client RPCs involving maintenance supports fine-grained lock >

[jira] [Resolved] (HDFS-17417) [FGL] HeartbeatManager and DatanodeAdminMonitor support fine-grained lock

2024-03-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17417. Resolution: Fixed > [FGL] HeartbeatManager and DatanodeAdminMonitor support fine-grained lock >

[jira] [Resolved] (HDFS-17415) [FGL] RPCs in NamenodeProtocol support fine-grained lock

2024-03-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17415. Resolution: Fixed > [FGL] RPCs in NamenodeProtocol support fine-grained lock >

[jira] [Resolved] (HDFS-17410) [FGL] Client RPCs that changes file attributes supports fine-grained lock

2024-03-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17410. Resolution: Fixed > [FGL] Client RPCs that changes file attributes supports fine-grained lock >

[jira] [Resolved] (HDFS-17416) [FGL] Monitor threads in BlockManager.class support fine-grained lock

2024-03-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17416. Resolution: Fixed > [FGL] Monitor threads in BlockManager.class support fine-grained lock >

[jira] [Resolved] (HDFS-17423) [FGL] BlockManagerSafeMode supports fine-grained lock

2024-03-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17423. Resolution: Fixed > [FGL] BlockManagerSafeMode supports fine-grained lock >

[jira] [Resolved] (HDFS-17414) [FGL] RPCs in DatanodeProtocol support fine-grained lock

2024-03-23 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17414. Resolution: Fixed > [FGL] RPCs in DatanodeProtocol support fine-grained lock >

[jira] [Resolved] (HDFS-17413) [FGL] CacheReplicationMonitor supports fine-grained lock

2024-03-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17413. Resolution: Fixed > [FGL] CacheReplicationMonitor supports fine-grained lock >

[jira] [Updated] (HDFS-17437) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit failed

2024-03-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-17437: --- Parent: HDFS-15646 Issue Type: Sub-task (was: Test) >

[jira] [Updated] (HDFS-17437) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit failed

2024-03-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-17437: --- Description: reported by https://github.com/apache/hadoop/pull/6641 log as following {quote} [ERROR]

[jira] [Created] (HDFS-17437) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit failed

2024-03-21 Thread Hui Fei (Jira)
Hui Fei created HDFS-17437: -- Summary: TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit failed Key: HDFS-17437 URL: https://issues.apache.org/jira/browse/HDFS-17437 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-17390) [FGL] FSDirectory supports this fine-grained locking

2024-03-06 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17390. Resolution: Fixed > [FGL] FSDirectory supports this fine-grained locking >

[jira] [Resolved] (HDFS-17405) [FGL] Using different metric name to trace FGL and Global lock

2024-03-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17405. Resolution: Fixed > [FGL] Using different metric name to trace FGL and Global lock >

[jira] [Reopened] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-03-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-17384: > [FGL] Replace the global lock with global FS Lock and global BM lock >

[jira] [Resolved] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-03-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17384. Resolution: Fixed > [FGL] Replace the global lock with global FS Lock and global BM lock >

[jira] [Resolved] (HDFS-17387) [FGL] Abstract the configurable locking mode

2024-03-04 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17387. Resolution: Fixed > [FGL] Abstract the configurable locking mode >

[jira] [Resolved] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-03-04 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17384. Resolution: Fixed > [FGL] Replace the global lock with global FS Lock and global BM lock >

[jira] [Reopened] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-03-04 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-17384: > [FGL] Replace the global lock with global FS Lock and global BM lock >

[jira] [Updated] (HDFS-17387) [FGL] Abstract the configurable locking mode

2024-02-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-17387: --- Summary: [FGL] Abstract the configurable locking mode (was: [FGL] Abstract selectable locking mode) >

[jira] [Resolved] (HDFS-17394) [FGL] Remove unused WriteHoldCount of FSNamesystemLock

2024-02-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17394. Resolution: Fixed > [FGL] Remove unused WriteHoldCount of FSNamesystemLock >

[jira] [Resolved] (HDFS-17393) Remove unused cond in FSNamesystem

2024-02-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17393. Fix Version/s: 3.5.0 Resolution: Fixed > Remove unused cond in FSNamesystem >

[jira] [Assigned] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-02-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-17384: -- Assignee: ZanderXu > [FGL] Replace the global lock with global FS Lock and global BM lock >

[jira] [Assigned] (HDFS-17366) NameNode Fine-Grained Locking via Namespace Tree

2024-02-02 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-17366: -- Assignee: ZanderXu > NameNode Fine-Grained Locking via Namespace Tree >

[jira] [Commented] (HDFS-16771) JN should tersely print logs about NewerTxnIdException

2022-09-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609073#comment-17609073 ] Hui Fei commented on HDFS-16771: Close this issue because the PR had been merged > JN should tersely

[jira] [Resolved] (HDFS-16771) JN should tersely print logs about NewerTxnIdException

2022-09-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16771. Resolution: Fixed > JN should tersely print logs about NewerTxnIdException >

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2022-09-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600565#comment-17600565 ] Hui Fei commented on HDFS-2139: --- [~xuzq_zander] cut a feature branch HDFS-2139 from trunk. can start your

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2022-08-28 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17596967#comment-17596967 ] Hui Fei commented on HDFS-2139: --- [~xuzq_zander] I think the design doc is good to me, Thanks. We can wait

[jira] [Resolved] (HDFS-16738) Invalid CallerContext caused NullPointerException

2022-08-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16738. Fix Version/s: 3.4.0 Resolution: Fixed > Invalid CallerContext caused NullPointerException >

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2022-08-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17584592#comment-17584592 ] Hui Fei commented on HDFS-2139: --- [~slfan1989] Thanks for your comments. > keep the original Assignee of

[jira] [Assigned] (HDFS-2139) Fast copy for HDFS.

2022-08-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-2139: - Assignee: Rituraj (was: ZanderXu) > Fast copy for HDFS. > --- > > Key:

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2022-08-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17584144#comment-17584144 ] Hui Fei commented on HDFS-2139: --- [~weichiu] Could you check the design doc [~xuzq_zander] provided? > Fast

[jira] [Updated] (HDFS-2139) Fast copy for HDFS.

2022-08-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-2139: -- Description: There is a need to perform fast file copy on HDFS. The fast copy mechanism for a file works as

[jira] [Reopened] (HDFS-16689) Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-08-15 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-16689: > Standby NameNode crashes when transitioning to Active with in-progress tailer >

[jira] [Resolved] (HDFS-16689) Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-08-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16689. Fix Version/s: 3.4.0 Resolution: Fixed > Standby NameNode crashes when transitioning to Active with

[jira] [Assigned] (HDFS-2139) Fast copy for HDFS.

2022-08-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-2139: - Assignee: ZanderXu (was: Rituraj) > Fast copy for HDFS. > --- > > Key:

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2022-08-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17578340#comment-17578340 ] Hui Fei commented on HDFS-2139: --- Glad to receive positive feedbacks, thank you! [~xuzq_zander] is interested

[jira] [Comment Edited] (HDFS-2139) Fast copy for HDFS.

2022-08-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17578340#comment-17578340 ] Hui Fei edited comment on HDFS-2139 at 8/11/22 9:16 AM: [~weichiu] [~ayushtkn]

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2022-08-10 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17578053#comment-17578053 ] Hui Fei commented on HDFS-2139: --- Fast Copy really is a good feature. In my experience it can help us copy

[jira] [Resolved] (HDFS-16648) Normalize the usage of debug logs in NameNode

2022-08-06 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16648. Fix Version/s: 3.4.0 Resolution: Fixed > Normalize the usage of debug logs in NameNode >

[jira] [Resolved] (HDFS-16642) [SBN read] Moving selecting inputstream from JN in EditlogTailer out of FSNLock

2022-08-03 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16642. Fix Version/s: 3.4.0 Resolution: Fixed > [SBN read] Moving selecting inputstream from JN in

[jira] [Resolved] (HDFS-16671) RBF: RouterRpcFairnessPolicyController supports configurable permit acquire timeout

2022-07-28 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16671. Fix Version/s: 1.3.0 Resolution: Fixed > RBF: RouterRpcFairnessPolicyController supports

[jira] [Commented] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2022-07-23 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17570305#comment-17570305 ] Hui Fei commented on HDFS-15079: This critical issue has been resolved. Thanks you all here. > RBF:

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2022-07-23 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-15079: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) > RBF:

[jira] [Assigned] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2022-07-23 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-15079: -- Assignee: ZanderXu > RBF: Client maybe get an unexpected result with network anomaly >

[jira] [Resolved] (HDFS-16525) System.err should be used when error occurs in multiple methods in DFSAdmin class

2022-05-12 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16525. Fix Version/s: 3.4.0 Resolution: Fixed > System.err should be used when error occurs in multiple

[jira] [Commented] (HDFS-16539) RBF: Support refreshing/changing router fairness policy controller without rebooting router

2022-04-28 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529372#comment-17529372 ] Hui Fei commented on HDFS-16539: [~coconut_icecream] Thanks. Can create a new ticket to add the document.

[jira] [Resolved] (HDFS-16488) [SPS]: Expose metrics to JMX for external SPS

2022-04-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16488. Resolution: Fixed > [SPS]: Expose metrics to JMX for external SPS >

[jira] [Reopened] (HDFS-16488) [SPS]: Expose metrics to JMX for external SPS

2022-04-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-16488: > [SPS]: Expose metrics to JMX for external SPS > - > >

[jira] [Resolved] (HDFS-16488) [SPS]: Expose metrics to JMX for external SPS

2022-04-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16488. Fix Version/s: 3.4.0 Resolution: Fixed > [SPS]: Expose metrics to JMX for external SPS >

[jira] [Resolved] (HDFS-16460) [SPS]: Handle failure retries for moving tasks

2022-04-07 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16460. Fix Version/s: 3.4.0 Resolution: Fixed > [SPS]: Handle failure retries for moving tasks >

[jira] [Commented] (HDFS-16450) Give priority to releasing DNs with less free space

2022-04-02 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516231#comment-17516231 ] Hui Fei commented on HDFS-16450: [~it_singer] Thanks for your contribution. Could you please add UT and

[jira] (HDFS-16500) Make asynchronous blocks deletion lock and unlock durtion threshold configurable

2022-03-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16500 ] Hui Fei deleted comment on HDFS-16500: was (Author: ferhui): We met one problem when we used this feature. It created and deleted files frequently in data lake scenario. Async deleting is slower

[jira] [Commented] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-03-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511781#comment-17511781 ] Hui Fei commented on HDFS-16043: We met one problem when we used this feature. It created and deleted

[jira] [Commented] (HDFS-16500) Make asynchronous blocks deletion lock and unlock durtion threshold configurable

2022-03-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511774#comment-17511774 ] Hui Fei commented on HDFS-16500: We met one problem when we used this feature. It created and deleted

[jira] [Comment Edited] (HDFS-13248) RBF: Namenode need to choose block location for the client

2022-03-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510217#comment-17510217 ] Hui Fei edited comment on HDFS-13248 at 3/22/22, 4:51 AM: -- Thank you all!! Very

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2022-03-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510217#comment-17510217 ] Hui Fei commented on HDFS-13248: Thanks you all!! Very glad to see that this issue has been resolved. >

[jira] [Resolved] (HDFS-16499) [SPS]: Should not start indefinitely while another SPS process is running

2022-03-16 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16499. Fix Version/s: 3.4.0 Resolution: Fixed > [SPS]: Should not start indefinitely while another SPS

[jira] [Resolved] (HDFS-16458) [SPS]: Fix bug for unit test of reconfiguring SPS mode

2022-03-01 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16458. Fix Version/s: 3.4.0 Resolution: Fixed > [SPS]: Fix bug for unit test of reconfiguring SPS mode >

[jira] [Resolved] (HDFS-16480) Fix typo: indicies -> indices

2022-02-28 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16480. Fix Version/s: 3.4.0 Assignee: Jiale Qi Resolution: Fixed > Fix typo: indicies -> indices

[jira] [Resolved] (HDFS-16316) Improve DirectoryScanner: add regular file check related block

2022-02-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16316. Fix Version/s: 3.4.0 Resolution: Fixed > Improve DirectoryScanner: add regular file check related

[jira] [Resolved] (HDFS-16406) DataNode metric ReadsFromLocalClient does not count short-circuit reads

2022-02-08 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16406. Fix Version/s: 3.4.0 Resolution: Fixed > DataNode metric ReadsFromLocalClient does not count

[jira] [Updated] (HDFS-16444) Show start time of JournalNode on Web

2022-01-30 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-16444: --- Issue Type: Improvement (was: New Feature) > Show start time of JournalNode on Web >

[jira] [Resolved] (HDFS-16444) Show start time of JournalNode on Web

2022-01-30 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16444. Fix Version/s: 3.4.0 Resolution: Fixed > Show start time of JournalNode on Web >

[jira] [Resolved] (HDFS-16401) Remove the worthless DatasetVolumeChecker#numAsyncDatasetChecks

2022-01-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16401. Fix Version/s: 3.4.0 Resolution: Fixed > Remove the worthless

[jira] [Updated] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-16417: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) > RBF:

[jira] [Assigned] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-16417: -- Assignee: Felix N (was: Hui Fei) > RBF: StaticRouterRpcFairnessPolicyController init fails with

[jira] [Assigned] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-16417: -- Assignee: Hui Fei > RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if >

[jira] [Resolved] (HDFS-16392) TestWebHdfsFileSystemContract#testResponseCode fails

2021-12-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16392. Fix Version/s: 3.4.0 Resolution: Fixed > TestWebHdfsFileSystemContract#testResponseCode fails >

[jira] [Commented] (HDFS-16168) TestHDFSFileSystemContract#testAppend fails

2021-12-20 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462495#comment-17462495 ] Hui Fei commented on HDFS-16168: Merged. [~secfree.teng]Thanks for your contribution. >

[jira] [Commented] (HDFS-16368) DFSAdmin supports refresh topology info without restarting namenode

2021-12-20 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462496#comment-17462496 ] Hui Fei commented on HDFS-16368: It is the same to HDFS-11242, yes? > DFSAdmin supports refresh

[jira] [Resolved] (HDFS-16168) TestHDFSFileSystemContract#testAppend fails

2021-12-20 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16168. Fix Version/s: 3.4.0 Resolution: Fixed > TestHDFSFileSystemContract#testAppend fails >

[jira] [Assigned] (HDFS-16168) TestHDFSFileSystemContract#testAppend fails

2021-12-20 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-16168: -- Assignee: secfree.teng > TestHDFSFileSystemContract#testAppend fails >

[jira] [Resolved] (HDFS-16350) Datanode start time should be set after RPC server starts successfully

2021-11-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16350. Resolution: Fixed > Datanode start time should be set after RPC server starts successfully >

[jira] [Commented] (HDFS-16350) Datanode start time should be set after RPC server starts successfully

2021-11-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448903#comment-17448903 ] Hui Fei commented on HDFS-16350: cherry-picked to branch 3.3 & 3.2 > Datanode start time should be set

[jira] [Reopened] (HDFS-16350) Datanode start time should be set after RPC server starts successfully

2021-11-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-16350: > Datanode start time should be set after RPC server starts successfully >

[jira] [Updated] (HDFS-16350) Datanode start time should be set after RPC server starts successfully

2021-11-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-16350: --- Fix Version/s: 3.2.3 3.3.3 > Datanode start time should be set after RPC server starts

[jira] [Updated] (HDFS-16350) Datanode start time should be set after RPC server starts successfully

2021-11-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-16350: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Datanode

[jira] [Assigned] (HDFS-16333) fix balancer bug when transfer an EC block

2021-11-23 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-16333: -- Assignee: qinyuren > fix balancer bug when transfer an EC block >

[jira] [Resolved] (HDFS-16320) Datanode retrieve slownode information from NameNode

2021-11-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16320. Fix Version/s: 3.4.0 Resolution: Fixed > Datanode retrieve slownode information from NameNode >

[jira] [Resolved] (HDFS-16287) Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable

2021-11-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16287. Fix Version/s: 3.4.0 Resolution: Fixed > Support to make dfs.namenode.avoid.read.slow.datanode

[jira] [Resolved] (HDFS-16305) Record the remote NameNode address when the rolling log is triggered

2021-11-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16305. Fix Version/s: 3.4.0 Resolution: Fixed > Record the remote NameNode address when the rolling log is

[jira] [Resolved] (HDFS-16302) RBF: RouterRpcFairnessPolicyController record requests handled by each nameservice

2021-11-07 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16302. Fix Version/s: 3.4.0 Resolution: Fixed > RBF: RouterRpcFairnessPolicyController record requests

[jira] [Resolved] (HDFS-16296) RBF: RouterRpcFairnessPolicyController add denied permits for each nameservice

2021-11-04 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16296. Fix Version/s: 3.4.0 Resolution: Fixed > RBF: RouterRpcFairnessPolicyController add denied permits

[jira] [Resolved] (HDFS-16291) Make the comment of INode#ReclaimContext more standardized

2021-11-03 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16291. Fix Version/s: 3.4.0 Resolution: Fixed > Make the comment of INode#ReclaimContext more standardized

[jira] [Resolved] (HDFS-16281) Fix flaky unit tests failed due to timeout

2021-10-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16281. Fix Version/s: 3.4.0 Resolution: Fixed > Fix flaky unit tests failed due to timeout >

[jira] [Resolved] (HDFS-16244) Add the necessary write lock in Checkpointer#doCheckpoint()

2021-10-13 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16244. Fix Version/s: 3.4.0 Resolution: Fixed > Add the necessary write lock in

[jira] [Resolved] (HDFS-16264) When adding block keys, the records come from the specific Block Pool

2021-10-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16264. Fix Version/s: 3.4.0 Resolution: Fixed > When adding block keys, the records come from the specific

  1   2   3   4   >