[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15574: -- Component/s: datanode > Remove unnecessary sort of block list in DirectoryScanner >

[jira] [Updated] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-12862: -- Hadoop Flags: Reviewed Environment: (was: ) > CacheDirective becomes invalid when NN restart

[jira] [Updated] (HDFS-15508) [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15508: -- Hadoop Flags: Reviewed > [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module >

[jira] [Updated] (HDFS-15508) [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15508: -- Affects Version/s: 3.3.1 3.4.0 > [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf

[jira] [Updated] (HDFS-15506) [JDK 11] Fix javadoc errors in hadoop-hdfs module

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15506: -- Affects Version/s: 3.3.1 3.4.0 > [JDK 11] Fix javadoc errors in hadoop-hdfs

[jira] [Updated] (HDFS-15499) Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15499: -- Affects Version/s: 3.3.1 3.4.0 > Clean up httpfs/pom.xml to remove

[jira] [Updated] (HDFS-15524) Add edit log entry for Snapshot deletion GC thread snapshot deletion

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15524: -- Hadoop Flags: Reviewed > Add edit log entry for Snapshot deletion GC thread snapshot deletion >

[jira] [Updated] (HDFS-15507) [JDK 11] Fix javadoc errors in hadoop-hdfs-client module

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15507: -- Affects Version/s: 3.3.1 3.4.0 > [JDK 11] Fix javadoc errors in

[jira] [Updated] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15493: -- Affects Version/s: 3.3.1 3.4.0 > Update block map and name cache in parallel

[jira] [Updated] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15493: -- Hadoop Flags: Reviewed > Update block map and name cache in parallel while loading fsimage. >

[jira] [Updated] (HDFS-17001) Support getStatus API in WebHDFS

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17001: -- Target Version/s: 3.4.0 > Support getStatus API in WebHDFS > > >

[jira] [Updated] (HDFS-17000) Potential infinite loop in TestDFSStripedOutputStreamUpdatePipeline.testDFSStripedOutputStreamUpdatePipeline

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17000: -- Component/s: test > Potential infinite loop in >

[jira] [Updated] (HDFS-16999) Fix wrong use of processFirstBlockReport()

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16999: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix wrong use

[jira] [Updated] (HDFS-17000) Potential infinite loop in TestDFSStripedOutputStreamUpdatePipeline.testDFSStripedOutputStreamUpdatePipeline

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17000: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Potential infinite loop in >

[jira] [Updated] (HDFS-16965) Add switch to decide whether to enable native codec.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16965: -- Target Version/s: 3.4.0 > Add switch to decide whether to enable native codec. >

[jira] [Updated] (HDFS-16971) Add read time metrics for remote reads in Statistics

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16971: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add read time metrics for remote reads in

[jira] [Updated] (HDFS-16946) RBF: top real owners metrics can't been parsed json string

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16946: -- Target Version/s: 3.4.0 > RBF: top real owners metrics can't been parsed json string >

[jira] [Updated] (HDFS-16947) RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16947: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16954) RBF: The operation of renaming a multi-subcluster directory to a single-cluster directory should throw ioexception

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16954: -- Target Version/s: 3.4.0 > RBF: The operation of renaming a multi-subcluster directory to a >

[jira] [Updated] (HDFS-16953) RBF: Mount table store APIs should update cache only if state store record is successfully updated

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16953: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Mount table

[jira] [Updated] (HDFS-16939) Fix the thread safety bug in LowRedundancyBlocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16939: -- Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5 3.4.0 > Fix the

[jira] [Updated] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16943: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Implement MySQL based StateStoreDriver >

[jira] [Updated] (HDFS-16964) Improve processing of excess redundancy after failover

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16964: -- Component/s: block placement Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Improve

[jira] [Updated] (HDFS-16959) RBF: State store cache loading metrics

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16959: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: State store

[jira] [Updated] (HDFS-16949) Update ReadTransferRate to ReadLatencyPerGB for effective percentile metrics

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16949: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Update ReadTransferRate to ReadLatencyPerGB

[jira] [Updated] (HDFS-16967) RBF: File based state stores should allow concurrent access to the records

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16967: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16948) Update log of BlockManager#chooseExcessRedundancyStriped when EC internal block is moved by balancer

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16948: -- Component/s: erasure-coding Target Version/s: 3.4.0 > Update log of

[jira] [Updated] (HDFS-16914) Add some logs for updateBlockForPipeline RPC.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16914: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 > Add some logs for updateBlockForPipeline RPC.

[jira] [Updated] (HDFS-16910) Fix incorrectly initializing RandomAccessFile caused flush performance decreased for JN

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16910: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix incorrectly initializing RandomAccessFile

[jira] [Updated] (HDFS-16917) Add transfer rate quantile metrics for DataNode reads

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16917: -- Hadoop Flags: Reviewed Target Version/s: 3.3.0, 3.4.0 Affects Version/s: 3.3.0

[jira] [Updated] (HDFS-16881) Warn if AccessControlEnforcer runs for a long time to check permission

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16881: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Warn if AccessControlEnforcer runs for a long

[jira] [Updated] (HDFS-16882) RBF: Add cache hit rate metric in MountTableResolver#getDestinationForPath

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16882: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 > RBF: Add cache hit rate metric in

[jira] [Updated] (HDFS-16877) Namenode doesn't use alignment context in TestObserverWithRouter

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16877: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Namenode

[jira] [Updated] (HDFS-16873) FileStatus compareTo does not specify ordering

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16873: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > FileStatus compareTo does not specify ordering

[jira] [Updated] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16876: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Garbage

[jira] [Updated] (HDFS-16879) EC : Fsck -blockId shows number of redundant internal block replicas for EC Blocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16879: -- Target Version/s: 3.4.0 > EC : Fsck -blockId shows number of redundant internal block replicas for EC

[jira] [Updated] (HDFS-16879) EC : Fsck -blockId shows number of redundant internal block replicas for EC Blocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16879: -- Affects Version/s: 3.4.0 > EC : Fsck -blockId shows number of redundant internal block replicas for EC

[jira] [Updated] (HDFS-16879) EC : Fsck -blockId shows number of redundant internal block replicas for EC Blocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16879: -- Component/s: erasure-coding > EC : Fsck -blockId shows number of redundant internal block replicas for

[jira] [Updated] (HDFS-16838) Fix NPE in testAddRplicaProcessorForAddingReplicaInMap

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16838: -- Component/s: test > Fix NPE in testAddRplicaProcessorForAddingReplicaInMap >

[jira] [Updated] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16839: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Updated] (HDFS-16831) [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16831: -- Affects Version/s: 3.4.0 > [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes >

[jira] [Updated] (HDFS-16831) [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16831: -- Target Version/s: 3.4.0 > [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes >

[jira] [Updated] (HDFS-16826) [RBF SBN] ConnectionManager should advance the client stateId for every request

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16826: -- Component/s: namanode rbf Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16831) [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16831: -- Component/s: namanode rbf > [RBF SBN] GetNamenodesForNameserviceId should shuffle

[jira] [Updated] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16822: -- Affects Version/s: 3.3.6 3.4.0 > HostRestrictingAuthorizationFilter should pass

[jira] [Updated] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16822: -- Component/s: webhdfs > HostRestrictingAuthorizationFilter should pass through requests if they don't

[jira] [Updated] (HDFS-16817) Remove useless DataNode lock related configuration

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16817: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Remove useless

[jira] [Updated] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16822: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 > HostRestrictingAuthorizationFilter

[jira] [Updated] (HDFS-16774) Improve async delete replica on datanode

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16774: -- Component/s: datanode > Improve async delete replica on datanode >

[jira] [Updated] (HDFS-16776) Erasure Coding: The length of targets should be checked when DN gets a reconstruction task

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16776: -- Component/s: erasure-coding Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0

[jira] [Updated] (HDFS-16770) [Documentation] RBF: Duplicate statement to be removed for better readabilty

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16770: -- Component/s: documentation rbf Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16774) Improve async delete replica on datanode

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16774: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Improve async delete replica on datanode >

[jira] [Updated] (HDFS-16771) JN should tersely print logs about NewerTxnIdException

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16771: -- Component/s: journal-node Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (HDFS-16689) Standby NameNode crashes when transitioning to Active with in-progress tailer

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16689: -- Component/s: namanode Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16687) RouterFsckServlet replicates code from DfsServlet base class

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16687: -- Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5 3.4.0 >

[jira] [Updated] (HDFS-16907) Add LastHeartbeatResponseTime for BP service actor

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16907: -- Hadoop Flags: Reviewed > Add LastHeartbeatResponseTime for BP service actor >

[jira] [Updated] (HDFS-16904) Close webhdfs during the teardown

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16904: -- Target Version/s: 3.4.0, 3.3.9 > Close webhdfs during the teardown > -

[jira] [Assigned] (HDFS-16904) Close webhdfs during the teardown

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-16904: - Assignee: Steve Vaughan > Close webhdfs during the teardown > -

[jira] [Updated] (HDFS-16910) Fix incorrectly initializing RandomAccessFile caused flush performance decreased for JN

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16910: -- Component/s: namanode > Fix incorrectly initializing RandomAccessFile caused flush performance >

[jira] [Updated] (HDFS-16911) Distcp with snapshot diff to support Ozone filesystem.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16911: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Distcp with

[jira] [Updated] (HDFS-16908) Fix javadoc of field IncrementalBlockReportManager#readyToSend.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16908: -- Target Version/s: 3.4.0 > Fix javadoc of field IncrementalBlockReportManager#readyToSend. >

[jira] [Updated] (HDFS-16888) BlockManager#maxReplicationStreams, replicationStreamsHardLimit, blocksReplWorkMultiplier and PendingReconstructionBlocks#timeout should be volatile

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16888: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Updated] (HDFS-16888) BlockManager#maxReplicationStreams, replicationStreamsHardLimit, blocksReplWorkMultiplier and PendingReconstructionBlocks#timeout should be volatile

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16888: -- Component/s: block placement > BlockManager#maxReplicationStreams, replicationStreamsHardLimit, >

[jira] [Updated] (HDFS-16893) Standardize the usage of DFSClient debug log

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16893: -- Hadoop Flags: Reviewed > Standardize the usage of DFSClient debug log >

[jira] [Updated] (HDFS-16873) FileStatus compareTo does not specify ordering

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16873: -- Component/s: documentation > FileStatus compareTo does not specify ordering >

[jira] [Assigned] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-16872: - Assignee: Chengbing Liu > Fix log throttling by declaring LogThrottlingHelper as static members

[jira] [Updated] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16872: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 > Fix log throttling by declaring

[jira] [Updated] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16872: -- Component/s: namanode > Fix log throttling by declaring LogThrottlingHelper as static members >

[jira] [Updated] (HDFS-16873) FileStatus compareTo does not specify ordering

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16873: -- Hadoop Flags: Reviewed > FileStatus compareTo does not specify ordering >

[jira] [Updated] (HDFS-16852) Register the shutdown hook only when not in shutdown for KeyProviderCache constructor

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16852: -- Hadoop Flags: Reviewed Affects Version/s: 3.3.6 3.4.0

[jira] [Assigned] (HDFS-16858) Dynamically adjust max slow disks to exclude

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-16858: - Assignee: dingshun > Dynamically adjust max slow disks to exclude >

[jira] [Updated] (HDFS-16851) RBF: Add a utility to dump the StateStore

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16851: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Updated] (HDFS-16848) RBF: Improve StateStoreZookeeperImpl

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16848: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Improve StateStoreZookeeperImpl >

[jira] [Updated] (HDFS-16847) RBF: StateStore writer should not commit tmp fail if there was an error in writing the file.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16847: -- Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16846) EC: Only EC blocks should be effected by max-streams-hard-limit configuration

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16846: -- Component/s: erasure-coding (was: ec) Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16832: -- Component/s: namanode Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0

[jira] [Updated] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16833: -- Component/s: erasure-coding > NameNode should log internal EC blocks instead of the EC block group

[jira] [Updated] (HDFS-16834) PoolAlignmentContext should not max poolLocalStateId with sharedGlobalStateId when sending requests to the namenode.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16834: -- Component/s: namnode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (HDFS-16836) StandbyCheckpointer can still trigger rollback fs image after RU is finalized

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16836: -- Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16837) [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max state id for each namespace

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16837: -- Target Version/s: 3.4.0 > [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max

[jira] [Updated] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16833: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > NameNode

[jira] [Updated] (HDFS-16764) ObserverNamenode handles addBlock rpc and throws a FileNotFoundException

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16764: -- Component/s: namanode Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0

[jira] [Updated] (HDFS-16748) RBF: DFSClient should uniquely identify writing files by namespace id and iNodeId

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16748: -- Affects Version/s: 3.4.0 > RBF: DFSClient should uniquely identify writing files by namespace id and

[jira] [Updated] (HDFS-16748) RBF: DFSClient should uniquely identify writing files by namespace id and iNodeId

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16748: -- Component/s: rbf Target Version/s: 3.4.0 > RBF: DFSClient should uniquely identify writing

[jira] [Updated] (HDFS-16750) NameNode should use NameNode.getRemoteUser() to log audit event to avoid possible NPE

2024-01-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16750: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > NameNode

[jira] [Updated] (HDFS-16974) Consider volumes average load of each DataNode when choosing target.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16974: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Consider

[jira] [Updated] (HDFS-16985) Fix data missing issue when delete local block file.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16985: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix data missing issue when delete local block

[jira] [Updated] (HDFS-16982) Use the right Quantiles Array for Inverse Quantiles snapshot

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16982: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Use the right Quantiles Array for Inverse

[jira] [Updated] (HDFS-16983) Fix concat operation doesn't honor dfs.permissions.enabled

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16983: -- Target Version/s: 3.4.0 > Fix concat operation doesn't honor dfs.permissions.enabled >

[jira] [Updated] (HDFS-16981) Support getFileLinkStatus API in WebHDFS

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16981: -- Target Version/s: 3.4.0 > Support getFileLinkStatus API in WebHDFS >

[jira] [Updated] (HDFS-16979) RBF: Add dfsrouter port in hdfsauditlog

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16979: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Add dfsrouter

[jira] [Updated] (HDFS-16978) RBF: Admin command to support bulk add of mount points

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16978: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Admin command

[jira] [Updated] (HDFS-16975) FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16975: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > FileWithSnapshotFeature.isCurrentFileDeleted

[jira] [Updated] (HDFS-16973) RBF: MountTableResolver cache size lookup should take read lock

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16973: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF:

[jira] [Updated] (HDFS-16972) Delete a snapshot may deleteCurrentFile

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16972: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Delete a

[jira] [Updated] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16902: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Updated] (HDFS-16903) Fix javadoc of Class LightWeightResizableGSet

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16903: -- Target Version/s: 3.4.0 > Fix javadoc of Class LightWeightResizableGSet >

[jira] [Updated] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16902: -- Component/s: namanode > Add Namenode status to BPServiceActor metrics and improve logging in >

[jira] [Updated] (HDFS-16901) RBF: Routers should propagate the real user in the UGI via the caller context

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16901: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 > RBF: Routers should propagate the real

[jira] [Updated] (HDFS-16898) Remove write lock for processCommandFromActor of DataNode to reduce impact on heartbeat

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16898: -- Target Version/s: 3.4.0, 3.3.7 > Remove write lock for processCommandFromActor of DataNode to reduce

<    9   10   11   12   13   14   15   16   >