[jira] [Updated] (HDFS-16616) Remove the use if Sets#newHashSet and Sets#newTreeSet

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16616: -- Component/s: hdfs-common Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16522) Set Http and Ipc ports for Datanodes in MiniDFSCluster

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16522: -- Component/s: tets Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 Affects

[jira] [Updated] (HDFS-16502) Reconfigure Block Invalidate limit

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16502: -- Component/s: block placement Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0

[jira] [Updated] (HDFS-16481) Provide support to set Http and Rpc ports in MiniJournalCluster

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16481: -- Component/s: test Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16054) Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16054: -- Component/s: hdfs-common Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16435) Remove no need TODO comment for ObserverReadProxyProvider

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16435: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Remove no need

[jira] [Updated] (HDFS-16541) Fix a typo in NameNodeLayoutVersion.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16541: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix a typo in N

[jira] [Updated] (HDFS-16587) Allow configuring Handler number for the JournalNodeRpcServer

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16587: -- Component/s: journal-node Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Allow confi

[jira] [Updated] (HDFS-16339) Show the threshold when mover threads quota is exceeded

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16339: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16335) Fix HDFSCommands.md

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16335: -- Component/s: documentation Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16326) Simplify the code for DiskBalancer

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16326: -- Component/s: diskbalancer Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2, 3.4

[jira] [Updated] (HDFS-16319) Add metrics doc for ReadLockLongHoldCount and WriteLockLongHoldCount

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16319: -- Component/s: metrics Target Version/s: 3.3.2, 3.4.0 Affects Version/s: 3.3.2

[jira] [Updated] (HDFS-16298) Improve error msg for BlockMissingException

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16298: -- Component/s: hdfs-client Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2, 2.10

[jira] [Updated] (HDFS-16312) Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16312: -- Component/s: datanode metrics Hadoop Flags: Reviewed Target V

[jira] [Updated] (HDFS-16280) Fix typo for ShortCircuitReplica#isStale

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16280: -- Component/s: hdfs-client Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix typo for

[jira] [Updated] (HDFS-16281) Fix flaky unit tests failed due to timeout

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16281: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version

[jira] [Updated] (HDFS-16194) Simplify the code with DatanodeID#getXferAddrWithHostname

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16194: -- Component/s: datanode metrics namanode Target V

[jira] [Updated] (HDFS-16131) Show storage type for failed volumes on namenode web

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16131: -- Component/s: namanode ui Target Version/s: 3.4.0 Affects Version/s

[jira] [Updated] (HDFS-16110) Remove unused method reportChecksumFailure in DFSClient

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16110: -- Component/s: dfsclient Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Ve

[jira] [Updated] (HDFS-16106) Fix flaky unit test TestDFSShell

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16106: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version

[jira] [Updated] (HDFS-16089) EC: Add metric EcReconstructionValidateTimeMillis for StripedBlockReconstructor

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16089: -- Component/s: erasure-coding metrics Hadoop Flags: Reviewed Ta

[jira] [Updated] (HDFS-16104) Remove unused parameter and fix java doc for DiskBalancerCLI

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16104: -- Component/s: diskbalancer documentation Target Version/s: 3.4.0 Af

[jira] [Updated] (HDFS-16079) Improve the block state change log

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16079: -- Component/s: block placement Target Version/s: 3.3.2, 3.4.0 Affects Version/s: 3.3.2

[jira] [Updated] (HDFS-16078) Remove unused parameters for DatanodeManager.handleLifeline()

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16078: -- Component/s: namanode Target Version/s: 3.3.2, 3.2.3, 3.4.0 Affects Version/s: 3.3.2

[jira] [Updated] (HDFS-15991) Add location into datanode info for NameNodeMXBean

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15991: -- Component/s: metrics namanode Hadoop Flags: Reviewed Target V

[jira] [Assigned] (HDFS-16535) SlotReleaser should reuse the domain socket based on socket paths

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-16535: - Assignee: Quanlong Huang > SlotReleaser should reuse the domain socket based on socket paths > -

[jira] [Updated] (HDFS-15951) Remove unused parameters in NameNodeProxiesClient

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15951: -- Component/s: hdfs-client Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0 A

[jira] [Updated] (HDFS-15975) Use LongAdder instead of AtomicLong

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15975: -- Component/s: metrics Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0 Affec

[jira] [Updated] (HDFS-15938) Fix java doc in FSEditLog

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15938: -- Component/s: documentation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix java d

[jira] [Updated] (HDFS-15906) Close FSImage and FSNamesystem after formatting is complete

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15906: -- Component/s: namanode Hadoop Flags: Reviewed Target Version/s: 3.2.3, 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15892) Add metric for editPendingQ in FSEditLogAsync

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15892: -- Component/s: metrics Hadoop Flags: Reviewed Target Version/s: 3.2.3, 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15870) Remove unused configuration dfs.namenode.stripe.min

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15870: -- Component/s: configuration Hadoop Flags: Reviewed Target Version/s: 3.2.3, 3.3.1, 3.

[jira] [Updated] (HDFS-15854) Make some parameters configurable for SlowDiskTracker and SlowPeerTracker

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15854: -- Component/s: block placement Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13274: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Extend RouterRp

[jira] [Updated] (HDFS-16598) Fix DataNode FsDatasetImpl lock issue without GS checks.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16598: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix DataNode Fs

[jira] [Updated] (HDFS-16600) Fix deadlock of fine-grain lock for FsDatastImpl of DataNode.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16600: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix deadlock of

[jira] [Updated] (HDFS-16526) Add metrics for slow DataNode

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16526: -- Component/s: datanode metrics Target Version/s: 3.4.0 Affects Vers

[jira] [Updated] (HDFS-16488) [SPS]: Expose metrics to JMX for external SPS

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16488: -- Component/s: metrics sps Hadoop Flags: Reviewed Target Versio

[jira] [Updated] (HDFS-16460) [SPS]: Handle failure retries for moving tasks

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16460: -- Component/s: sps Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/

[jira] [Updated] (HDFS-16484) [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16484: -- Component/s: sps Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.2.4, 3.4.0 Af

[jira] [Updated] (HDFS-15987) Improve oiv tool to parse fsimage file in parallel with delimited format

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15987: -- Component/s: tools Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Improve oiv tool t

[jira] [Updated] (HDFS-16477) [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16477: -- Component/s: sps Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > [SPS]: Add metric Pe

[jira] [Updated] (HDFS-16499) [SPS]: Should not start indefinitely while another SPS process is running

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16499: -- Component/s: sps Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13248: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.3.5, 2.10.2, 3.4.0 A

[jira] [Updated] (HDFS-16458) [SPS]: Fix bug for unit test of reconfiguring SPS mode

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16458: -- Component/s: sps test Hadoop Flags: Reviewed Target Version/s

[jira] [Updated] (HDFS-16222) Fix ViewDFS with mount points for HDFS only API

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16222: -- Component/s: viewfs Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix ViewDFS with

[jira] [Updated] (HDFS-16231) Fix TestDataNodeMetrics#testReceivePacketSlowMetrics

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16231: -- Component/s: datanode metrics Hadoop Flags: Reviewed Target V

[jira] [Updated] (HDFS-16192) ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16192: -- Component/s: viewfs Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0 Affect

[jira] [Updated] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15671: -- Component/s: balancer test Hadoop Flags: Reviewed Target Vers

[jira] [Updated] (HDFS-15973) RBF: Add permission check before doing router federation rename.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15973: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/

[jira] [Updated] (HDFS-13975) TestBalancer#testMaxIterationTime fails sporadically

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13975: -- Component/s: balancer test Target Version/s: 3.2.3, 2.10.2, 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15848: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Ve

[jira] [Updated] (HDFS-15847) create client protocol: add ecPolicyName & storagePolicy param to debug statement string

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15847: -- Component/s: erasure-coding namanode Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15834) Remove the usage of org.apache.log4j.Level

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15834: -- Component/s: hdfs-common Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15820) Ensure snapshot root trash provisioning happens only post safe mode exit

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15820: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Ve

[jira] [Updated] (HDFS-15817) Rename snapshots while marking them deleted

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15817: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Ve

[jira] [Updated] (HDFS-15767) RBF: Router federation rename of directory.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15767: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Router federati

[jira] [Updated] (HDFS-15672) TestBalancerWithMultipleNameNodes#testBalancingBlockpoolsWithBlockPoolPolicy fails on trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15672: -- Component/s: balancer test Target Version/s: 3.2.3, 3.3.1, 3.4.0 A

[jira] [Updated] (HDFS-15762) TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStream fails intermittently

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15762: -- Component/s: hdfs test Target Version/s: 3.2.3, 3.3.1, 3.4.0 Affec

[jira] [Updated] (HDFS-14558) RBF: Isolation/Fairness documentation

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14558: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Isolation/Fairn

[jira] [Updated] (HDFS-15702) Fix intermittent falilure of TestDecommission#testAllocAndIBRWhileDecommission

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15702: -- Component/s: hdfs test Target Version/s: 3.4.0 Affects Version/s:

[jira] [Updated] (HDFS-15766) RBF: MockResolver.getMountPoints() breaks the semantic of FileSubclusterResolver.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15766: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: MockResolver.ge

[jira] [Updated] (HDFS-15748) RBF: Move the router related part from hadoop-federation-balance module to hadoop-hdfs-rbf.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15748: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Move the router

[jira] [Updated] (HDFS-15648) TestFileChecksum should be parameterized

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15648: -- Component/s: test Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > TestFileChecksum sh

[jira] [Updated] (HDFS-15677) TestRouterRpcMultiDestination#testGetCachedDatanodeReport fails on trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15677: -- Component/s: rbf test Target Version/s: 3.4.0 Affects Version/s: 3

[jira] [Updated] (HDFS-15674) TestBPOfferService#testMissBlocksWhenReregister fails on trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15674: -- Component/s: datanode test Target Version/s: 3.3.6, 3.4.0 Affects

[jira] [Updated] (HDFS-15643) EC: Fix checksum computation in case of native encoders

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15643: -- Component/s: erasure-coding Target Version/s: 3.2.3, 3.3.1, 3.2.2, 3.4.0 Affects Version/

[jira] [Updated] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15460: -- Component/s: hdfs test Target Version/s: 3.4.0 Affects Version/s:

[jira] [Updated] (HDFS-9776) TestHAAppend#testMultipleAppendsDuringCatchupTailing is flaky

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-9776: - Component/s: test Target Version/s: 3.2.3, 3.3.1, 3.2.2, 3.4.0 Affects Version/s: 3.2.3

[jira] [Updated] (HDFS-15640) Add diff threshold to FedBalance

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15640: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add diff threshold t

[jira] [Updated] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15614: -- Component/s: namanode snapshots Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-15598) ViewHDFS#canonicalizeUri should not be restricted to DFS only API.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15598: -- Component/s: viewfs Target Version/s: 3.4.0 > ViewHDFS#canonicalizeUri should not be restricte

[jira] [Updated] (HDFS-15585) ViewDFS#getDelegationToken should not throw UnsupportedOperationException.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15585: -- Component/s: viewfs Target Version/s: 3.3.1, 3.4.0 > ViewDFS#getDelegationToken should not thr

[jira] [Updated] (HDFS-15532) listFiles on root/InternalDir will fail if fallback root has file

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15532: -- Component/s: viewfs Target Version/s: 3.3.1, 3.4.0 > listFiles on root/InternalDir will fail i

[jira] [Updated] (HDFS-15558) ViewDistributedFileSystem#recoverLease should call super.recoverLease when there are no mounts configured

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15558: -- Component/s: viewfs Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (HDFS-15496) Add UI for deleted snapshots

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15496: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Ve

[jira] [Updated] (HDFS-15518) Wrong operation name in FsNamesystem for listSnapshots

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15518: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Ve

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15374: -- Component/s: documentation rbf Target Version/s: 3.4.0 Affects Ver

[jira] [Updated] (HDFS-15410) Add separated config file hdfs-fedbalance-default.xml for fedbalance tool

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15410: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add separated config

[jira] [Updated] (HDFS-15346) FedBalance tool implementation

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15346: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > FedBalance tool impl

[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15340: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Implement Balan

[jira] [Updated] (HDFS-15146) TestBalancerRPCDelay. testBalancerRPCDelayQpsDefault fails intermittently

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15146: -- Component/s: balancer test Target Version/s: 2.10.1, 3.2.2, 3.3.0, 3.4

[jira] [Updated] (HDFS-15898) Test case TestOfflineImageViewer fails

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15898: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0 Affects

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15576: -- Component/s: erasure-coding test Hadoop Flags: Reviewed Targe

[jira] [Updated] (HDFS-15690) Add lz4-java as hadoop-hdfs test dependency

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15690: -- Component/s: test Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15559: -- Component/s: test Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Complement initiali

[jira] [Updated] (HDFS-16550) [SBN read] Improper cache-size for journal node may cause cluster crash

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16550: -- Component/s: journal-node Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16547) [SBN read] Namenode in safe mode should not be transfered to observer state

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16547: -- Component/s: namanode Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Ver

[jira] [Updated] (HDFS-16593) Correct inaccurate BlocksRemoved metric on DataNode side

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16593: -- Component/s: datanode metrics Target Version/s: 3.4.0 Affects Vers

[jira] [Updated] (HDFS-16659) JournalNode should throw NewerTxnIdException if SinceTxId is bigger than HighestWrittenTxId

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16659: -- Component/s: journal-node Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16623) IllegalArgumentException in LifelineSender

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16623: -- Component/s: datanode Target Version/s: 3.3.5, 3.2.4, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16583: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.2.4, 3.4.0

[jira] [Updated] (HDFS-15225) RBF: Add snapshot counts to content summary in router

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15225: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Add snapshot co

[jira] [Updated] (HDFS-16572) Fix typo in readme of hadoop-project-dist

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16572: -- Component/s: documentation Hadoop Flags: Reviewed Target Version/s: 3.4.0 > Fix typo i

[jira] [Updated] (HDFS-16552) Fix NPE for TestBlockManager

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16552: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.2.4, 3.4.0 A

[jira] [Updated] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16507: -- Component/s: namanode Target Version/s: 3.3.3, 3.4.0 (was: 3.3.3) > [SBN read] Avoid purging

[jira] [Updated] (HDFS-16498) Fix NPE for checkBlockReportLease

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16498: -- Component/s: datanode namanode Target Version/s: 3.4.0 Affects Ver

[jira] [Updated] (HDFS-16503) Should verify whether the path name is valid in the WebHDFS

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16503: -- Component/s: webhdfs Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Should verify wh

[jira] [Updated] (HDFS-16406) DataNode metric ReadsFromLocalClient does not count short-circuit reads

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16406: -- Component/s: datanode metrics Hadoop Flags: Reviewed Target V

[jira] [Updated] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16303: -- Component/s: block placement datanode Target Version/s: 3.3.5, 3.2.4, 3.4

  1   2   3   >