[jira] [Updated] (HDFS-17011) Fix the metric of "HttpPort" at DataNodeInfo

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17011: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Updated] (HDFS-17011) Fix the metric of "HttpPort" at DataNodeInfo

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17011: -- Component/s: datanode > Fix the metric of "HttpPort" at DataNodeInfo >

[jira] [Updated] (HDFS-17010) Add a subtree test to TestSnapshotDiffReport

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17010: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add a subtree test to TestSnapshotDiffReport >

[jira] [Updated] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17017: -- Component/s: dfsadmin Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Updated] (HDFS-17011) Fix the metric of "HttpPort" at DataNodeInfo

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17011: -- Labels: pull-request-available (was: ) > Fix the metric of "HttpPort" at DataNodeInfo >

[jira] [Updated] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17298: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0, 3.3.9 Affects Version/s: 3.4.0

[jira] [Updated] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17294: -- Component/s: configuration > Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread. >

[jira] [Updated] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17297: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0, 3.3.9 Affects Version/s: 3.4.0

[jira] [Updated] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17301: -- Component/s: datanode > Add read and write dataXceiver threads count metrics to datanode. >

[jira] [Updated] (HDFS-17315) Optimize the namenode format code logic.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17315: -- Hadoop Flags: Reviewed > Optimize the namenode format code logic. >

[jira] [Updated] (HDFS-17315) Optimize the namenode format code logic.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17315: -- Component/s: namenode (was: namanode) > Optimize the namenode format code logic.

[jira] [Updated] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17301: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add read and

[jira] [Updated] (HDFS-17093) Fix block report lease issue to avoid missing some storages report.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17093: -- Target Version/s: 3.4.0 > Fix block report lease issue to avoid missing some storages report. >

[jira] [Updated] (HDFS-17105) mistakenly purge editLogs even after it is empty in NNStorageRetentionManager

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17105: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > mistakenly

[jira] [Updated] (HDFS-17116) RBF: Update invoke millisecond time as monotonicNow() in RouterSafemodeService.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17116: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Update invoke

[jira] [Updated] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17111: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Optimize msync

[jira] [Updated] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17094: -- Component/s: erasure-coding Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (HDFS-17112) Show decommission duration in JMX and HTML

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17112: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Show decommission duration in JMX and HTML >

[jira] [Updated] (HDFS-17115) HttpFS Add Support getErasureCodeCodecs API

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17115: -- Target Version/s: 3.4.0 > HttpFS Add Support getErasureCodeCodecs API >

[jira] [Updated] (HDFS-17117) Print reconstructionQueuesInitProgress periodically when BlockManager processMisReplicatesAsync.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17117: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Print reconstructionQueuesInitProgress

[jira] [Updated] (HDFS-17019) Optimize the logic for reconfigure slow peer enable for Namenode

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17019: -- Hadoop Flags: Reviewed > Optimize the logic for reconfigure slow peer enable for Namenode >

[jira] [Updated] (HDFS-17020) RBF: mount table addAll should print failed records in std error

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17020: -- Component/s: rbf > RBF: mount table addAll should print failed records in std error >

[jira] [Updated] (HDFS-17018) Improve dfsclient log format

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17018: -- Target Version/s: 3.4.0 > Improve dfsclient log format > > >

[jira] [Updated] (HDFS-17019) Optimize the logic for reconfigure slow peer enable for Namenode

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17019: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Optimize the

[jira] [Updated] (HDFS-17020) RBF: mount table addAll should print failed records in std error

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17020: -- Target Version/s: 3.4.0 > RBF: mount table addAll should print failed records in std error >

[jira] [Updated] (HDFS-15596) ViewHDFS#create(f, permission, cflags, bufferSize, replication, blockSize, progress, checksumOpt) should not be restricted to DFS only.

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15596: -- Affects Version/s: 3.4.0 > ViewHDFS#create(f, permission, cflags, bufferSize, replication, blockSize,

[jira] [Updated] (HDFS-15607) Create trash dir when allowing snapshottable dir

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15607: -- Hadoop Flags: Reviewed > Create trash dir when allowing snapshottable dir >

[jira] [Updated] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-1: -- Affects Version/s: 3.3.1 3.4.0 > RBF: Refresh cacheNS when SocketException

[jira] [Updated] (HDFS-15542) Add identified snapshot corruption tests for ordered snapshot deletion

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15542: -- Hadoop Flags: Reviewed > Add identified snapshot corruption tests for ordered snapshot deletion >

[jira] [Updated] (HDFS-15541) Disallow making a Snapshottable directory unsnapshottable if it has no empty snapshot trash directory

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15541: -- Fix Version/s: (was: 3.4.0) > Disallow making a Snapshottable directory unsnapshottable if it has

[jira] [Updated] (HDFS-15540) Directories protected from delete can still be moved to the trash

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15540: -- Hadoop Flags: Reviewed > Directories protected from delete can still be moved to the trash >

[jira] [Updated] (HDFS-15542) Add identified snapshot corruption tests for ordered snapshot deletion

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15542: -- Component/s: test > Add identified snapshot corruption tests for ordered snapshot deletion >

[jira] [Updated] (HDFS-15539) When disallowing snapshot on a dir, throw exception if its trash root is not empty

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15539: -- Affects Version/s: 3.4.0 > When disallowing snapshot on a dir, throw exception if its trash root is

[jira] [Updated] (HDFS-15539) When disallowing snapshot on a dir, throw exception if its trash root is not empty

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15539: -- Hadoop Flags: Reviewed > When disallowing snapshot on a dir, throw exception if its trash root is not

[jira] [Updated] (HDFS-15524) Add edit log entry for Snapshot deletion GC thread snapshot deletion

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15524: -- Affects Version/s: 3.4.0 > Add edit log entry for Snapshot deletion GC thread snapshot deletion >

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15492: -- Hadoop Flags: Reviewed > Make trash root inside each snapshottable directory >

[jira] [Updated] (HDFS-15488) Add a command to list all snapshots for a snaphottable root with snapshot Ids

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15488: -- Affects Version/s: 3.4.0 > Add a command to list all snapshots for a snaphottable root with snapshot

[jira] [Updated] (HDFS-15449) Optionally ignore port number in mount-table name when picking from initialized uri

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15449: -- Affects Version/s: 3.3.1 3.4.0 > Optionally ignore port number in mount-table

[jira] [Updated] (HDFS-15430) create should work when parent dir is internalDir and fallback configured.

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15430: -- Component/s: hdfs > create should work when parent dir is internalDir and fallback configured. >

[jira] [Updated] (HDFS-15449) Optionally ignore port number in mount-table name when picking from initialized uri

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15449: -- Component/s: hdfs > Optionally ignore port number in mount-table name when picking from > initialized

[jira] [Updated] (HDFS-15488) Add a command to list all snapshots for a snaphottable root with snapshot Ids

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15488: -- Hadoop Flags: Reviewed > Add a command to list all snapshots for a snaphottable root with snapshot Ids

[jira] [Updated] (HDFS-15462) Add fs.viewfs.overload.scheme.target.ofs.impl to core-default.xml

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15462: -- Hadoop Flags: Reviewed > Add fs.viewfs.overload.scheme.target.ofs.impl to core-default.xml >

[jira] [Updated] (HDFS-15613) RBF: Router FSCK fails after HDFS-14442

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15613: -- Hadoop Flags: Reviewed > RBF: Router FSCK fails after HDFS-14442 >

[jira] [Updated] (HDFS-15608) Rename variable DistCp#CLEANUP

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15608: -- Hadoop Flags: Reviewed > Rename variable DistCp#CLEANUP > -- > >

[jira] [Updated] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-1: -- Hadoop Flags: Reviewed > RBF: Refresh cacheNS when SocketException occurs >

[jira] [Updated] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15545: -- Affects Version/s: 3.4.0 > (S)Webhdfs will not use updated delegation tokens available in the ugi

[jira] [Updated] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15545: -- Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0 (was: 3.4.0, 3.3.2) > (S)Webhdfs will

[jira] [Updated] (HDFS-15542) Add identified snapshot corruption tests for ordered snapshot deletion

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15542: -- Affects Version/s: 3.4.0 > Add identified snapshot corruption tests for ordered snapshot deletion >

[jira] [Updated] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15545: -- Component/s: webhdfs > (S)Webhdfs will not use updated delegation tokens available in the ugi after >

[jira] [Updated] (HDFS-15345) RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15345: -- Affects Version/s: 3.4.0 > RBF: RouterPermissionChecker#checkSuperuserPrivilege should use

[jira] [Updated] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15344: -- Affects Version/s: 3.4.0 > DataNode#checkSuperuserPrivilege should use UGI#getGroups after

[jira] [Updated] (HDFS-15345) RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15345: -- Component/s: rbf > RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups >

[jira] [Updated] (HDFS-15320) StringIndexOutOfBoundsException in HostRestrictingAuthorizationFilter

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15320: -- Affects Version/s: 3.3.1 3.4.0 > StringIndexOutOfBoundsException in

[jira] [Updated] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15344: -- Component/s: datanode > DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442 >

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesystem are not deleted during snapshot delete

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15313: -- Affects Version/s: 3.3.1 3.4.0 > Ensure inodes in active filesystem are not

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesystem are not deleted during snapshot delete

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15313: -- Hadoop Flags: Reviewed > Ensure inodes in active filesystem are not deleted during snapshot delete >

[jira] [Updated] (HDFS-15298) Fix the findbugs warnings introduced in HDFS-15217

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15298: -- Affects Version/s: 3.4.0 > Fix the findbugs warnings introduced in HDFS-15217 >

[jira] [Updated] (HDFS-15298) Fix the findbugs warnings introduced in HDFS-15217

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15298: -- Component/s: namanode > Fix the findbugs warnings introduced in HDFS-15217 >

[jira] [Updated] (HDFS-15298) Fix the findbugs warnings introduced in HDFS-15217

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15298: -- Hadoop Flags: Reviewed > Fix the findbugs warnings introduced in HDFS-15217 >

[jira] [Updated] (HDFS-15253) Set default throttle value on dfs.image.transfer.bandwidthPerSec

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15253: -- Affects Version/s: 3.3.1 3.4.0 > Set default throttle value on

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15255: -- Component/s: hdfs > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Updated] (HDFS-15253) Set default throttle value on dfs.image.transfer.bandwidthPerSec

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15253: -- Hadoop Flags: Reviewed > Set default throttle value on dfs.image.transfer.bandwidthPerSec >

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15255: -- Affects Version/s: 3.3.1 3.4.0 > Consider StorageType when

[jira] [Updated] (HDFS-15287) HDFS rollingupgrade prepare never finishes

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15287: -- Hadoop Flags: Reviewed > HDFS rollingupgrade prepare never finishes >

[jira] [Updated] (HDFS-15283) Cache pool MAXTTL is not persisted and restored on cluster restart

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15283: -- Hadoop Flags: Reviewed > Cache pool MAXTTL is not persisted and restored on cluster restart >

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15255: -- Hadoop Flags: Reviewed > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15240: -- Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.2.2, 3.4.0 (was: 3.2.2, 3.3.1, 3.4.0) >

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15240: -- Affects Version/s: 3.3.1 3.4.0 > Erasure Coding: dirty buffer causes

[jira] [Updated] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15160: -- Hadoop Flags: Reviewed Target Version/s: 3.2.3, 2.10.2, 3.4.0 (was: 3.4.0, 2.10.2, 3.2.3) >

[jira] [Updated] (HDFS-15098) Add SM4 encryption method for HDFS

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15098: -- Component/s: hdfs > Add SM4 encryption method for HDFS > -- > >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14694: -- Affects Version/s: 3.4.0 > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14013: -- Hadoop Flags: Reviewed > Skip any credentials stored in HDFS when starting ZKFC >

[jira] [Updated] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13671: -- Component/s: namnode > Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet >

[jira] [Updated] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13671: -- Hadoop Flags: Reviewed > Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet >

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13639: -- Hadoop Flags: Reviewed > SlotReleaser is not fast enough > --- > >

[jira] [Updated] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with Hadoop 3.x

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-12920: -- Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.2.3, 3.4.0 (was: 3.4.0, 3.2.3, 3.3.2) >

[jira] [Updated] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with Hadoop 3.x

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-12920: -- Affects Version/s: 3.3.2 3.4.0 > HDFS default value change (with adding time

[jira] [Updated] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15372: -- Affects Version/s: 3.3.1 3.4.0 > Files in snapshots no longer see attribute

[jira] [Updated] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15372: -- Component/s: snapshots > Files in snapshots no longer see attribute provider permissions >

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15415: -- Hadoop Flags: Reviewed > Reduce locking in Datanode DirectoryScanner >

[jira] [Updated] (HDFS-15371) Nonstandard characters exist in NameNode.java

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15371: -- Component/s: namanode > Nonstandard characters exist in NameNode.java >

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15359: -- Affects Version/s: 3.4.0 > EC: Allow closing a file with committed blocks >

[jira] [Updated] (HDFS-15350) Set dfs.client.failover.random.order to true as default

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15350: -- Affects Version/s: 3.4.0 > Set dfs.client.failover.random.order to true as default >

[jira] [Updated] (HDFS-15371) Nonstandard characters exist in NameNode.java

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15371: -- Hadoop Flags: Reviewed > Nonstandard characters exist in NameNode.java >

[jira] [Updated] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15372: -- Hadoop Flags: Reviewed > Files in snapshots no longer see attribute provider permissions >

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15422: -- Hadoop Flags: Reviewed > Reported IBR is partially replaced with stored info when queuing. >

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15422: -- Affects Version/s: 3.3.1 3.4.0 > Reported IBR is partially replaced with stored

[jira] [Updated] (HDFS-15429) mkdirs should work when parent dir is internalDir and fallback configured.

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15429: -- Component/s: hdfs > mkdirs should work when parent dir is internalDir and fallback configured. >

[jira] [Updated] (HDFS-15418) ViewFileSystemOverloadScheme should represent mount links as non symlinks

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15418: -- Affects Version/s: 3.3.1 > ViewFileSystemOverloadScheme should represent mount links as non symlinks >

[jira] [Updated] (HDFS-15418) ViewFileSystemOverloadScheme should represent mount links as non symlinks

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15418: -- Affects Version/s: 3.4.0 > ViewFileSystemOverloadScheme should represent mount links as non symlinks >

[jira] [Updated] (HDFS-15418) ViewFileSystemOverloadScheme should represent mount links as non symlinks

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15418: -- Component/s: hdfs > ViewFileSystemOverloadScheme should represent mount links as non symlinks >

[jira] [Updated] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15580: -- Affects Version/s: 3.4.0 > [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails >

[jira] [Updated] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15580: -- Hadoop Flags: Reviewed > [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails >

[jira] [Updated] (HDFS-15596) ViewHDFS#create(f, permission, cflags, bufferSize, replication, blockSize, progress, checksumOpt) should not be restricted to DFS only.

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15596: -- Component/s: hdfs-client > ViewHDFS#create(f, permission, cflags, bufferSize, replication, blockSize,

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15641: -- Hadoop Flags: Reviewed Target Version/s: 3.2.3, 3.3.1, 3.4.0 (was: 3.3.1, 3.4.0, 3.2.3) >

[jira] [Updated] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15620: -- Affects Version/s: 3.3.1 3.4.0 > RBF: Fix test failures after HADOOP-17281 >

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15641: -- Component/s: datanode > DataNode could meet deadlock if invoke refreshNameNode >

[jira] [Updated] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15621: -- Hadoop Flags: Reviewed > Datanode DirectoryScanner uses excessive memory >

[jira] [Updated] (HDFS-15573) Only log warning if considerLoad and considerStorageType are both true

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15573: -- Component/s: hdfs > Only log warning if considerLoad and considerStorageType are both true >

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2024-01-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15574: -- Hadoop Flags: Reviewed > Remove unnecessary sort of block list in DirectoryScanner >

<    8   9   10   11   12   13   14   15   16   >