[jira] [Resolved] (HDFS-17383) Datanode current block token should come from active NameNode in HA mode

[ https://issues.apache.org/jira/browse/HDFS-17383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17383. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0 Ass

[jira] [Resolved] (HDFS-17408) Reduce the number of quota calculations in FSDirRenameOp

[ https://issues.apache.org/jira/browse/HDFS-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17408. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0 Resol

[jira] [Resolved] (HDFS-17345) Add a metrics to record block report generating cost time

[ https://issues.apache.org/jira/browse/HDFS-17345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17345. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Add a metrics to reco

[jira] [Resolved] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17342. - Hadoop Flags: Reviewed Target Version/s: 3.5.0 Resolution: Fixed > Fix DataNode

[jira] [Resolved] (HDFS-17339) BPServiceActor should skip cacheReport when one blockPool does not have CacheBlock on this DataNode

[ https://issues.apache.org/jira/browse/HDFS-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17339. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0 Resol

[jira] [Resolved] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17346. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0 Resol

[jira] [Resolved] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17293. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > First packet data + c

[jira] [Resolved] (HDFS-17331) Fix Blocks are always -1 and DataNode`s version are always UNKNOWN in federationhealth.html

[ https://issues.apache.org/jira/browse/HDFS-17331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17331. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0 Ass

[jira] [Resolved] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17337. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17291. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure.

[ https://issues.apache.org/jira/browse/HDFS-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17289. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17283. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17275) Judge whether the block has been deleted in the block report

[ https://issues.apache.org/jira/browse/HDFS-17275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17275. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Assignee: lei w Resolution: Fixed

[jira] [Resolved] (HDFS-17152) Fix the documentation of count command in FileSystemShell.md

[ https://issues.apache.org/jira/browse/HDFS-17152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17152. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix the documentation

[jira] [Resolved] (HDFS-17243) Add the parameter storage type for getBlocks method

[ https://issues.apache.org/jira/browse/HDFS-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17243. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add the parameter sto

[jira] [Created] (HDFS-17227) EC: Fix bug in choosing targets when racks is not enough.

Shuyan Zhang created HDFS-17227: --- Summary: EC: Fix bug in choosing targets when racks is not enough. Key: HDFS-17227 URL: https://issues.apache.org/jira/browse/HDFS-17227 Project: Hadoop HDFS I

[jira] [Created] (HDFS-17204) EC: Reduce unnecessary log when processing excess redundancy.

Shuyan Zhang created HDFS-17204: --- Summary: EC: Reduce unnecessary log when processing excess redundancy. Key: HDFS-17204 URL: https://issues.apache.org/jira/browse/HDFS-17204 Project: Hadoop HDFS

[jira] [Created] (HDFS-17197) Show file replication when listing corrupt files.

Shuyan Zhang created HDFS-17197: --- Summary: Show file replication when listing corrupt files. Key: HDFS-17197 URL: https://issues.apache.org/jira/browse/HDFS-17197 Project: Hadoop HDFS Issue Typ

[jira] [Created] (HDFS-17190) EC: Fix bug for OIV processing XAttr.

Shuyan Zhang created HDFS-17190: --- Summary: EC: Fix bug for OIV processing XAttr. Key: HDFS-17190 URL: https://issues.apache.org/jira/browse/HDFS-17190 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-17154) EC: Fix bug in updateBlockForPipeline after failover

Shuyan Zhang created HDFS-17154: --- Summary: EC: Fix bug in updateBlockForPipeline after failover Key: HDFS-17154 URL: https://issues.apache.org/jira/browse/HDFS-17154 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-17151) EC: Fix wrong metadata in BlockInfoStriped after recovery

Shuyan Zhang created HDFS-17151: --- Summary: EC: Fix wrong metadata in BlockInfoStriped after recovery Key: HDFS-17151 URL: https://issues.apache.org/jira/browse/HDFS-17151 Project: Hadoop HDFS I

[jira] [Created] (HDFS-17150) EC: Fix the bug of failed lease recovery.

Shuyan Zhang created HDFS-17150: --- Summary: EC: Fix the bug of failed lease recovery. Key: HDFS-17150 URL: https://issues.apache.org/jira/browse/HDFS-17150 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-17134) RBF: Fix duplicate results of getListing through Router.

Shuyan Zhang created HDFS-17134: --- Summary: RBF: Fix duplicate results of getListing through Router. Key: HDFS-17134 URL: https://issues.apache.org/jira/browse/HDFS-17134 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-17112) Show decommission duration in JMX and HTML

Shuyan Zhang created HDFS-17112: --- Summary: Show decommission duration in JMX and HTML Key: HDFS-17112 URL: https://issues.apache.org/jira/browse/HDFS-17112 Project: Hadoop HDFS Issue Type: Impr

[jira] [Created] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

Shuyan Zhang created HDFS-17094: --- Summary: EC: Fix bug in block recovery when there are stale datanodes Key: HDFS-17094 URL: https://issues.apache.org/jira/browse/HDFS-17094 Project: Hadoop HDFS

[jira] [Created] (HDFS-17089) Close child files systems in ViewFileSystem when cache is disabled.

Shuyan Zhang created HDFS-17089: --- Summary: Close child files systems in ViewFileSystem when cache is disabled. Key: HDFS-17089 URL: https://issues.apache.org/jira/browse/HDFS-17089 Project: Hadoop HDFS

[jira] [Created] (HDFS-17049) Fix duplicate block group ids generated by SequentialBlockGroupIdGenerator

Shuyan Zhang created HDFS-17049: --- Summary: Fix duplicate block group ids generated by SequentialBlockGroupIdGenerator Key: HDFS-17049 URL: https://issues.apache.org/jira/browse/HDFS-17049 Project: Hadoo

[jira] [Created] (HDFS-17037) Consider nonDfsUsed when running balancer

Shuyan Zhang created HDFS-17037: --- Summary: Consider nonDfsUsed when running balancer Key: HDFS-17037 URL: https://issues.apache.org/jira/browse/HDFS-17037 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

[ https://issues.apache.org/jira/browse/HDFS-17021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17021. - Resolution: Not A Bug > GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas

[jira] [Created] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

Shuyan Zhang created HDFS-17021: --- Summary: GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas() Key: HDFS-17021 URL: https://issues.apache.org/jira/browse/HDFS-17021 Project: Hado

[jira] [Created] (HDFS-16999) Fix wrong use of processFirstBlockReport()

Shuyan Zhang created HDFS-16999: --- Summary: Fix wrong use of processFirstBlockReport() Key: HDFS-16999 URL: https://issues.apache.org/jira/browse/HDFS-16999 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16986) EC: Fix locationBudget in getListing()

Shuyan Zhang created HDFS-16986: --- Summary: EC: Fix locationBudget in getListing() Key: HDFS-16986 URL: https://issues.apache.org/jira/browse/HDFS-16986 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16974) Consider load of every volume when choosing target

Shuyan Zhang created HDFS-16974: --- Summary: Consider load of every volume when choosing target Key: HDFS-16974 URL: https://issues.apache.org/jira/browse/HDFS-16974 Project: Hadoop HDFS Issue Ty

[jira] [Created] (HDFS-16964) Improve processing of excess redundancy after failover

Shuyan Zhang created HDFS-16964: --- Summary: Improve processing of excess redundancy after failover Key: HDFS-16964 URL: https://issues.apache.org/jira/browse/HDFS-16964 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-16958) Fix bug in processing EC excess redundancy

Shuyan Zhang created HDFS-16958: --- Summary: Fix bug in processing EC excess redundancy Key: HDFS-16958 URL: https://issues.apache.org/jira/browse/HDFS-16958 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16939) Fix the thread safety bug in LowRedundancyBlocks

Shuyan Zhang created HDFS-16939: --- Summary: Fix the thread safety bug in LowRedundancyBlocks Key: HDFS-16939 URL: https://issues.apache.org/jira/browse/HDFS-16939 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-16735) Reduce the number of HeartbeatManager loops

Shuyan Zhang created HDFS-16735: --- Summary: Reduce the number of HeartbeatManager loops Key: HDFS-16735 URL: https://issues.apache.org/jira/browse/HDFS-16735 Project: Hadoop HDFS Issue Type: Imp

[jira] [Created] (HDFS-16683) All method metrics related to the rpc protocol should be initialized

Shuyan Zhang created HDFS-16683: --- Summary: All method metrics related to the rpc protocol should be initialized Key: HDFS-16683 URL: https://issues.apache.org/jira/browse/HDFS-16683 Project: Hadoop HDFS

[jira] [Created] (HDFS-16146) All three replicas are lost due to not adding a new DataNode in time

Shuyan Zhang created HDFS-16146: --- Summary: All three replicas are lost due to not adding a new DataNode in time Key: HDFS-16146 URL: https://issues.apache.org/jira/browse/HDFS-16146 Project: Hadoop HDFS

[jira] [Created] (HDFS-16099) Make bpServiceToActive to be volatile

Shuyan Zhang created HDFS-16099: --- Summary: Make bpServiceToActive to be volatile Key: HDFS-16099 URL: https://issues.apache.org/jira/browse/HDFS-16099 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-15963) Unreleased volume references cause an infinite loop

Shuyan Zhang created HDFS-15963: --- Summary: Unreleased volume references cause an infinite loop Key: HDFS-15963 URL: https://issues.apache.org/jira/browse/HDFS-15963 Project: Hadoop HDFS Issue T