[jira] [Updated] (HDFS-9940) Balancer should not use property dfs.datanode.balance.max.concurrent.moves

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-9940: - Target Version/s: 3.5.0 (was: 3.4.0) > Balancer should not use property dfs.datanode.balance.max.concurre

[jira] [Commented] (HDFS-9940) Balancer should not use property dfs.datanode.balance.max.concurrent.moves

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802547#comment-17802547 ] Shilun Fan commented on HDFS-9940: -- Bulk update: moved all 3.4.0 non-blocker issues, plea

[jira] [Updated] (HDFS-9821) HDFS configuration should accept friendly time units

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-9821: - Target Version/s: 3.5.0 (was: 3.4.0) > HDFS configuration should accept friendly time units > ---

[jira] [Updated] (HDFS-8893) DNs with failed volumes stop serving during rolling upgrade

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-8893: - Target Version/s: 3.5.0 (was: 3.4.0) > DNs with failed volumes stop serving during rolling upgrade >

[jira] [Commented] (HDFS-9821) HDFS configuration should accept friendly time units

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802548#comment-17802548 ] Shilun Fan commented on HDFS-9821: -- Bulk update: moved all 3.4.0 non-blocker issues, plea

[jira] [Updated] (HDFS-8430) Erasure coding: compute file checksum for striped files (stripe by stripe)

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-8430: - Target Version/s: 3.5.0 (was: 3.4.0) > Erasure coding: compute file checksum for striped files (stripe by

[jira] [Commented] (HDFS-8430) Erasure coding: compute file checksum for striped files (stripe by stripe)

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802551#comment-17802551 ] Shilun Fan commented on HDFS-8430: -- Bulk update: moved all 3.4.0 non-blocker issues, plea

[jira] [Updated] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-8538: - Target Version/s: 3.5.0 (was: 3.4.0) > Change the default volume choosing policy to > AvailableSpaceVolu

[jira] [Commented] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802550#comment-17802550 ] Shilun Fan commented on HDFS-8538: -- Bulk update: moved all 3.4.0 non-blocker issues, plea

[jira] [Updated] (HDFS-8115) Make PermissionStatusFormat public

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-8115: - Target Version/s: 3.5.0 (was: 3.4.0) > Make PermissionStatusFormat public > -

[jira] [Updated] (HDFS-7902) Expose truncate API for libwebhdfs

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-7902: - Target Version/s: 3.5.0 (was: 3.4.0) > Expose truncate API for libwebhdfs > -

[jira] [Updated] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-7702: - Target Version/s: 3.5.0 (was: 3.4.0) > Move metadata across namenode - Effort to a real distributed namen

[jira] [Updated] (HDFS-8065) Erasure coding: Support truncate at striped group boundary

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-8065: - Target Version/s: 3.5.0 (was: 3.4.0) > Erasure coding: Support truncate at striped group boundary > -

[jira] [Commented] (HDFS-8115) Make PermissionStatusFormat public

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802552#comment-17802552 ] Shilun Fan commented on HDFS-8115: -- Bulk update: moved all 3.4.0 non-blocker issues, plea

[jira] [Commented] (HDFS-8065) Erasure coding: Support truncate at striped group boundary

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802554#comment-17802554 ] Shilun Fan commented on HDFS-8065: -- Bulk update: moved all 3.4.0 non-blocker issues, plea

[jira] [Commented] (HDFS-7408) Add a counter in the log that shows the number of block reports processed

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802559#comment-17802559 ] Shilun Fan commented on HDFS-7408: -- Bulk update: moved all 3.4.0 non-blocker issues, plea

[jira] [Updated] (HDFS-7408) Add a counter in the log that shows the number of block reports processed

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-7408: - Target Version/s: 3.5.0 (was: 3.4.0) > Add a counter in the log that shows the number of block reports pr

[jira] [Updated] (HDFS-7550) Minor followon cleanups from HDFS-7543

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-7550: - Target Version/s: 3.5.0 (was: 3.4.0) > Minor followon cleanups from HDFS-7543 > -

[jira] [Updated] (HDFS-7368) Support HDFS specific 'shell' on command 'hdfs dfs' invocation

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-7368: - Target Version/s: 3.5.0 (was: 3.4.0) > Support HDFS specific 'shell' on command 'hdfs dfs' invocation > -

[jira] [Updated] (HDFS-4319) FSShell copyToLocal creates files with the executable bit set

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-4319: - Target Version/s: 3.5.0 (was: 3.4.0) > FSShell copyToLocal creates files with the executable bit set > --

[jira] [Updated] (HDFS-4389) Non-HA DFSClients do not attempt reconnects

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-4389: - Target Version/s: 3.5.0 (was: 3.4.0) > Non-HA DFSClients do not attempt reconnects >

[jira] [Commented] (HDFS-4319) FSShell copyToLocal creates files with the executable bit set

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802563#comment-17802563 ] Shilun Fan commented on HDFS-4319: -- Bulk update: moved all 3.4.0 non-blocker issues, plea

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802564#comment-17802564 ] Shilun Fan commented on HDFS-3570: -- Bulk update: moved all 3.4.0 non-blocker issues, plea

[jira] [Updated] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-3570: - Target Version/s: 3.5.0 (was: 3.4.0) > Balancer shouldn't rely on "DFS Space Used %" as that ignores non-

[jira] [Comment Edited] (HDFS-13689) NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802444#comment-17802444 ] Shilun Fan edited comment on HDFS-13689 at 1/4/24 7:56 AM: --- Bul

[jira] [Comment Edited] (HDFS-13656) Logging more info when client completes file error

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802445#comment-17802445 ] Shilun Fan edited comment on HDFS-13656 at 1/4/24 7:56 AM: --- Bul

[jira] [Comment Edited] (HDFS-13287) TestINodeFile#testGetBlockType results in NPE when run alone

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802447#comment-17802447 ] Shilun Fan edited comment on HDFS-13287 at 1/4/24 7:56 AM: --- Bul

[jira] [Comment Edited] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802449#comment-17802449 ] Shilun Fan edited comment on HDFS-13243 at 1/4/24 7:57 AM: --- Bul

[jira] [Comment Edited] (HDFS-13035) Owner should be allowed to set xattr if not already set.

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802452#comment-17802452 ] Shilun Fan edited comment on HDFS-13035 at 1/4/24 7:57 AM: --- Bul

[jira] [Comment Edited] (HDFS-13064) Httpfs should return json instead of html when writting to a file without Content-Type

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802451#comment-17802451 ] Shilun Fan edited comment on HDFS-13064 at 1/4/24 7:57 AM: --- Bul

[jira] [Comment Edited] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802453#comment-17802453 ] Shilun Fan edited comment on HDFS-12969 at 1/4/24 7:57 AM: --- Bul

[jira] [Comment Edited] (HDFS-13285) Improve runtime for TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802448#comment-17802448 ] Shilun Fan edited comment on HDFS-13285 at 1/4/24 7:57 AM: --- Bul

[jira] [Comment Edited] (HDFS-13177) Investigate and fix DFSStripedOutputStream handling of DSQuotaExceededException

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802450#comment-17802450 ] Shilun Fan edited comment on HDFS-13177 at 1/4/24 7:57 AM: --- Bul

[jira] [Comment Edited] (HDFS-12953) XORRawDecoder.doDecode throws NullPointerException

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802454#comment-17802454 ] Shilun Fan edited comment on HDFS-12953 at 1/4/24 7:58 AM: --- Bul

[jira] [Comment Edited] (HDFS-12597) Add CryptoOutputStream to WebHdfsFileSystem create call.

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802461#comment-17802461 ] Shilun Fan edited comment on HDFS-12597 at 1/4/24 7:58 AM: --- Bul

[jira] [Comment Edited] (HDFS-12652) INodeAttributesProvider#getAttributes(): Avoid multiple conversions of path components byte[][] to String[] when requesting INode attributes

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802460#comment-17802460 ] Shilun Fan edited comment on HDFS-12652 at 1/4/24 7:58 AM: --- Bul

[jira] [Comment Edited] (HDFS-12657) Operations based on inode id must not fallback to the path

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802459#comment-17802459 ] Shilun Fan edited comment on HDFS-12657 at 1/4/24 7:58 AM: --- Bul

[jira] [Comment Edited] (HDFS-12859) Admin command resetBalancerBandwidth

2024-01-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802455#comment-17802455 ] Shilun Fan edited comment on HDFS-12859 at 1/4/24 7:58 AM: --- Bul

[jira] [Comment Edited] (HDFS-12769) TestReadStripedFileWithDecodingCorruptData and TestReadStripedFileWithDecodingDeletedData timeout in trunk

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802457#comment-17802457 ] Shilun Fan edited comment on HDFS-12769 at 1/4/24 7:58 AM: --- Bul

[jira] [Comment Edited] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802458#comment-17802458 ] Shilun Fan edited comment on HDFS-12667 at 1/4/24 7:58 AM: --- Bul

[jira] [Comment Edited] (HDFS-12575) Improve test coverage for EC related edit logs ops

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802462#comment-17802462 ] Shilun Fan edited comment on HDFS-12575 at 1/4/24 7:58 AM: --- Bul

[jira] [Comment Edited] (HDFS-12534) Provide logical BlockLocations for EC files for better split calculation

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802463#comment-17802463 ] Shilun Fan edited comment on HDFS-12534 at 1/4/24 7:59 AM: --- Bul

[jira] [Updated] (HDFS-17322) RetryCache#MAX_CAPACITY seems to be MIN_CAPACITY

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17322: -- Target Version/s: 3.5.0 (was: 3.4.1) > RetryCache#MAX_CAPACITY seems to be MIN_CAPACITY >

[jira] [Comment Edited] (HDFS-12379) NameNode getListing should use FileStatus instead of HdfsFileStatus

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802465#comment-17802465 ] Shilun Fan edited comment on HDFS-12379 at 1/4/24 7:59 AM: --- Bul

[jira] [Commented] (HDFS-17322) RetryCache#MAX_CAPACITY seems to be MIN_CAPACITY

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802571#comment-17802571 ] Shilun Fan commented on HDFS-17322: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Comment Edited] (HDFS-12372) Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC)

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802466#comment-17802466 ] Shilun Fan edited comment on HDFS-12372 at 1/4/24 7:59 AM: --- Bul

[jira] [Updated] (HDFS-17318) RBF: MountTableResolver#locationCache supports multi policies

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17318: -- Target Version/s: 3.5.0 (was: 3.4.1) > RBF: MountTableResolver#locationCache supports multi policies >

[jira] [Commented] (HDFS-17318) RBF: MountTableResolver#locationCache supports multi policies

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802572#comment-17802572 ] Shilun Fan commented on HDFS-17318: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17142) Refactor method BlockManager#chooseExcessRedundancies

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17142: -- Target Version/s: 3.5.0 (was: 3.4.1) > Refactor method BlockManager#chooseExcessRedundancies > ---

[jira] [Commented] (HDFS-17158) Show the rate of metrics in EC recovery task.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802574#comment-17802574 ] Shilun Fan commented on HDFS-17158: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17283: -- Target Version/s: 3.5.0 (was: 3.4.1) > Change the name of variable SECOND in HdfsClientConfigKeys > --

[jira] [Updated] (HDFS-17158) Show the rate of metrics in EC recovery task.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17158: -- Target Version/s: 3.5.0 (was: 3.4.1) > Show the rate of metrics in EC recovery task. > ---

[jira] [Commented] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802573#comment-17802573 ] Shilun Fan commented on HDFS-17283: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17160) Metrics fsyncCount should be computed correctly in flushOrSync

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17160: -- Target Version/s: 3.5.0 (was: 3.4.1) > Metrics fsyncCount should be computed correctly in flushOrSync

[jira] [Updated] (HDFS-17185) Add acquire lock time for DataSetLockManager

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17185: -- Target Version/s: 3.5.0 (was: 3.4.1) > Add acquire lock time for DataSetLockManager >

[jira] [Updated] (HDFS-17061) EC: Let data blocks and parity blocks on DNs more balanced

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17061: -- Target Version/s: 3.5.0 (was: 3.4.1) > EC: Let data blocks and parity blocks on DNs more balanced > --

[jira] [Commented] (HDFS-17061) EC: Let data blocks and parity blocks on DNs more balanced

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802579#comment-17802579 ] Shilun Fan commented on HDFS-17061: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17251) RBF: Optimize MountTableResolver#TRASH_PATTERN

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17251: -- Target Version/s: 3.5.0 (was: 3.4.1) > RBF: Optimize MountTableResolver#TRASH_PATTERN > --

[jira] [Commented] (HDFS-16790) rbf wrong path when destination dir is not created

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802581#comment-17802581 ] Shilun Fan commented on HDFS-16790: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17173) Whether the read lock in method moveBlockAcrossVolumes can be removed or not?

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17173: -- Target Version/s: 3.5.0 (was: 3.4.1) > Whether the read lock in method moveBlockAcrossVolumes can be r

[jira] [Commented] (HDFS-17160) Metrics fsyncCount should be computed correctly in flushOrSync

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802577#comment-17802577 ] Shilun Fan commented on HDFS-17160: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-16790) rbf wrong path when destination dir is not created

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16790: -- Target Version/s: 3.5.0 (was: 3.4.1) > rbf wrong path when destination dir is not created > --

[jira] [Updated] (HDFS-15271) Remove obsolete SPNEGO configuration of NN, SNN and JN.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15271: -- Target Version/s: 3.5.0 (was: 3.4.1) > Remove obsolete SPNEGO configuration of NN, SNN and JN. > -

[jira] [Updated] (HDFS-15857) Space is missed in the print result of ECAdmin.RemoveECPolicyCommand

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15857: -- Target Version/s: 3.5.0 (was: 3.4.1) > Space is missed in the print result of ECAdmin.RemoveECPolicyCo

[jira] [Updated] (HDFS-16797) Remove WhiteBox in hdfs module.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16797: -- Target Version/s: 3.5.0 (was: 3.4.1) > Remove WhiteBox in hdfs module. > -

[jira] [Commented] (HDFS-15857) Space is missed in the print result of ECAdmin.RemoveECPolicyCommand

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802582#comment-17802582 ] Shilun Fan commented on HDFS-15857: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-15509) Set safemode should not fail if one of the namenode is down.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15509: -- Target Version/s: 3.5.0 (was: 3.4.1) > Set safemode should not fail if one of the namenode is down. >

[jira] [Updated] (HDFS-17123) Sort datanodeStorages when generating StorageBlockReport[] in method BPServiceActor#blockReport for future convenience

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17123: -- Target Version/s: 3.5.0 (was: 3.4.1) > Sort datanodeStorages when generating StorageBlockReport[] in m

[jira] [Updated] (HDFS-17188) Data loss in our production clusters due to missing HDFS-16540

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17188: -- Target Version/s: 3.5.0 (was: 3.4.1) > Data loss in our production clusters due to missing HDFS-16540

[jira] [Commented] (HDFS-17188) Data loss in our production clusters due to missing HDFS-16540

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802585#comment-17802585 ] Shilun Fan commented on HDFS-17188: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17125) Method checkAndUpdate should also resolve duplicate replicas when memBlockInfo.metadataExists() return false

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17125: -- Target Version/s: 3.5.0 (was: 3.4.1) > Method checkAndUpdate should also resolve duplicate replicas wh

[jira] [Updated] (HDFS-17149) getBlockLocations RPC should use actual client ip to compute network distance when using RBF.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17149: -- Target Version/s: 3.5.0 (was: 3.4.1) > getBlockLocations RPC should use actual client ip to compute ne

[jira] [Commented] (HDFS-17149) getBlockLocations RPC should use actual client ip to compute network distance when using RBF.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802588#comment-17802588 ] Shilun Fan commented on HDFS-17149: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Commented] (HDFS-15509) Set safemode should not fail if one of the namenode is down.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802584#comment-17802584 ] Shilun Fan commented on HDFS-15509: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Commented] (HDFS-17125) Method checkAndUpdate should also resolve duplicate replicas when memBlockInfo.metadataExists() return false

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802587#comment-17802587 ] Shilun Fan commented on HDFS-17125: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Commented] (HDFS-17126) FsDataSetImpl#checkAndUpdate should delete duplicated block meta file.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802591#comment-17802591 ] Shilun Fan commented on HDFS-17126: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-16993) Datanode supports configure TopN DatanodeNetworkCounts

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16993: -- Target Version/s: 3.5.0 (was: 3.4.1) > Datanode supports configure TopN DatanodeNetworkCounts > --

[jira] [Updated] (HDFS-16818) RBF TestRouterRPCMultipleDestinationMountTableResolver non-deterministic unit tests failures

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16818: -- Target Version/s: 3.5.0 (was: 3.4.1) > RBF TestRouterRPCMultipleDestinationMountTableResolver non-dete

[jira] [Updated] (HDFS-17126) FsDataSetImpl#checkAndUpdate should delete duplicated block meta file.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17126: -- Target Version/s: 3.5.0 (was: 3.4.1) > FsDataSetImpl#checkAndUpdate should delete duplicated block met

[jira] [Commented] (HDFS-16818) RBF TestRouterRPCMultipleDestinationMountTableResolver non-deterministic unit tests failures

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802593#comment-17802593 ] Shilun Fan commented on HDFS-16818: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-16874) Improve DataNode decommission for Erasure Coding

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16874: -- Target Version/s: 3.5.0 (was: 3.4.1) > Improve DataNode decommission for Erasure Coding >

[jira] [Commented] (HDFS-16874) Improve DataNode decommission for Erasure Coding

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802592#comment-17802592 ] Shilun Fan commented on HDFS-16874: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-16940) Provide HTTP API health endpoints to simplify monitoring

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16940: -- Target Version/s: 3.3.9, 3.5.0 (was: 3.3.9, 3.4.1) > Provide HTTP API health endpoints to simplify mon

[jira] [Commented] (HDFS-17281) Added support of reporting RPC round-trip time at NN.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802597#comment-17802597 ] Shilun Fan commented on HDFS-17281: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17226) Building native libraries fails on Fedora 38

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17226: -- Target Version/s: 3.3.9, 3.3.7, 3.5.0 (was: 3.3.9, 3.3.7, 3.4.1) > Building native libraries fails on

[jira] [Updated] (HDFS-17286) Add UDP as a transfer protocol for HDFS

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17286: -- Target Version/s: 3.5.0 (was: 3.4.1) > Add UDP as a transfer protocol for HDFS > -

[jira] [Commented] (HDFS-16993) Datanode supports configure TopN DatanodeNetworkCounts

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802595#comment-17802595 ] Shilun Fan commented on HDFS-16993: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Commented] (HDFS-17226) Building native libraries fails on Fedora 38

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802598#comment-17802598 ] Shilun Fan commented on HDFS-17226: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Commented] (HDFS-16940) Provide HTTP API health endpoints to simplify monitoring

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802596#comment-17802596 ] Shilun Fan commented on HDFS-16940: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17281) Added support of reporting RPC round-trip time at NN.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17281: -- Target Version/s: 3.3.7, 3.5.0 (was: 3.3.7, 3.4.1) > Added support of reporting RPC round-trip time at

[jira] [Commented] (HDFS-17286) Add UDP as a transfer protocol for HDFS

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802599#comment-17802599 ] Shilun Fan commented on HDFS-17286: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17201) some methods in FsDatasetImpl should acquire readLock with LockLevel.VOLUME

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17201: -- Target Version/s: 3.5.0 (was: 3.4.1) > some methods in FsDatasetImpl should acquire readLock with Lock

[jira] [Commented] (HDFS-17201) some methods in FsDatasetImpl should acquire readLock with LockLevel.VOLUME

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802601#comment-17802601 ] Shilun Fan commented on HDFS-17201: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17267) Client send the smae packet multiple times when method markSlowNode throws IOException.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17267: -- Target Version/s: 3.5.0 (was: 3.4.1) > Client send the smae packet multiple times when method markSlow

[jira] [Commented] (HDFS-17072) DFSAdmin: add a triggerDirectoryScanner command

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802604#comment-17802604 ] Shilun Fan commented on HDFS-17072: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17072) DFSAdmin: add a triggerDirectoryScanner command

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17072: -- Target Version/s: 3.5.0 (was: 3.4.1) > DFSAdmin: add a triggerDirectoryScanner command >

[jira] [Commented] (HDFS-17267) Client send the smae packet multiple times when method markSlowNode throws IOException.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802600#comment-17802600 ] Shilun Fan commented on HDFS-17267: --- Bulk update: moved all 3.4.0 non-blocker issues, p

[jira] [Updated] (HDFS-17199) LightWeightResizableGSet#values() seems not thread-safe.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17199: -- Target Version/s: 3.5.0 (was: 3.4.1) > LightWeightResizableGSet#values() seems not thread-safe. >

[jira] [Updated] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17293: -- Target Version/s: 3.5.0 (was: 3.4.1) > First packet data + checksum size will be set to 516 bytes when

[jira] [Commented] (HDFS-17314) Add a metrics to record congestion backoff counts.

2024-01-04 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802608#comment-17802608 ] Shilun Fan commented on HDFS-17314: --- Bulk update: moved all 3.4.0 non-blocker issues, p

<    2   3   4   5   6   7   8   9   10   11   >