[jira] [Commented] (HDFS-17352) Add configuration to control whether DN delete this replica from disk when client requests a missing block

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821550#comment-17821550 ] ASF GitHub Bot commented on HDFS-17352: --- haiyang1987 commented on code in PR #6559: URL:

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821537#comment-17821537 ] ASF GitHub Bot commented on HDFS-17372: --- hadoop-yetus commented on PR #6530: URL:

[jira] [Commented] (HDFS-17401) Erasure Coding: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821513#comment-17821513 ] ASF GitHub Bot commented on HDFS-17401: --- hadoop-yetus commented on PR #6597: URL:

[jira] [Commented] (HDFS-17397) Choose another DN as soon as possible, when encountering network issues

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821494#comment-17821494 ] ASF GitHub Bot commented on HDFS-17397: --- hadoop-yetus commented on PR #6591: URL:

[jira] [Commented] (HDFS-17387) [FGL] Abstract the configurable locking mode

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821487#comment-17821487 ] ASF GitHub Bot commented on HDFS-17387: --- ZanderXu commented on code in PR #6572: URL:

[jira] [Commented] (HDFS-17387) [FGL] Abstract the configurable locking mode

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821486#comment-17821486 ] ASF GitHub Bot commented on HDFS-17387: --- ZanderXu commented on code in PR #6572: URL:

[jira] [Updated] (HDFS-17401) Erasure Coding: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17401: -- Labels: pull-request-available (was: ) > Erasure Coding: Excess internal block may not be

[jira] [Commented] (HDFS-17401) Erasure Coding: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821441#comment-17821441 ] ASF GitHub Bot commented on HDFS-17401: --- RuinanGu opened a new pull request, #6597: URL:

[jira] [Updated] (HDFS-17401) Erasure Coding: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage

2024-02-27 Thread Ruinan Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruinan Gu updated HDFS-17401: - Description: Excess internal block can't be deleted correctly when it's stored in fallback storage.

[jira] [Updated] (HDFS-17401) Erasure Coding: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage

2024-02-27 Thread Ruinan Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruinan Gu updated HDFS-17401: - Description: Excess internal block can't be deleted correctly when it's stored in fallback storage.

[jira] [Updated] (HDFS-17401) Erasure Coding: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage

2024-02-27 Thread Ruinan Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruinan Gu updated HDFS-17401: - Summary: Erasure Coding: Excess internal block may not be able to be deleted correctly when it's stored

[jira] [Updated] (HDFS-17401) Erasure Coding: Excess internal block may not be able to deleted correctly when it's stored in fallback storage

2024-02-27 Thread Ruinan Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruinan Gu updated HDFS-17401: - Summary: Erasure Coding: Excess internal block may not be able to deleted correctly when it's stored in

[jira] [Updated] (HDFS-17401) Erasure Coding: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage

2024-02-27 Thread Ruinan Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruinan Gu updated HDFS-17401: - Description: Excess internal block can't be deleted correctly when it's stored in fallback storage.

[jira] [Updated] (HDFS-17401) Erasure Coding: Excess internal block can't be deleted correctly

2024-02-27 Thread Ruinan Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruinan Gu updated HDFS-17401: - Target Version/s: 3.3.6 Affects Version/s: 3.3.6 Description: Excess internal block can't

[jira] [Updated] (HDFS-17401) Erasure Coding: Excess internal block can't be deleted correctly

2024-02-27 Thread Ruinan Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruinan Gu updated HDFS-17401: - Description: Excess internal block can't be deleted correctly when it's stored in fallback storage.

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821420#comment-17821420 ] ASF GitHub Bot commented on HDFS-17372: --- hadoop-yetus commented on PR #6530: URL:

[jira] [Commented] (HDFS-17380) FsImageValidation: remove inaccessible nodes

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821406#comment-17821406 ] ASF GitHub Bot commented on HDFS-17380: --- hadoop-yetus commented on PR #6549: URL:

[jira] [Created] (HDFS-17401) Erasure Coding: Excess internal block can't be deleted correctly

2024-02-27 Thread Ruinan Gu (Jira)
Ruinan Gu created HDFS-17401: Summary: Erasure Coding: Excess internal block can't be deleted correctly Key: HDFS-17401 URL: https://issues.apache.org/jira/browse/HDFS-17401 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821401#comment-17821401 ] ASF GitHub Bot commented on HDFS-17146: --- hadoop-yetus commented on PR #6595: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821396#comment-17821396 ] ASF GitHub Bot commented on HDFS-17299: --- ritegarg closed pull request #6556: HDFS-17299. Adding

[jira] [Commented] (HDFS-17391) Adjust the checkpoint io buffer size to the chunk size

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821375#comment-17821375 ] ASF GitHub Bot commented on HDFS-17391: --- hadoop-yetus commented on PR #6594: URL:

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821347#comment-17821347 ] ASF GitHub Bot commented on HDFS-17372: --- hadoop-yetus commented on PR #6530: URL:

[jira] [Commented] (HDFS-17254) DataNode httpServer has too many worker threads

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821344#comment-17821344 ] ASF GitHub Bot commented on HDFS-17254: --- hadoop-yetus commented on PR #6307: URL:

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821306#comment-17821306 ] ASF GitHub Bot commented on HDFS-17372: --- hadoop-yetus commented on PR #6530: URL:

[jira] [Created] (HDFS-17400) Expose metrics for inode ChildrenList size

2024-02-27 Thread Srinivasu Majeti (Jira)
Srinivasu Majeti created HDFS-17400: --- Summary: Expose metrics for inode ChildrenList size Key: HDFS-17400 URL: https://issues.apache.org/jira/browse/HDFS-17400 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-16849) Terminate SNN when failing to perform EditLogTailing

2024-02-27 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821281#comment-17821281 ] Srinivasu Majeti commented on HDFS-16849: - Gentle reminder to review this [~weichiu] /

[jira] [Commented] (HDFS-17349) evictWriters command does not seem to work effectively

2024-02-27 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821278#comment-17821278 ] Srinivasu Majeti commented on HDFS-17349: - Hi [~weichiu] / [~sodonnell], Could you please review

[jira] [Updated] (HDFS-17399) Ensure atomic transactions when snapshot manager is facing OS resource limit issues

2024-02-27 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasu Majeti updated HDFS-17399: Description: One of the customers is facing 'resource' issues ( max number of processes )

[jira] [Created] (HDFS-17399) Ensure atomic transactions when snapshot manager is facing OS resource limit issues

2024-02-27 Thread Srinivasu Majeti (Jira)
Srinivasu Majeti created HDFS-17399: --- Summary: Ensure atomic transactions when snapshot manager is facing OS resource limit issues Key: HDFS-17399 URL: https://issues.apache.org/jira/browse/HDFS-17399

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821264#comment-17821264 ] ASF GitHub Bot commented on HDFS-17372: --- hadoop-yetus commented on PR #6530: URL:

[jira] [Commented] (HDFS-17254) DataNode httpServer has too many worker threads

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821243#comment-17821243 ] ASF GitHub Bot commented on HDFS-17254: --- hadoop-yetus commented on PR #6307: URL:

[jira] [Commented] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821235#comment-17821235 ] ASF GitHub Bot commented on HDFS-17146: --- zhtttylz opened a new pull request, #6595: URL:

[jira] [Commented] (HDFS-17333) DFSClient support lazy resolve host->ip.

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821221#comment-17821221 ] ASF GitHub Bot commented on HDFS-17333: --- KeeProMise commented on PR #6430: URL:

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821191#comment-17821191 ] ASF GitHub Bot commented on HDFS-17372: --- hadoop-yetus commented on PR #6530: URL:

[jira] [Commented] (HDFS-17387) [FGL] Abstract the configurable locking mode

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821146#comment-17821146 ] ASF GitHub Bot commented on HDFS-17387: --- ferhui commented on code in PR #6572: URL:

[jira] [Commented] (HDFS-17397) Choose another DN as soon as possible, when encountering network issues

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821145#comment-17821145 ] ASF GitHub Bot commented on HDFS-17397: --- hadoop-yetus commented on PR #6591: URL:

[jira] [Commented] (HDFS-17387) [FGL] Abstract the configurable locking mode

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821143#comment-17821143 ] ASF GitHub Bot commented on HDFS-17387: --- ZanderXu commented on code in PR #6572: URL:

[jira] [Commented] (HDFS-17391) Adjust the checkpoint io buffer size to the chunk size

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821142#comment-17821142 ] ASF GitHub Bot commented on HDFS-17391: --- hadoop-yetus commented on PR #6594: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821141#comment-17821141 ] ASF GitHub Bot commented on HDFS-17299: --- hadoop-yetus commented on PR #6566: URL:

[jira] [Commented] (HDFS-17387) [FGL] Abstract the configurable locking mode

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821129#comment-17821129 ] ASF GitHub Bot commented on HDFS-17387: --- ferhui commented on code in PR #6572: URL:

[jira] [Commented] (HDFS-17397) Choose another DN as soon as possible, when encountering network issues

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821127#comment-17821127 ] ASF GitHub Bot commented on HDFS-17397: --- hadoop-yetus commented on PR #6591: URL:

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821054#comment-17821054 ] ASF GitHub Bot commented on HDFS-17372: --- hfutatzhanghb commented on PR #6530: URL: