[jira] [Updated] (HDFS-17521) Erasure Coding: Fix calculation errors caused by special index order

2024-05-11 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated HDFS-17521: Description: I found that if the erasedIndexes distribution is such that the parity index

[jira] [Commented] (HDFS-17520) TestDFSAdmin.testAllDatanodesReconfig and TestDFSAdmin.testDecommissionDataNodesReconfig failed

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845609#comment-17845609 ] ASF GitHub Bot commented on HDFS-17520: --- slfan1989 commented on PR #6812: URL: https://github.com

[jira] [Updated] (HDFS-17521) Erasure Coding: Fix calculation errors caused by special index order

2024-05-11 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated HDFS-17521: Description: I found that if the erasedIndexes distribution is such that the parity index

[jira] [Commented] (HDFS-17506) [FGL] Performance for phase 1

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845591#comment-17845591 ] ASF GitHub Bot commented on HDFS-17506: --- hadoop-yetus commented on PR #6806: URL: https

[jira] [Created] (HDFS-17521) Erasure Coding: Fix calculation errors caused by special index order

2024-05-11 Thread Chenyu Zheng (Jira)
Chenyu Zheng created HDFS-17521: --- Summary: Erasure Coding: Fix calculation errors caused by special index order Key: HDFS-17521 URL: https://issues.apache.org/jira/browse/HDFS-17521 Project: Hadoop

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845576#comment-17845576 ] ASF GitHub Bot commented on HDFS-17509: --- ZanderXu commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2024-05-11 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845565#comment-17845565 ] ZanderXu commented on HDFS-2139: https://docs.google.com/document/d/1uGHA2dXLldlNoaYF

[jira] [Comment Edited] (HDFS-2139) Fast copy for HDFS.

2024-05-11 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581740#comment-17581740 ] ZanderXu edited comment on HDFS-2139 at 5/11/24 9:13 AM: - https://docs.google.com

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845562#comment-17845562 ] ASF GitHub Bot commented on HDFS-17509: --- LiuGuH commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845559#comment-17845559 ] ASF GitHub Bot commented on HDFS-17509: --- LiuGuH commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845556#comment-17845556 ] ASF GitHub Bot commented on HDFS-17497: --- hfutatzhanghb commented on code in PR #6765: URL: https

[jira] [Updated] (HDFS-17492) [FGL] Abstract a INodeLockManager to manage acquiring and releasing locks in the directory-tree [I]

2024-05-11 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-17492: Summary: [FGL] Abstract a INodeLockManager to manage acquiring and releasing locks in the directory-tree

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1784#comment-1784 ] ASF GitHub Bot commented on HDFS-17488: --- hadoop-yetus commented on PR #6759: URL: https

[jira] [Resolved] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-05-11 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu resolved HDFS-17488. - Fix Version/s: 3.5.0 Resolution: Fixed > DN can fail IBRs with NPE when a volume is remo

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845551#comment-17845551 ] ASF GitHub Bot commented on HDFS-17488: --- ZanderXu commented on PR #6759: URL: https://github.com

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845550#comment-17845550 ] ASF GitHub Bot commented on HDFS-17488: --- ZanderXu merged PR #6759: URL: https://github.com/apache

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845548#comment-17845548 ] ASF GitHub Bot commented on HDFS-17509: --- ZanderXu commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-17520) TestDFSAdmin.testAllDatanodesReconfig and TestDFSAdmin.testDecommissionDataNodesReconfig failed

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845545#comment-17845545 ] ASF GitHub Bot commented on HDFS-17520: --- ZanderXu commented on PR #6812: URL: https://github.com

[jira] [Updated] (HDFS-17520) TestDFSAdmin.testAllDatanodesReconfig and TestDFSAdmin.testDecommissionDataNodesReconfig failed

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17520: -- Labels: pull-request-available (was: ) > TestDFSAdmin.testAllDatanodesRecon

[jira] [Commented] (HDFS-17520) TestDFSAdmin.testAllDatanodesReconfig and TestDFSAdmin.testDecommissionDataNodesReconfig failed

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845544#comment-17845544 ] ASF GitHub Bot commented on HDFS-17520: --- ZanderXu opened a new pull request, #6812: URL: https

[jira] [Created] (HDFS-17520) TestDFSAdmin.testAllDatanodesReconfig and TestDFSAdmin.testDecommissionDataNodesReconfig failed

2024-05-11 Thread ZanderXu (Jira)
ZanderXu created HDFS-17520: --- Summary: TestDFSAdmin.testAllDatanodesReconfig and TestDFSAdmin.testDecommissionDataNodesReconfig failed Key: HDFS-17520 URL: https://issues.apache.org/jira/browse/HDFS-17520

[jira] [Commented] (HDFS-17486) VIO: dumpXattrs logic optimization

2024-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845541#comment-17845541 ] ASF GitHub Bot commented on HDFS-17486: --- YaAYadeer commented on PR #6797: URL: https://github.com

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845530#comment-17845530 ] ASF GitHub Bot commented on HDFS-17514: --- hadoop-yetus commented on PR #6804: URL: https

[jira] [Commented] (HDFS-17506) [FGL] Performance for phase 1

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845517#comment-17845517 ] ASF GitHub Bot commented on HDFS-17506: --- hadoop-yetus commented on PR #6806: URL: https

[jira] [Commented] (HDFS-13603) Warmup NameNode EDEK thread retries continuously if there's an invalid key

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845512#comment-17845512 ] ASF GitHub Bot commented on HDFS-13603: --- CloudZY commented on code in PR #6774: URL: https

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845465#comment-17845465 ] ASF GitHub Bot commented on HDFS-17514: --- ctrezzo commented on code in PR #6804: URL: https

[jira] [Commented] (HDFS-13603) Warmup NameNode EDEK thread retries continuously if there's an invalid key

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845461#comment-17845461 ] ASF GitHub Bot commented on HDFS-13603: --- simbadzina commented on code in PR #6774: URL: https

[jira] [Commented] (HDFS-17506) [FGL] Performance for phase 1

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845459#comment-17845459 ] ASF GitHub Bot commented on HDFS-17506: --- hadoop-yetus commented on PR #6806: URL: https

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845458#comment-17845458 ] ASF GitHub Bot commented on HDFS-17514: --- ctrezzo commented on code in PR #6804: URL: https

[jira] [Updated] (HDFS-17519) Reduce lease checks when the last block is in the complete state and the penultimate block is in the committed state

2024-05-10 Thread lei w (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-17519: - Summary: Reduce lease checks when the last block is in the complete state and the penultimate block

[jira] [Commented] (HDFS-17519) Reduce lease checks when the last block is in the complete state and the penultimate block is in the committed state in ones file.

2024-05-10 Thread lei w (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845401#comment-17845401 ] lei w commented on HDFS-17519: -- [~ayushsaxena] Can you give me some suggestions? > Reduce lease checks w

[jira] [Updated] (HDFS-17519) Reduce lease checks when the last block is in the complete state and the penultimate block is in the committed state in ones file.

2024-05-10 Thread lei w (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-17519: - Summary: Reduce lease checks when the last block is in the complete state and the penultimate block

[jira] [Created] (HDFS-17519) LeaseMonitor renew the lease when the last block is in the complete state and the penultimate block is in the committed state in ones file.

2024-05-10 Thread lei w (Jira)
://issues.apache.org/jira/browse/HDFS-17519 Project: Hadoop HDFS Issue Type: Bug Reporter: lei w When the last block of the file is in the complete state and the penultimate block is in the committed state, LeaseMonitor will continuously check the lease of this file

[jira] [Commented] (HDFS-17518) In the lease monitor, if a file is closed, we should sync the editslog

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845393#comment-17845393 ] ASF GitHub Bot commented on HDFS-17518: --- ThinkerLei opened a new pull request, #6809: URL: https

[jira] [Updated] (HDFS-17518) In the lease monitor, if a file is closed, we should sync the editslog

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17518: -- Labels: pull-request-available (was: ) > In the lease monitor, if a file is closed, we sho

[jira] [Created] (HDFS-17518) In the lease monitor, if a file is closed, we should sync the editslog

2024-05-10 Thread lei w (Jira)
lei w created HDFS-17518: Summary: In the lease monitor, if a file is closed, we should sync the editslog Key: HDFS-17518 URL: https://issues.apache.org/jira/browse/HDFS-17518 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845355#comment-17845355 ] ASF GitHub Bot commented on HDFS-17514: --- hadoop-yetus commented on PR #6804: URL: https

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845350#comment-17845350 ] ASF GitHub Bot commented on HDFS-17509: --- hadoop-yetus commented on PR #6784: URL: https

[jira] [Commented] (HDFS-17506) [FGL] Performance for phase 1

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845348#comment-17845348 ] ASF GitHub Bot commented on HDFS-17506: --- hadoop-yetus commented on PR #6806: URL: https

[jira] [Updated] (HDFS-17505) [FGL] Solutions for StoragePolicy

2024-05-10 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-17505: Description: StoragePolicy may be set on an ancestor path and used by some children files

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845287#comment-17845287 ] ASF GitHub Bot commented on HDFS-17509: --- LiuGuH commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-16368) DFSAdmin supports refresh topology info without restarting namenode

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845259#comment-17845259 ] ASF GitHub Bot commented on HDFS-16368: --- hadoop-yetus commented on PR #3743: URL: https

[jira] [Commented] (HDFS-17486) VIO: dumpXattrs logic optimization

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845248#comment-17845248 ] ASF GitHub Bot commented on HDFS-17486: --- hadoop-yetus commented on PR #6797: URL: https

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845223#comment-17845223 ] ASF GitHub Bot commented on HDFS-17514: --- hadoop-yetus commented on PR #6804: URL: https

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845215#comment-17845215 ] ASF GitHub Bot commented on HDFS-17514: --- hadoop-yetus commented on PR #6804: URL: https

[jira] [Commented] (HDFS-17511) method storagespaceConsumedContiguous should use BlockInfo#getReplication to compute dsDelta

2024-05-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845210#comment-17845210 ] ASF GitHub Bot commented on HDFS-17511: --- skyskyhu commented on PR #6799: URL: https://github.com

[jira] [Commented] (HDFS-17506) [FGL] Performance for phase 1

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845185#comment-17845185 ] ASF GitHub Bot commented on HDFS-17506: --- ferhui commented on code in PR #6806: URL: https

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845184#comment-17845184 ] ASF GitHub Bot commented on HDFS-17509: --- ZanderXu commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-17506) [FGL] Performance for phase 1

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845182#comment-17845182 ] ASF GitHub Bot commented on HDFS-17506: --- ferhui commented on PR #6806: URL: https://github.com

[jira] [Commented] (HDFS-17503) Unreleased volume references because of OOM

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845179#comment-17845179 ] ASF GitHub Bot commented on HDFS-17503: --- zhuzilong2013 commented on PR #6782: URL: https

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845174#comment-17845174 ] ASF GitHub Bot commented on HDFS-17509: --- LiuGuH commented on code in PR #6784: URL: https

[jira] [Updated] (HDFS-2139) Fast copy for HDFS.

2024-05-09 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-2139: --- Description: There is a need to perform fast file copy on HDFS. The fast copy mechanism for a file works

[jira] [Resolved] (HDFS-17503) Unreleased volume references because of OOM

2024-05-09 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu resolved HDFS-17503. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Unreleased volume referen

[jira] [Commented] (HDFS-17503) Unreleased volume references because of OOM

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845173#comment-17845173 ] ASF GitHub Bot commented on HDFS-17503: --- ZanderXu commented on PR #6782: URL: https://github.com

[jira] [Commented] (HDFS-17503) Unreleased volume references because of OOM

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845172#comment-17845172 ] ASF GitHub Bot commented on HDFS-17503: --- ZanderXu merged PR #6782: URL: https://github.com/apache

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845171#comment-17845171 ] ASF GitHub Bot commented on HDFS-17509: --- ZanderXu commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-17506) [FGL] Performance for phase 1

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845170#comment-17845170 ] ASF GitHub Bot commented on HDFS-17506: --- ZanderXu commented on PR #6806: URL: https://github.com

[jira] [Commented] (HDFS-17506) [FGL] Performance for phase 1

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845167#comment-17845167 ] ASF GitHub Bot commented on HDFS-17506: --- ferhui commented on PR #6806: URL: https://github.com

[jira] [Commented] (HDFS-17438) RBF: The newest STANDBY and UNAVAILABLE nn should be the lowest priority.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845166#comment-17845166 ] ASF GitHub Bot commented on HDFS-17438: --- hadoop-yetus commented on PR #6655: URL: https

[jira] [Commented] (HDFS-17476) fix: False positive "Observer Node is too far behind" due to long overflow.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845162#comment-17845162 ] ASF GitHub Bot commented on HDFS-17476: --- hadoop-yetus commented on PR #6747: URL: https

[jira] [Commented] (HDFS-16368) DFSAdmin supports refresh topology info without restarting namenode

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845156#comment-17845156 ] ASF GitHub Bot commented on HDFS-16368: --- hadoop-yetus commented on PR #3743: URL: https

[jira] [Commented] (HDFS-17438) RBF: The newest STANDBY and UNAVAILABLE nn should be the lowest priority.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845152#comment-17845152 ] ASF GitHub Bot commented on HDFS-17438: --- hadoop-yetus commented on PR #6655: URL: https

[jira] [Commented] (HDFS-16993) Datanode supports configure TopN DatanodeNetworkCounts

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845120#comment-17845120 ] ASF GitHub Bot commented on HDFS-16993: --- hadoop-yetus commented on PR #5597: URL: https

[jira] [Commented] (HDFS-17276) The nn fetch editlog forbidden in kerberos environment

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845069#comment-17845069 ] ASF GitHub Bot commented on HDFS-17276: --- hadoop-yetus commented on PR #6326: URL: https

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844966#comment-17844966 ] ASF GitHub Bot commented on HDFS-17509: --- LiuGuH commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844945#comment-17844945 ] ASF GitHub Bot commented on HDFS-17509: --- LiuGuH commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844944#comment-17844944 ] ASF GitHub Bot commented on HDFS-17509: --- LiuGuH commented on code in PR #6784: URL: https

[jira] [Created] (HDFS-17517) [FGL] Abstract lock mode to cover all RPCs

2024-05-09 Thread ZanderXu (Jira)
ZanderXu created HDFS-17517: --- Summary: [FGL] Abstract lock mode to cover all RPCs Key: HDFS-17517 URL: https://issues.apache.org/jira/browse/HDFS-17517 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-17481) [FGL] ComputeFileSize in INodeFile should avoid BM lock

2024-05-09 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-17481: Parent Issue: HDFS-17366 (was: HDFS-17385) > [FGL] ComputeFileSize in INodeFile should avoid BM l

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844943#comment-17844943 ] ASF GitHub Bot commented on HDFS-17509: --- ZanderXu commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844940#comment-17844940 ] ASF GitHub Bot commented on HDFS-17509: --- ZanderXu commented on code in PR #6784: URL: https

[jira] [Commented] (HDFS-17515) Erasure Coding: ErasureCodingWork is not effectively limited during a block reconstruction cycle.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844927#comment-17844927 ] ASF GitHub Bot commented on HDFS-17515: --- zhengchenyu commented on PR #6805: URL: https://github.com

[jira] [Commented] (HDFS-17515) Erasure Coding: ErasureCodingWork is not effectively limited during a block reconstruction cycle.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844928#comment-17844928 ] ASF GitHub Bot commented on HDFS-17515: --- zhengchenyu closed pull request #6805: HDFS-17515. Erasure

[jira] [Updated] (HDFS-17506) [FGL] Performance for phase 1

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17506: -- Labels: pull-request-available (was: ) > [FGL] Performance for phas

[jira] [Updated] (HDFS-17516) Erasure Coding: Some reconstruction blocks and metrics are inaccuracy when decommission DN which contains many EC blocks.

2024-05-09 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated HDFS-17516: Description: When decommission DN  which contains many EC blocks, this DN will mark as busy

[jira] [Updated] (HDFS-17516) Erasure Coding: Some reconstruction blocks and metrics are inaccuracy when decommission DN which contains many EC blocks.

2024-05-09 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated HDFS-17516: Description: When decommission DN  which contains many EC blocks, this DN will mark as busy

[jira] [Created] (HDFS-17516) Erasure Coding: Some reconstruction blocks and metrics are inaccuracy when decommission DN which contains many EC blocks.

2024-05-09 Thread Chenyu Zheng (Jira)
/jira/browse/HDFS-17516 Project: Hadoop HDFS Issue Type: Improvement Reporter: Chenyu Zheng Assignee: Chenyu Zheng Attachments: 截屏2024-05-09 下午3.59.22.png, 截屏2024-05-09 下午3.59.44.png When decommission DN  which contains many EC blocks, this DN

[jira] [Assigned] (HDFS-17402) StartupSafeMode should not exit when resources are from low to available

2024-05-09 Thread Zilong Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zilong Zhu reassigned HDFS-17402: - Assignee: Zilong Zhu > StartupSafeMode should not exit when resources are from low to availa

[jira] [Commented] (HDFS-17503) Unreleased volume references because of OOM

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844895#comment-17844895 ] ASF GitHub Bot commented on HDFS-17503: --- zhuzilong2013 commented on PR #6782: URL: https

[jira] [Commented] (HDFS-17504) DN process should exit when BPServiceActor exit

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844894#comment-17844894 ] ASF GitHub Bot commented on HDFS-17504: --- zhuzilong2013 commented on PR #6792: URL: https

[jira] (HDFS-16954) RBF: The operation of renaming a multi-subcluster directory to a single-cluster directory should throw ioexception

2024-05-09 Thread chuanjie.duan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16954 ] chuanjie.duan deleted comment on HDFS-16954: -- was (Author: chuanjie.duan): if srcdir and distdir are same (single mount point or mult mount point), is that allowd to rename? >

[jira] [Comment Edited] (HDFS-16954) RBF: The operation of renaming a multi-subcluster directory to a single-cluster directory should throw ioexception

2024-05-09 Thread chuanjie.duan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844893#comment-17844893 ] chuanjie.duan edited comment on HDFS-16954 at 5/9/24 7:32 AM: -- if srcdir

[jira] [Commented] (HDFS-16954) RBF: The operation of renaming a multi-subcluster directory to a single-cluster directory should throw ioexception

2024-05-09 Thread chuanjie.duan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844893#comment-17844893 ] chuanjie.duan commented on HDFS-16954: -- if srcdir and distdir is same (single mount point or mult

[jira] [Commented] (HDFS-17515) Erasure Coding: ErasureCodingWork is not effectively limited during a block reconstruction cycle.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844880#comment-17844880 ] ASF GitHub Bot commented on HDFS-17515: --- zhengchenyu opened a new pull request, #6805: URL: https

[jira] [Updated] (HDFS-17515) Erasure Coding: ErasureCodingWork is not effectively limited during a block reconstruction cycle.

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17515: -- Labels: pull-request-available (was: ) > Erasure Coding: ErasureCodingWork is not effectiv

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844876#comment-17844876 ] ASF GitHub Bot commented on HDFS-17514: --- simbadzina commented on code in PR #6804: URL: https

[jira] [Created] (HDFS-17515) Erasure Coding: ErasureCodingWork is not effectively limited during a block reconstruction cycle.

2024-05-09 Thread Chenyu Zheng (Jira)
Chenyu Zheng created HDFS-17515: --- Summary: Erasure Coding: ErasureCodingWork is not effectively limited during a block reconstruction cycle. Key: HDFS-17515 URL: https://issues.apache.org/jira/browse/HDFS-17515

[jira] [Updated] (HDFS-17515) Erasure Coding: ErasureCodingWork is not effectively limited during a block reconstruction cycle.

2024-05-09 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated HDFS-17515: Description: In a block reconstruction cycle, ErasureCodingWork is not effectively limited. I add

[jira] [Commented] (HDFS-17512) dumpXattrs logic optimization

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844864#comment-17844864 ] ASF GitHub Bot commented on HDFS-17512: --- YaAYadeer closed pull request #6800: HDFS-17512. Unify

[jira] [Commented] (HDFS-17512) dumpXattrs logic optimization

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844863#comment-17844863 ] ASF GitHub Bot commented on HDFS-17512: --- YaAYadeer opened a new pull request, #6800: URL: https

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844858#comment-17844858 ] ASF GitHub Bot commented on HDFS-17514: --- simbadzina commented on code in PR #6804: URL: https

[jira] [Commented] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844847#comment-17844847 ] ASF GitHub Bot commented on HDFS-17464: --- hadoop-yetus commented on PR #6724: URL: https

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844840#comment-17844840 ] ASF GitHub Bot commented on HDFS-17488: --- hadoop-yetus commented on PR #6759: URL: https

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844825#comment-17844825 ] ASF GitHub Bot commented on HDFS-17514: --- xinglin commented on code in PR #6804: URL: https

[jira] [Commented] (HDFS-13603) Warmup NameNode EDEK thread retries continuously if there's an invalid key

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844782#comment-17844782 ] ASF GitHub Bot commented on HDFS-13603: --- hadoop-yetus commented on PR #6774: URL: https

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844758#comment-17844758 ] ASF GitHub Bot commented on HDFS-17514: --- simbadzina commented on code in PR #6804: URL: https

[jira] [Commented] (HDFS-17509) RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file.

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844752#comment-17844752 ] ASF GitHub Bot commented on HDFS-17509: --- hadoop-yetus commented on PR #6784: URL: https

[jira] [Commented] (HDFS-17503) Unreleased volume references because of OOM

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844729#comment-17844729 ] ASF GitHub Bot commented on HDFS-17503: --- hadoop-yetus commented on PR #6782: URL: https

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844727#comment-17844727 ] ASF GitHub Bot commented on HDFS-17514: --- xinglin commented on code in PR #6804: URL: https

[jira] [Commented] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844716#comment-17844716 ] ASF GitHub Bot commented on HDFS-17514: --- mccormickt12 commented on code in PR #6804: URL: https

<    2   3   4   5   6   7   8   9   10   11   >