[jira] [Commented] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809273#comment-17809273 ] ASF GitHub Bot commented on HDFS-17342: --- haiyang1987 commented on code in PR #6464: URL:

[jira] [Commented] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809270#comment-17809270 ] ASF GitHub Bot commented on HDFS-17342: --- haiyang1987 commented on PR #6464: URL:

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809267#comment-17809267 ] ASF GitHub Bot commented on HDFS-17346: --- hadoop-yetus commented on PR #6476: URL:

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809261#comment-17809261 ] ASF GitHub Bot commented on HDFS-17293: --- hadoop-yetus commented on PR #6368: URL:

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809236#comment-17809236 ] ASF GitHub Bot commented on HDFS-17293: --- hfutatzhanghb commented on PR #6368: URL:

[jira] [Resolved] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17293. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > First packet data +

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809235#comment-17809235 ] ASF GitHub Bot commented on HDFS-17293: --- zhangshuyan0 commented on PR #6368: URL:

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809234#comment-17809234 ] ASF GitHub Bot commented on HDFS-17293: --- zhangshuyan0 merged PR #6368: URL:

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809229#comment-17809229 ] ASF GitHub Bot commented on HDFS-17293: --- hfutatzhanghb commented on PR #6368: URL:

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809227#comment-17809227 ] Haiyang Hu commented on HDFS-17346: --- Get it, thanks [~hexiaoqiao] for your comment. > Fix

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809224#comment-17809224 ] Xiaoqiao He commented on HDFS-17346: [~haiyang Hu] Thanks for your contributions. The best practice

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17346: --- Fix Version/s: (was: 3.5.0) > Fix DirectoryScanner check mark the normal blocks as corrupt. >

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Fix Version/s: 3.5.0 > Fix DirectoryScanner check mark the normal blocks as corrupt. >

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Component/s: datanode > Fix DirectoryScanner check mark the normal blocks as corrupt. >

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809222#comment-17809222 ] ASF GitHub Bot commented on HDFS-17346: --- haiyang1987 commented on PR #6476: URL:

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809221#comment-17809221 ] ASF GitHub Bot commented on HDFS-17293: --- zhangshuyan0 commented on PR #6368: URL:

[jira] [Commented] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809215#comment-17809215 ] ASF GitHub Bot commented on HDFS-17342: --- ZanderXu commented on PR #6464: URL:

[jira] [Commented] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809212#comment-17809212 ] ASF GitHub Bot commented on HDFS-17342: --- smarthanwang commented on code in PR #6464: URL:

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809149#comment-17809149 ] ASF GitHub Bot commented on HDFS-17346: --- hadoop-yetus commented on PR #6476: URL:

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17346: -- Labels: pull-request-available (was: ) > Fix DirectoryScanner check mark the normal blocks as

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809114#comment-17809114 ] ASF GitHub Bot commented on HDFS-17346: --- haiyang1987 opened a new pull request, #6476: URL:

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Description: DirectoryScanner check mark the normal blocks as corrupt and report to namenode, it

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Description: DirectoryScanner check mark the normal blocks as corrupt and report to namenode, it

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Description: DirectoryScanner check mark the normal blocks as corrupt and report to namenode, it

[jira] [Created] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17346: - Summary: Fix DirectoryScanner check mark the normal blocks as corrupt. Key: HDFS-17346 URL: https://issues.apache.org/jira/browse/HDFS-17346 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16511) Improve lock type for ReplicaMap under fine-grain lock mode.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16511: -- Affects Version/s: 3.4.0 > Improve lock type for ReplicaMap under fine-grain lock mode. >

[jira] [Updated] (HDFS-16534) Split datanode block pool locks to volume grain.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16534: -- Affects Version/s: 3.4.0 > Split datanode block pool locks to volume grain. >

[jira] [Updated] (HDFS-16534) Split datanode block pool locks to volume grain.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16534: -- Component/s: datanode > Split datanode block pool locks to volume grain. >

[jira] [Commented] (HDFS-17345) Add a metrics to record block report generating cost time

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809093#comment-17809093 ] ASF GitHub Bot commented on HDFS-17345: --- hadoop-yetus commented on PR #6475: URL: