[jira] [Updated] (HDFS-17483) volume in full disk will be regarded as failure volume when dn restart

2024-04-18 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-17483: - Attachment: 0001-HDFS-17483-volume-in-full-disk-will-be-regarded-as-f.patch > volume in full disk will be

[jira] [Created] (HDFS-17483) volume in full disk will be regarded as failure volume when dn restart

2024-04-18 Thread Xuze Yang (Jira)
Xuze Yang created HDFS-17483: Summary: volume in full disk will be regarded as failure volume when dn restart Key: HDFS-17483 URL: https://issues.apache.org/jira/browse/HDFS-17483 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable

2023-12-19 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-17295: - Attachment: 0001-HDFS-17295-hdfs-dfs-put-may-fail-when-more-than-half.patch Status: Patch Availabl

[jira] [Commented] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable

2023-12-18 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17798040#comment-17798040 ] Xuze Yang commented on HDFS-17295: -- A simple solution is to increase the considerLoadFac

[jira] [Updated] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable

2023-12-17 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-17295: - Description: I encountered an error in one of our production environments. Client error log is: !image-

[jira] [Updated] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable

2023-12-17 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-17295: - Description: I encountered an error in one of our production environments. Client error log is: !image-

[jira] [Updated] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable

2023-12-17 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-17295: - Attachment: image-2023-12-18-14-25-12-447.png > 'hdfs dfs -put' may fail when more than half of the datan

[jira] [Updated] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable

2023-12-17 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-17295: - Description: I encountered an error in one of our production environments. Client error log is: !image-

[jira] [Updated] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable

2023-12-17 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-17295: - Description: I encountered an error in one of our production environments. Client error log is: !image-

[jira] [Created] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable

2023-12-17 Thread Xuze Yang (Jira)
Xuze Yang created HDFS-17295: Summary: 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable Key: HDFS-17295 URL: https://issues.apache.org/jira/browse/HDFS-17295 Project: Hadoop H

[jira] [Updated] (HDFS-17077) slow disks should be used when no more normal disks are available

2023-12-16 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-17077: - Attachment: 0001-HDFS-17077-slow-disks-should-be-used-when-no-more-no.patch Status: Patch Availabl

[jira] [Updated] (HDFS-17274) slow datanodes should be chosen when no more normal datanodes are available

2023-12-04 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-17274: - Description: When dataNodePeerStats and excludeSlowNodes are enabled, hdfs will distinguish and exclude

[jira] [Created] (HDFS-17274) slow datanodes should be chosen when no more normal datanodes are available

2023-12-04 Thread Xuze Yang (Jira)
Xuze Yang created HDFS-17274: Summary: slow datanodes should be chosen when no more normal datanodes are available Key: HDFS-17274 URL: https://issues.apache.org/jira/browse/HDFS-17274 Project: Hadoop HDF

[jira] [Created] (HDFS-17077) slow disks should be used when no more normal disks are available

2023-07-10 Thread Xuze Yang (Jira)
Xuze Yang created HDFS-17077: Summary: slow disks should be used when no more normal disks are available Key: HDFS-17077 URL: https://issues.apache.org/jira/browse/HDFS-17077 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-15990) No need to write to sub_section when serialize SnapshotDiff Section

2021-04-19 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17325409#comment-17325409 ] Xuze Yang edited comment on HDFS-15990 at 4/20/21, 1:30 AM: [

[jira] [Commented] (HDFS-15990) No need to write to sub_section when serialize SnapshotDiff Section

2021-04-19 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17325409#comment-17325409 ] Xuze Yang commented on HDFS-15990: -- [~sodonnell] Thank you for your timely reply. I got

[jira] [Updated] (HDFS-15990) No need to write to sub_section when serialize SnapshotDiff Section

2021-04-19 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-15990: - Priority: Minor (was: Major) > No need to write to sub_section when serialize SnapshotDiff Section > ---

[jira] [Updated] (HDFS-15990) No need to write to sub_section when serialize SnapshotDiff Section

2021-04-19 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-15990: - Description: In FSImageFormatPBSnapshot.serializeSnapshotDiffSection(), the following code exists: {code

[jira] [Updated] (HDFS-15990) No need to write to sub_section when serialize SnapshotDiff Section

2021-04-19 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-15990: - Description: In FSImageFormatPBSnapshot.serializeSnapshotDiffSection(), the following code exists: {quot

[jira] [Updated] (HDFS-15990) No need to write to sub_section when serialize SnapshotDiff Section

2021-04-19 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuze Yang updated HDFS-15990: - Description: In FSImageFormatPBSnapshot.serializeSnapshotDiffSection(), the following code exists: {quot

[jira] [Created] (HDFS-15990) No need to write to sub_section when serialize SnapshotDiff Section

2021-04-19 Thread Xuze Yang (Jira)
Xuze Yang created HDFS-15990: Summary: No need to write to sub_section when serialize SnapshotDiff Section Key: HDFS-15990 URL: https://issues.apache.org/jira/browse/HDFS-15990 Project: Hadoop HDFS