[jira] [Created] (HDFS-16573) Fix test TestDFSStripedInputStreamWithRandomECPolicy

daimin created HDFS-16573: - Summary: Fix test TestDFSStripedInputStreamWithRandomECPolicy Key: HDFS-16573 URL: https://issues.apache.org/jira/browse/HDFS-16573 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17532770#comment-17532770 ] daimin commented on HDFS-13243: --- [~gzh1992n][~weichiu] We have encountered the same problem in our cluster

[jira] [Assigned] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daimin reassigned HDFS-13243: - Assignee: daimin (was: Zephyr Guo) > Get CorruptBlock because of calling close and sync in same time >

[jira] [Created] (HDFS-16546) Fix UT TestOfflineImageViewer#testReverseXmlWithoutSnapshotDiffSection to branch branch-3.2

daimin created HDFS-16546: - Summary: Fix UT TestOfflineImageViewer#testReverseXmlWithoutSnapshotDiffSection to branch branch-3.2 Key: HDFS-16546 URL: https://issues.apache.org/jira/browse/HDFS-16546

[jira] [Updated] (HDFS-16543) Keep default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec consistent

[ https://issues.apache.org/jira/browse/HDFS-16543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daimin updated HDFS-16543: -- Description: "WARN datanode.DirectoryScanner (DirectoryScanner.java:(300)) -

[jira] [Updated] (HDFS-16543) Keep default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec consistent

[ https://issues.apache.org/jira/browse/HDFS-16543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daimin updated HDFS-16543: -- Description: "WARN datanode.DirectoryScanner (DirectoryScanner.java:(300)) -

[jira] [Created] (HDFS-16543) Keep default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec consistent

daimin created HDFS-16543: - Summary: Keep default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec consistent Key: HDFS-16543 URL: https://issues.apache.org/jira/browse/HDFS-16543 Project:

[jira] [Created] (HDFS-16542) Fix failed unit tests in branch branch-3.2

daimin created HDFS-16542: - Summary: Fix failed unit tests in branch branch-3.2 Key: HDFS-16542 URL: https://issues.apache.org/jira/browse/HDFS-16542 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520328#comment-17520328 ] daimin commented on HDFS-16422: --- [~tasanuma] I think NativeRSRawDecoder is thread safe after HDFS-16422,

[jira] [Created] (HDFS-16520) Improve EC pread: avoid potential reading whole block

daimin created HDFS-16520: - Summary: Improve EC pread: avoid potential reading whole block Key: HDFS-16520 URL: https://issues.apache.org/jira/browse/HDFS-16520 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-16519) Add throttler to EC reconstruction

daimin created HDFS-16519: - Summary: Add throttler to EC reconstruction Key: HDFS-16519 URL: https://issues.apache.org/jira/browse/HDFS-16519 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Comment Edited] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511224#comment-17511224 ] daimin edited comment on HDFS-16422 at 3/23/22, 12:30 PM: -- [~jingzhao] I tested

[jira] [Comment Edited] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511224#comment-17511224 ] daimin edited comment on HDFS-16422 at 3/23/22, 12:26 PM: -- [~jingzhao] I tested

[jira] [Comment Edited] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511224#comment-17511224 ] daimin edited comment on HDFS-16422 at 3/23/22, 12:25 PM: -- [~jingzhao] I tested

[jira] [Commented] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511224#comment-17511224 ] daimin commented on HDFS-16422: --- [~jingzhao] I tested this again, and my test steps are: # Setup a cluster

[jira] [Created] (HDFS-16510) Fix EC decommission when rack is not enough

daimin created HDFS-16510: - Summary: Fix EC decommission when rack is not enough Key: HDFS-16510 URL: https://issues.apache.org/jira/browse/HDFS-16510 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16509) Fix decommission UnsupportedOperationException: Remove unsupported

daimin created HDFS-16509: - Summary: Fix decommission UnsupportedOperationException: Remove unsupported Key: HDFS-16509 URL: https://issues.apache.org/jira/browse/HDFS-16509 Project: Hadoop HDFS

[jira] [Commented] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507969#comment-17507969 ] daimin commented on HDFS-16422: --- I tested both NativeRSRawDecoder and RSRawDecoder before, and they seems

[jira] [Created] (HDFS-16430) Validate maximum blocks in EC group when adding an EC policy

daimin created HDFS-16430: - Summary: Validate maximum blocks in EC group when adding an EC policy Key: HDFS-16430 URL: https://issues.apache.org/jira/browse/HDFS-16430 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

daimin created HDFS-16422: - Summary: Fix thread safety of EC decoding during concurrent preads Key: HDFS-16422 URL: https://issues.apache.org/jira/browse/HDFS-16422 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daimin updated HDFS-8791: - Description: underlined textWe are seeing cases where the new directory layout causes the datanode to basically

[jira] [Created] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background

daimin created HDFS-16403: - Summary: Improve FUSE IO performance by supporting FUSE parameter max_background Key: HDFS-16403 URL: https://issues.apache.org/jira/browse/HDFS-16403 Project: Hadoop HDFS

[jira] [Commented] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17436476#comment-17436476 ] daimin commented on HDFS-16286: --- [~sodonnell] Thanks for your reply. I have visited the README document

[jira] [Comment Edited] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17434694#comment-17434694 ] daimin edited comment on HDFS-16286 at 10/27/21, 6:57 AM: -- pull request #3593:

[jira] [Updated] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daimin updated HDFS-16286: -- Labels: pull-request-available (was: ) > Debug tool to verify the correctness of erasure coding on file >

[jira] [Commented] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17434694#comment-17434694 ] daimin commented on HDFS-16286: --- pull request #3593: URL: 

[jira] [Updated] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daimin updated HDFS-16286: -- Labels: (was: pull) > Debug tool to verify the correctness of erasure coding on file >

[jira] [Updated] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daimin updated HDFS-16286: -- Labels: pull (was: ) > Debug tool to verify the correctness of erasure coding on file >

[jira] [Created] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

daimin created HDFS-16286: - Summary: Debug tool to verify the correctness of erasure coding on file Key: HDFS-16286 URL: https://issues.apache.org/jira/browse/HDFS-16286 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-16282) Duplicate generic usage information to hdfs debug command

daimin created HDFS-16282: - Summary: Duplicate generic usage information to hdfs debug command Key: HDFS-16282 URL: https://issues.apache.org/jira/browse/HDFS-16282 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-16272) Int overflow in computing safe length during EC block recovery

daimin created HDFS-16272: - Summary: Int overflow in computing safe length during EC block recovery Key: HDFS-16272 URL: https://issues.apache.org/jira/browse/HDFS-16272 Project: Hadoop HDFS Issue