[jira] [Updated] (HDFS-16272) Int overflow in computing safe length during EC block recovery

2022-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16272: --- Component/s: ec erasure-coding > Int overflow in computing safe length

[jira] [Resolved] (HDFS-16520) Improve EC pread: avoid potential reading whole block

2022-05-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16520. Resolution: Fixed Merged the PR and cherrypicked into branch-3.3. Thanks! > Improve EC

[jira] [Updated] (HDFS-16520) Improve EC pread: avoid potential reading whole block

2022-05-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16520: --- Fix Version/s: 3.3.4 > Improve EC pread: avoid potential reading whole block >

[jira] [Updated] (HDFS-16520) Improve EC pread: avoid potential reading whole block

2022-05-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16520: --- Component/s: erasure-coding > Improve EC pread: avoid potential reading whole block >

[jira] [Updated] (HDFS-16520) Improve EC pread: avoid potential reading whole block

2022-05-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16520: --- Fix Version/s: 3.4.0 > Improve EC pread: avoid potential reading whole block >

[jira] [Resolved] (HDFS-16521) DFS API to retrieve slow datanodes

2022-05-05 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16521. Resolution: Fixed > DFS API to retrieve slow datanodes >

[jira] [Updated] (HDFS-16521) DFS API to retrieve slow datanodes

2022-05-05 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16521: --- Fix Version/s: 3.4.0 3.3.4 > DFS API to retrieve slow datanodes >

[jira] [Updated] (HDFS-16521) DFS API to retrieve slow datanodes

2022-05-02 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16521: --- Status: In Progress (was: Patch Available) > DFS API to retrieve slow datanodes >

[jira] [Resolved] (HDFS-16551) Backport HADOOP-17588 to 3.3 and other active old branches.

2022-04-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16551. Fix Version/s: 2.10.2 3.2.4 Resolution: Fixed Done. Thanks! >

[jira] [Updated] (HDFS-16389) Improve NNThroughputBenchmark test mkdirs

2022-04-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16389: --- Fix Version/s: 3.2.4 3.3.4 > Improve NNThroughputBenchmark test mkdirs >

[jira] [Updated] (HDFS-16544) EC decoding failed due to invalid buffer

2022-04-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16544: --- Component/s: erasure-coding > EC decoding failed due to invalid buffer >

[jira] [Updated] (HDFS-16538) EC decoding failed due to not enough valid inputs

2022-04-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16538: --- Component/s: erasure-coding > EC decoding failed due to not enough valid inputs >

[jira] [Resolved] (HDFS-16389) Improve NNThroughputBenchmark test mkdirs

2022-04-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16389. Fix Version/s: 3.4.0 Resolution: Fixed > Improve NNThroughputBenchmark test mkdirs

[jira] [Updated] (HDFS-16509) Fix decommission UnsupportedOperationException: Remove unsupported

2022-04-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16509: --- Fix Version/s: 3.2.4 > Fix decommission UnsupportedOperationException: Remove unsupported >

[jira] [Resolved] (HDFS-16535) SlotReleaser should reuse the domain socket based on socket paths

2022-04-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16535. Fix Version/s: 3.3.3 3.4.0 Resolution: Fixed Merged. Thanks

[jira] [Updated] (HDFS-16509) Fix decommission UnsupportedOperationException: Remove unsupported

2022-04-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16509: --- Fix Version/s: 3.3.4 > Fix decommission UnsupportedOperationException: Remove unsupported >

[jira] [Resolved] (HDFS-16502) Reconfigure Block Invalidate limit

2022-03-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16502. Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Reconfigure Block

[jira] [Updated] (HDFS-11041) Unable to unregister FsDatasetState MBean if DataNode is shutdown twice

2022-02-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11041: --- Fix Version/s: 2.10.2 3.2.3 3.3.3 > Unable to

[jira] [Commented] (HDFS-11041) Unable to unregister FsDatasetState MBean if DataNode is shutdown twice

2022-02-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496465#comment-17496465 ] Wei-Chiu Chuang commented on HDFS-11041: Sure thing. Done. > Unable to unregister FsDatasetState

[jira] [Commented] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493011#comment-17493011 ] Wei-Chiu Chuang commented on HDFS-16456: [~tasanuma] [~ferhui] would you be interesting in

[jira] [Updated] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

2022-02-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15273: --- Status: Open (was: Patch Available) > CacheReplicationMonitor hold lock for long time and

[jira] [Updated] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

2022-02-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15273: --- Status: Patch Available (was: Open) The patch still applies. Submit the patch to go through

[jira] [Assigned] (HDFS-16455) RBF: Router should explicitly specify the value of `jute.maxbuffer` in hadoop configuration files like core-site.xml

2022-02-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16455: -- Assignee: Max Xie > RBF: Router should explicitly specify the value of

[jira] [Resolved] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

2022-02-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16422. Fix Version/s: 3.4.0 3.2.3 3.3.3 Resolution:

[jira] [Comment Edited] (HDFS-16316) Improve DirectoryScanner: add regular file check related block

2022-02-07 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488633#comment-17488633 ] Wei-Chiu Chuang edited comment on HDFS-16316 at 2/8/22, 7:15 AM: -

[jira] [Commented] (HDFS-16316) Improve DirectoryScanner: add regular file check related block

2022-02-07 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488633#comment-17488633 ] Wei-Chiu Chuang commented on HDFS-16316: Interesting. The file type 'b' is a block device file.

[jira] [Commented] (HDFS-15924) Log4j will cause Server handler blocked when audit log boom.

2022-02-07 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488546#comment-17488546 ] Wei-Chiu Chuang commented on HDFS-15924: Reviewed the code in reload4j. This looks like still

[jira] [Updated] (HDFS-16437) ReverseXML processor doesn't accept XML files without the SnapshotDiffSection.

2022-02-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16437: --- Fix Version/s: 3.2.3 3.3.3 > ReverseXML processor doesn't accept XML

[jira] [Assigned] (HDFS-16437) ReverseXML processor doesn't accept XML files without the SnapshotDiffSection.

2022-02-05 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16437: -- Assignee: yanbin.zhang > ReverseXML processor doesn't accept XML files without the

[jira] [Resolved] (HDFS-16437) ReverseXML processor doesn't accept XML files without the SnapshotDiffSection.

2022-02-05 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16437. Fix Version/s: 3.4.0 Resolution: Fixed Merged. Thanks [~it_singer] for the

[jira] [Commented] (HDFS-16437) ReverseXML processor doesn't accept XML files without the SnapshotDiffSection.

2022-02-02 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17486196#comment-17486196 ] Wei-Chiu Chuang commented on HDFS-16437: [~it_singer] I'd like to add you as a contributor to the

[jira] [Resolved] (HDFS-16423) balancer should not get blocks on stale storages

2022-01-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16423. Fix Version/s: 3.3.3 Resolution: Fixed > balancer should not get blocks on stale

[jira] [Commented] (HDFS-16438) Avoid holding read locks for a long time when scanDatanodeStorage

2022-01-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481920#comment-17481920 ] Wei-Chiu Chuang commented on HDFS-16438: cc: [~sodonnell] > Avoid holding read locks for a long

[jira] [Resolved] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16403. Resolution: Fixed Thank you [~cndaimin] for the great work and the excellent performance

[jira] [Updated] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16403: --- Fix Version/s: 3.4.0 3.2.3 3.3.3 > Improve FUSE IO

[jira] [Reopened] (HDFS-16423) balancer should not get blocks on stale storages

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-16423: Reopen to backport this to lower branches. > balancer should not get blocks on stale storages

[jira] [Updated] (HDFS-16430) Validate maximum blocks in EC group when adding an EC policy

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16430: --- Fix Version/s: 3.2.3 3.3.3 > Validate maximum blocks in EC group when

[jira] [Commented] (HDFS-16430) Validate maximum blocks in EC group when adding an EC policy

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481492#comment-17481492 ] Wei-Chiu Chuang commented on HDFS-16430: Cherrypicked to branch-3.3 and branch-3.2 > Validate

[jira] [Updated] (HDFS-16427) Add debug log for BlockManager#chooseExcessRedundancyStriped

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16427: --- Component/s: erasure-coding > Add debug log for BlockManager#chooseExcessRedundancyStriped >

[jira] [Updated] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16420: --- Component/s: erasure-coding > Avoid deleting unique data blocks when deleting redundancy

[jira] [Updated] (HDFS-16333) fix balancer bug when transfer an EC block

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16333: --- Component/s: erasure-coding > fix balancer bug when transfer an EC block >

[jira] [Updated] (HDFS-16352) return the real datanode numBlocks in #getDatanodeStorageReport

2022-01-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16352: --- Fix Version/s: 3.3.3 > return the real datanode numBlocks in #getDatanodeStorageReport >

[jira] [Commented] (HDFS-16423) balancer should not get blocks on stale storages

2022-01-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478200#comment-17478200 ] Wei-Chiu Chuang commented on HDFS-16423: Thanks for filing the bug report! I just wonder if

[jira] [Resolved] (HDFS-16317) Backport HDFS-14729 for branch-3.2

2021-12-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16317. Fix Version/s: 3.2.3 Resolution: Fixed Merged the commit into branch-3.2 and

[jira] [Reopened] (HDFS-16384) Upgrade Netty to 4.1.72.Final

2021-12-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-16384: > Upgrade Netty to 4.1.72.Final > - > > Key:

[jira] [Updated] (HDFS-16384) Upgrade Netty to 4.1.72.Final

2021-12-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16384: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-16337) Show start time of Datanode on Web

2021-11-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16337: --- Fix Version/s: 3.3.3 (was: 3.3.2) > Show start time of Datanode on

[jira] [Updated] (HDFS-16337) Show start time of Datanode on Web

2021-11-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16337: --- Fix Version/s: 3.2.3 3.3.2 > Show start time of Datanode on Web >

[jira] [Resolved] (HDFS-16337) Show start time of Datanode on Web

2021-11-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16337. Fix Version/s: 3.4.0 Resolution: Fixed > Show start time of Datanode on Web >

[jira] [Updated] (HDFS-16182) numOfReplicas is given the wrong value in BlockPlacementPolicyDefault$chooseTarget can cause DataStreamer to fail with Heterogeneous Storage

2021-11-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16182: --- Fix Version/s: 3.4.0 3.2.3 3.3.2 Resolution:

[jira] [Updated] (HDFS-16187) SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing

2021-11-11 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16187: --- Fix Version/s: 3.3.2 > SnapshotDiff behaviour with Xattrs and Acls is not consistent across

[jira] [Updated] (HDFS-16187) SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing

2021-11-11 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16187: --- Fix Version/s: 3.2.3 > SnapshotDiff behaviour with Xattrs and Acls is not consistent across

[jira] [Updated] (HDFS-16187) SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing

2021-11-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16187: --- Fix Version/s: 3.4.0 (was: 1.3.0) > SnapshotDiff behaviour with

[jira] [Commented] (HDFS-16292) The DFS Input Stream is waiting to be read

2021-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17436790#comment-17436790 ] Wei-Chiu Chuang commented on HDFS-16292: Hi thanks for reporting the issue. However, 2.5.2 is

[jira] [Assigned] (HDFS-16292) The DFS Input Stream is waiting to be read

2021-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16292: -- Assignee: (was: Wei-Chiu Chuang) > The DFS Input Stream is waiting to be read >

[jira] [Assigned] (HDFS-16292) The DFS Input Stream is waiting to be read

2021-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16292: -- Assignee: Wei-Chiu Chuang > The DFS Input Stream is waiting to be read >

[jira] [Commented] (HDFS-16266) Add remote port information to HDFS audit log

2021-10-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17433608#comment-17433608 ] Wei-Chiu Chuang commented on HDFS-16266: Thanks for reporting the issue and submitting the PR.

[jira] [Assigned] (HDFS-12204) Dfsclient Do not close file descriptor when using shortcircuit

2021-10-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-12204: -- Assignee: HanRyong,Jung > Dfsclient Do not close file descriptor when using

[jira] [Resolved] (HDFS-16241) Standby close reconstruction thread

2021-10-11 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16241. Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution:

[jira] [Commented] (HDFS-16258) HDFS-13671 breaks TestBlockManager in branch-3.2

2021-10-07 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425395#comment-17425395 ] Wei-Chiu Chuang commented on HDFS-16258: It's reproducible even prior to this change. I guess

[jira] [Updated] (HDFS-16258) HDFS-13671 breaks TestBlockManager in branch-3.2

2021-10-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16258: --- Description: TestBlockManager in branch-3.2 has two failed tests: *

[jira] [Created] (HDFS-16258) HDFS-13671 breaks TestBlockManager in branch-3.2

2021-10-06 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16258: -- Summary: HDFS-13671 breaks TestBlockManager in branch-3.2 Key: HDFS-16258 URL: https://issues.apache.org/jira/browse/HDFS-16258 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2021-10-04 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12681: --- Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) Release Note:

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2021-10-04 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424262#comment-17424262 ] Wei-Chiu Chuang commented on HDFS-12681: For future reference, this change breaks source

[jira] [Resolved] (HDFS-16238) Improve comments related to EncryptionZoneManager

2021-09-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16238. Fix Version/s: 3.4.0 Resolution: Fixed Thanks [~vjasani] [~hexiaoqiao]for the

[jira] [Updated] (HDFS-16246) Print lockWarningThreshold in InstrumentedLock#logWarning and InstrumentedLock#logWaitWarning

2021-09-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16246: --- Fix Version/s: 3.3.2 > Print lockWarningThreshold in InstrumentedLock#logWarning and >

[jira] [Moved] (HDFS-16246) Print lockWarningThreshold in InstrumentedLock#logWarning and InstrumentedLock#logWaitWarning

2021-09-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang moved HADOOP-17938 to HDFS-16246: - Fix Version/s: (was: 3.4.0) 3.4.0

[jira] [Commented] (HDFS-15474) HttpFS: WebHdfsFileSystem cannot renew an expired delegation token from HttpFS response

2021-09-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423065#comment-17423065 ] Wei-Chiu Chuang commented on HDFS-15474: Is this fixed by HDFS-15545? > HttpFS:

[jira] [Commented] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

2021-09-28 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421893#comment-17421893 ] Wei-Chiu Chuang commented on HDFS-14575: Now that HDFS-16235 is resolved, we should consider

[jira] [Resolved] (HDFS-16232) Fix java doc for BlockReaderRemote#newBlockReader

2021-09-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16232. Fix Version/s: 3.4.0 Resolution: Fixed > Fix java doc for

[jira] [Commented] (HDFS-16233) Do not use exception handler to implement copy-on-write for EnumCounters

2021-09-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418424#comment-17418424 ] Wei-Chiu Chuang commented on HDFS-16233: [~LiJinglun] [~xkrogen] fyi > Do not use exception

[jira] [Updated] (HDFS-16233) Do not use exception handler to implement copy-on-write for EnumCounters

2021-09-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16233: --- Attachment: profile_c7_delete_asyncaudit.html > Do not use exception handler to implement

[jira] [Assigned] (HDFS-16233) Do not use exception handler to implement copy-on-write for EnumCounters

2021-09-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16233: -- Assignee: Wei-Chiu Chuang > Do not use exception handler to implement copy-on-write

[jira] [Created] (HDFS-16233) Do not use exception handler to implement copy-on-write for EnumCounters

2021-09-22 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16233: -- Summary: Do not use exception handler to implement copy-on-write for EnumCounters Key: HDFS-16233 URL: https://issues.apache.org/jira/browse/HDFS-16233 Project:

[jira] [Updated] (HDFS-16198) Short circuit read leaks Slot objects when InvalidToken exception is thrown

2021-09-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16198: --- Fix Version/s: (was: 3.32) 3.3.2 3.2.3

[jira] [Updated] (HDFS-16198) Short circuit read leaks Slot objects when InvalidToken exception is thrown

2021-09-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16198: --- Fix Version/s: 3.32 > Short circuit read leaks Slot objects when InvalidToken exception is

[jira] [Updated] (HDFS-16198) Short circuit read leaks Slot objects when InvalidToken exception is thrown

2021-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16198: --- Fix Version/s: 3.4.0 > Short circuit read leaks Slot objects when InvalidToken exception is

[jira] [Assigned] (HDFS-16198) Short circuit read leaks Slot objects when InvalidToken exception is thrown

2021-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16198: -- Assignee: Eungsop Yoo > Short circuit read leaks Slot objects when InvalidToken

[jira] [Resolved] (HDFS-16192) ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2021-08-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16192. Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Thanks

[jira] [Updated] (HDFS-16173) Improve CopyCommands#Put#executor queue configurability

2021-08-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16173: --- Fix Version/s: 3.2.4 3.3.2 3.4.0 > Improve

[jira] [Resolved] (HDFS-16173) Improve CopyCommands#Put#executor queue configurability

2021-08-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16173. Resolution: Fixed > Improve CopyCommands#Put#executor queue configurability >

[jira] [Resolved] (HDFS-16175) Improve the configurable value of Server #PURGE_INTERVAL_NANOS

2021-08-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16175. Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution:

[jira] [Resolved] (HDFS-16180) FsVolumeImpl.nextBlock should consider that the block meta file has been deleted.

2021-08-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16180. Fix Version/s: 3.4.0 Resolution: Fixed > FsVolumeImpl.nextBlock should consider

[jira] [Resolved] (HDFS-16112) Fix flaky unit test TestDecommissioningStatusWithBackoffMonitor

2021-08-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16112. Resolution: Duplicate closed it for you. You are already granted contributor privilege and

[jira] [Assigned] (HDFS-16112) Fix flaky unit test TestDecommissioningStatusWithBackoffMonitor

2021-08-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16112: -- Assignee: tomscut > Fix flaky unit test TestDecommissioningStatusWithBackoffMonitor

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2021-08-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403069#comment-17403069 ] Wei-Chiu Chuang commented on HDFS-6874: --- I rebased the patch and addressed Inigo's comments. Will

[jira] [Updated] (HDFS-13351) Revert HDFS-11156 from branch-2/branch-2.8

2021-08-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13351: --- Resolution: Fixed Status: Resolved (was: Patch Available) Updated fix version

[jira] [Updated] (HDFS-13351) Revert HDFS-11156 from branch-2/branch-2.8

2021-08-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13351: --- Fix Version/s: 2.8.5 > Revert HDFS-11156 from branch-2/branch-2.8 >

[jira] [Updated] (HDFS-13351) Revert HDFS-11156 from branch-2/branch-2.8

2021-08-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13351: --- Fix Version/s: 2.10.1 > Revert HDFS-11156 from branch-2/branch-2.8 >

[jira] [Resolved] (HDFS-16177) Bug fix for Util#receiveFile

2021-08-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16177. Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution:

[jira] [Resolved] (HDFS-14477) No enum constant Operation.GET_BLOCK_LOCATIONS

2021-08-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14477. Resolution: Duplicate > No enum constant Operation.GET_BLOCK_LOCATIONS >

[jira] [Resolved] (HDFS-16162) Improve DFSUtil#checkProtectedDescendants() related parameter comments

2021-08-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16162. Fix Version/s: 3.4.0 Resolution: Fixed > Improve

[jira] [Commented] (HDFS-16176) fix ec -unsetPolicy not success

2021-08-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400044#comment-17400044 ] Wei-Chiu Chuang commented on HDFS-16176: Thanks for reporting issue and opening the PR,

[jira] [Resolved] (HDFS-16161) Corrupt block checksum is not reported to NameNode

2021-08-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16161. Resolution: Duplicate Turns out it was fixed by HDFS-14706 > Corrupt block checksum is

[jira] [Updated] (HDFS-16161) Corrupt block checksum is not reported to NameNode

2021-08-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16161: --- Description: One of our user reported this error in the log: {noformat} 2021-07-30

[jira] [Updated] (HDFS-16161) Corrupt block checksum is not reported to NameNode

2021-08-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16161: --- Description: One of our user reported this error in the log: {noformat} 2021-07-30

[jira] [Created] (HDFS-16161) Corrupt block checksum is not reported to NameNode

2021-08-10 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16161: -- Summary: Corrupt block checksum is not reported to NameNode Key: HDFS-16161 URL: https://issues.apache.org/jira/browse/HDFS-16161 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-16154) TestMiniJournalCluster failing intermittently because of not reseting UserGroupInformation completely

2021-08-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16154. Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution:

[jira] [Resolved] (HDFS-16149) Improve the parameter annotation in FairCallQueue#priorityLevels

2021-08-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16149. Fix Version/s: 3.4.0 Resolution: Fixed > Improve the parameter annotation in

[jira] [Resolved] (HDFS-14529) SetTimes to throw FileNotFoundException if inode is not found

2021-07-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14529. Fix Version/s: 3.4.0 Resolution: Fixed > SetTimes to throw FileNotFoundException if

<    1   2   3   4   5   6   7   8   9   10   >