[jira] [Updated] (HDFS-17478) FSPermissionChecker to avoid obtaining a new AccessControlEnforcer instance before each authz call

2024-04-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17478: --- Fix Version/s: 3.5.0 (was: 3.4.1) > FSPermissionChecker to avoid obtai

[jira] [Updated] (HDFS-17478) FSPermissionChecker to avoid obtaining a new AccessControlEnforcer instance before each authz call

2024-04-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17478: --- Fix Version/s: 3.4.1 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Assigned] (HDFS-17478) FSPermissionChecker to avoid obtaining a new AccessControlEnforcer instance before each authz call

2024-04-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17478: -- Assignee: Madhan Neethiraj > FSPermissionChecker to avoid obtaining a new AccessContro

[jira] [Assigned] (HDFS-17181) WebHDFS not considering whether a DN is good when called from outside the cluster

2024-02-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17181: -- Assignee: Lars Francke > WebHDFS not considering whether a DN is good when called from

[jira] [Resolved] (HDFS-17181) WebHDFS not considering whether a DN is good when called from outside the cluster

2024-02-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-17181. Fix Version/s: 3.5.0 Resolution: Fixed > WebHDFS not considering whether a DN is goo

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Fix Version/s: 3.3.9 > Potential data race introduced by HDFS-15865 > ---

[jira] [Assigned] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17024: -- Assignee: Segawa Hiroaki > Potential data race introduced by HDFS-15865 >

[jira] [Resolved] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-17024. Fix Version/s: 3.4.0 Resolution: Fixed > Potential data race introduced by HDFS-1586

[jira] [Assigned] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17024: -- Assignee: (was: Wei-Chiu Chuang) > Potential data race introduced by HDFS-15865 >

[jira] [Commented] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

2023-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780041#comment-17780041 ] Wei-Chiu Chuang commented on HDFS-15273: +1 sorry for the very late review. IMO

[jira] [Updated] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

2023-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15273: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Commented] (HDFS-16950) Gap in edits after -initializeSharedEdits

2023-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780001#comment-17780001 ] Wei-Chiu Chuang commented on HDFS-16950: Karthik said because of the missing edit

[jira] [Updated] (HDFS-16950) Gap in edits after -initializeSharedEdits

2023-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16950: --- Priority: Critical (was: Major) > Gap in edits after -initializeSharedEdits > --

[jira] [Updated] (HDFS-16950) Gap in edits after -initializeSharedEdits

2023-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16950: --- Issue Type: Bug (was: Improvement) > Gap in edits after -initializeSharedEdits > ---

[jira] [Commented] (HDFS-17175) setOwner maybe set any user due to HDFS-16798

2023-08-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17760992#comment-17760992 ] Wei-Chiu Chuang commented on HDFS-17175: [~Linwood] can you elaborate? [~xuzq_za

[jira] [Created] (HDFS-17080) Fix ec connection leak (GitHub PR#5807)

2023-07-11 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-17080: -- Summary: Fix ec connection leak (GitHub PR#5807) Key: HDFS-17080 URL: https://issues.apache.org/jira/browse/HDFS-17080 Project: Hadoop HDFS Issue Type: T

[jira] [Updated] (HDFS-16866) Fix a typo in Dispatcher.

2023-06-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16866: --- Fix Version/s: 3.4.0 (was: 3.3.6) > Fix a typo in Dispatcher. > --

[jira] [Updated] (HDFS-16861) RBF. Truncate API always fails when dirs use AllResolver oder on Router

2023-06-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16861: --- Fix Version/s: 3.4.0 (was: 3.3.6) > RBF. Truncate API always fails whe

[jira] [Updated] (HDFS-16858) Dynamically adjust max slow disks to exclude

2023-06-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16858: --- Fix Version/s: 3.4.0 (was: 3.3.6) > Dynamically adjust max slow disks

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2023-06-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15368: --- Fix Version/s: 3.4.0 > TestBalancerWithHANameNodes#testBalancerWithObserver failed occasional

[jira] [Updated] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2023-06-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15383: --- Fix Version/s: 3.3.6 > RBF: Disable watch in ZKDelegationSecretManager for performance >

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2023-06-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15368: --- Fix Version/s: 3.3.6 (was: 3.4.0) > TestBalancerWithHANameNodes#testBa

[jira] [Updated] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2023-06-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15383: --- Fix Version/s: (was: 3.3.6) > RBF: Disable watch in ZKDelegationSecretManager for perform

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2023-06-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15368: --- Fix Version/s: (was: 3.3.6) > TestBalancerWithHANameNodes#testBalancerWithObserver failed

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-06-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Target Version/s: 3.3.9 (was: 3.3.6) > Potential data race introduced by HDFS-15865 > --

[jira] [Updated] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

2023-06-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16839: --- Component/s: ec erasure-coding > It should consider EC reconstruction work w

[jira] [Updated] (HDFS-17011) Fix the metric of "HttpPort" at DataNodeInfo

2023-06-07 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17011: --- Fix Version/s: 3.4.0 3.3.9 > Fix the metric of "HttpPort" at DataNodeInfo

[jira] [Updated] (HDFS-17003) Erasure coding: invalidate wrong block after reporting bad blocks from datanode

2023-06-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17003: --- Target Version/s: 3.3.6 > Erasure coding: invalidate wrong block after reporting bad blocks f

[jira] [Commented] (HDFS-17003) Erasure coding: invalidate wrong block after reporting bad blocks from datanode

2023-06-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729619#comment-17729619 ] Wei-Chiu Chuang commented on HDFS-17003: I've not reviewed the PR but I intend to

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-05-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Component/s: dfsclient > Potential data race introduced by HDFS-15865 > -

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-05-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Target Version/s: 3.3.6 > Potential data race introduced by HDFS-15865 >

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-05-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Affects Version/s: 3.3.1 > Potential data race introduced by HDFS-15865 > ---

[jira] [Assigned] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17024: -- Assignee: Wei-Chiu Chuang > Potential data race introduced by HDFS-15865 > ---

[jira] [Created] (HDFS-17024) Potential data race introduced by HDFS-15865

2023-05-23 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-17024: -- Summary: Potential data race introduced by HDFS-15865 Key: HDFS-17024 URL: https://issues.apache.org/jira/browse/HDFS-17024 Project: Hadoop HDFS Issue Ty

[jira] [Assigned] (HDFS-15865) Interrupt DataStreamer thread

2023-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15865: -- Assignee: Karthik Palanisamy > Interrupt DataStreamer thread > ---

[jira] [Commented] (HDFS-16985) delete local block file when FileNotFoundException occurred may lead to missing block.

2023-04-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713351#comment-17713351 ] Wei-Chiu Chuang commented on HDFS-16985: More details, please? > delete local bl

[jira] [Resolved] (HDFS-16947) RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store

2023-03-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16947. Resolution: Fixed > RBF NamenodeHeartbeatService to report error for not being able to regi

[jira] [Updated] (HDFS-16947) RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store

2023-03-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16947: --- Fix Version/s: 3.4.0 > RBF NamenodeHeartbeatService to report error for not being able to reg

[jira] [Commented] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2023-01-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679883#comment-17679883 ] Wei-Chiu Chuang commented on HDFS-15383: HADOOP-18519 backported HADOOP-17835 to

[jira] [Updated] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2023-01-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15383: --- Fix Version/s: 3.3.6 > RBF: Disable watch in ZKDelegationSecretManager for performance >

[jira] [Resolved] (HDFS-16873) FileStatus compareTo does not specify ordering

2022-12-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16873. Fix Version/s: 3.4.0 Resolution: Fixed > FileStatus compareTo does not specify order

[jira] [Assigned] (HDFS-16873) FileStatus compareTo does not specify ordering

2022-12-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16873: -- Assignee: DDillon > FileStatus compareTo does not specify ordering > -

[jira] [Resolved] (HDFS-16871) DiskBalancer process may throws IllegalArgumentException when the target DataNode has capital letter in hostname

2022-12-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16871. Fix Version/s: 3.4.0 Resolution: Fixed > DiskBalancer process may throws IllegalArgu

[jira] [Commented] (HDFS-16854) TestDFSIO to support non-default file system

2022-12-02 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17642641#comment-17642641 ] Wei-Chiu Chuang commented on HDFS-16854: [~liuml07] thanks for the tip. I still f

[jira] [Resolved] (HDFS-16854) TestDFSIO to support non-default file system

2022-12-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16854. Resolution: Duplicate > TestDFSIO to support non-default file system >

[jira] [Updated] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

2022-11-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16839: --- Fix Version/s: 3.3.9 > It should consider EC reconstruction work when we determine if a node

[jira] [Resolved] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

2022-11-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16839. Resolution: Fixed > It should consider EC reconstruction work when we determine if a node i

[jira] [Updated] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

2022-11-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16839: --- Fix Version/s: 3.4.0 > It should consider EC reconstruction work when we determine if a node

[jira] [Updated] (HDFS-16854) TestDFSIO to support non-default file system

2022-11-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16854: --- Description: TestDFSIO expects a parameter {{-Dtest.build.data=}} which is where the data is

[jira] [Updated] (HDFS-16854) TestDFSIO to support non-default file system

2022-11-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16854: --- Description: TestDFSIO expects a parameter {{-Dtest.build.data=}} which is where the data is

[jira] [Assigned] (HDFS-16854) TestDFSIO to support non-default file system

2022-11-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16854: -- Assignee: Wei-Chiu Chuang > TestDFSIO to support non-default file system > ---

[jira] [Created] (HDFS-16854) TestDFSIO to support non-default file system

2022-11-23 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16854: -- Summary: TestDFSIO to support non-default file system Key: HDFS-16854 URL: https://issues.apache.org/jira/browse/HDFS-16854 Project: Hadoop HDFS Issue Ty

[jira] [Resolved] (HDFS-9536) OOM errors during parallel upgrade to Block-ID based layout

2022-10-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-9536. --- Resolution: Duplicate I believe this is no longer an issue after HDFS-15937 and HDFS-15610. >

[jira] [Assigned] (HDFS-16815) Error occurred in processing CacheManagerSection for xml parsing fsimage

2022-10-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16815: -- Assignee: MeiJing > Error occurred in processing CacheManagerSection for xml parsing f

[jira] [Updated] (HDFS-16809) EC striped block is not sufficient when doing in maintenance

2022-10-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16809: --- Component/s: erasure-coding (was: hdfs) > EC striped block is not suffic

[jira] [Assigned] (HDFS-16809) EC striped block is not sufficient when doing in maintenance

2022-10-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16809: -- Assignee: dingshun > EC striped block is not sufficient when doing in maintenance > --

[jira] [Commented] (HDFS-16791) New API for enclosing root path for a file

2022-10-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615237#comment-17615237 ] Wei-Chiu Chuang commented on HDFS-16791: Should probably move this to HADOOP. But

[jira] [Assigned] (HDFS-16791) New API for enclosing root path for a file

2022-10-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16791: -- Assignee: Tom McCormick > New API for enclosing root path for a file > ---

[jira] [Assigned] (HDFS-16789) Update FileSystem class to read disk usage from actual usage value instead of file's length

2022-09-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16789: -- Assignee: Dave Teng > Update FileSystem class to read disk usage from actual usage val

[jira] [Resolved] (HDFS-4043) Namenode Kerberos Login does not use proper hostname for host qualified hdfs principal name.

2022-08-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-4043. --- Resolution: Fixed > Namenode Kerberos Login does not use proper hostname for host qualified hd

[jira] [Updated] (HDFS-16676) DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-08-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16676: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Updated] (HDFS-16730) Update the doc that append to EC files is supported

2022-08-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16730: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Commented] (HDFS-16730) Update the doc that append to EC files is supported

2022-08-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580442#comment-17580442 ] Wei-Chiu Chuang commented on HDFS-16730: Perfect. Thanks. > Update the doc that

[jira] [Created] (HDFS-16730) Update the doc that append to EC files is supported

2022-08-16 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16730: -- Summary: Update the doc that append to EC files is supported Key: HDFS-16730 URL: https://issues.apache.org/jira/browse/HDFS-16730 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2022-08-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580417#comment-17580417 ] Wei-Chiu Chuang commented on HDFS-6874: --- Feel free to take this over. > Add GETFILE

[jira] [Updated] (HDFS-16727) Consider reading chunk files using MappedByteBuffer

2022-08-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16727: --- Attachment: Screen Shot 2022-08-04 at 7.12.55 AM.png > Consider reading chunk files using Map

[jira] [Updated] (HDFS-16727) Consider reading chunk files using MappedByteBuffer

2022-08-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16727: --- Attachment: ozone_dn-rhel03.ozone.cisco.local.html > Consider reading chunk files using Mappe

[jira] [Created] (HDFS-16727) Consider reading chunk files using MappedByteBuffer

2022-08-10 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16727: -- Summary: Consider reading chunk files using MappedByteBuffer Key: HDFS-16727 URL: https://issues.apache.org/jira/browse/HDFS-16727 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2022-08-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578063#comment-17578063 ] Wei-Chiu Chuang commented on HDFS-2139: --- Sounds great! Some questions I have as I wa

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572211#comment-17572211 ] Wei-Chiu Chuang commented on HDFS-16645: Yeah... we don't have JNS in place so th

[jira] [Resolved] (HDFS-16619) Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import.

2022-07-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16619. Resolution: Fixed > Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import. > -

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572129#comment-17572129 ] Wei-Chiu Chuang commented on HDFS-16645: For the scenario that we observed, the o

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571592#comment-17571592 ] Wei-Chiu Chuang commented on HDFS-16645: I think instead of ignoring the older in

[jira] [Comment Edited] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571587#comment-17571587 ] Wei-Chiu Chuang edited comment on HDFS-16645 at 7/26/22 7:38 PM: --

[jira] [Comment Edited] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571587#comment-17571587 ] Wei-Chiu Chuang edited comment on HDFS-16645 at 7/26/22 7:38 PM: --

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571587#comment-17571587 ] Wei-Chiu Chuang commented on HDFS-16645: For the context: we started to notice th

[jira] [Commented] (HDFS-16675) DatanodeAdminManager.stopDecommission fails with ConcurrentModificationException

2022-07-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571193#comment-17571193 ] Wei-Chiu Chuang commented on HDFS-16675: [~sodonnell] Is this fixed by your HDFS-

[jira] [Updated] (HDFS-16533) COMPOSITE_CRC failed between replicated file and striped file due to invalid requested length

2022-07-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16533: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Updated] (HDFS-16533) COMPOSITE_CRC failed between replicated file and striped file due to invalid requested length

2022-07-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16533: --- Summary: COMPOSITE_CRC failed between replicated file and striped file due to invalid request

[jira] [Assigned] (HDFS-16566) Erasure Coding: Recovery may causes excess replicas when busy DN exsits

2022-07-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16566: -- Assignee: Ruinan Gu > Erasure Coding: Recovery may causes excess replicas when busy DN

[jira] [Updated] (HDFS-16566) Erasure Coding: Recovery may causes excess replicas when busy DN exsits

2022-07-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16566: --- Component/s: ec erasure-coding > Erasure Coding: Recovery may causes excess

[jira] [Updated] (HDFS-16566) Erasure Coding: Recovery may causes excess replicas when busy DN exsits

2022-07-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16566: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Commented] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-07-11 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565256#comment-17565256 ] Wei-Chiu Chuang commented on HDFS-16565: For future reference, i highly recommend

[jira] [Updated] (HDFS-16642) [SBN read] Moving selecting inputstream from JN in EditlogTailer out of FSNLock

2022-06-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16642: --- Summary: [SBN read] Moving selecting inputstream from JN in EditlogTailer out of FSNLock (wa

[jira] [Updated] (HDFS-16613) EC: Improve performance of decommissioning dn with many ec blocks

2022-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16613: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Moved] (HDFS-16632) java.io.IOException: Version Mismatch (Expected: 28, Received: 520 )

2022-06-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang moved HADOOP-18204 to HDFS-16632: - Component/s: hdfs++ native

[jira] [Updated] (HDFS-16595) Slow peer metrics - add median, mad and upper latency limits

2022-06-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16595: --- Fix Version/s: 3.3.4 > Slow peer metrics - add median, mad and upper latency limits > ---

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-06-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16456: --- Fix Version/s: 3.2.4 > EC: Decommission a rack with only on dn will fail when the rack number

[jira] [Resolved] (HDFS-16595) Slow peer metrics - add median, mad and upper latency limits

2022-06-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16595. Fix Version/s: 3.4.0 Resolution: Fixed > Slow peer metrics - add median, mad and upp

[jira] [Resolved] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2022-05-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16583. Resolution: Fixed > DatanodeAdminDefaultMonitor can get stuck in an infinite loop > ---

[jira] [Updated] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2022-05-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16583: --- Fix Version/s: 3.2.4 > DatanodeAdminDefaultMonitor can get stuck in an infinite loop > --

[jira] [Resolved] (HDFS-16603) Improve DatanodeHttpServer With Netty recommended method

2022-05-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16603. Resolution: Fixed > Improve DatanodeHttpServer With Netty recommended method >

[jira] [Resolved] (HDFS-16585) Add @VisibleForTesting in Dispatcher.java after HDFS-16268

2022-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16585. Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution: Fi

[jira] [Commented] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2022-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542619#comment-17542619 ] Wei-Chiu Chuang commented on HDFS-16583: PR was merged in trunk and cherrypicked

[jira] [Updated] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2022-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16583: --- Fix Version/s: 3.3.4 > DatanodeAdminDefaultMonitor can get stuck in an infinite loop > --

[jira] [Updated] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2022-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16583: --- Fix Version/s: 3.4.0 > DatanodeAdminDefaultMonitor can get stuck in an infinite loop > --

[jira] [Resolved] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2022-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16583. Resolution: Fixed > DatanodeAdminDefaultMonitor can get stuck in an infinite loop > ---

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16456: --- Fix Version/s: 3.3.4 > EC: Decommission a rack with only on dn will fail when the rack number

[jira] [Commented] (HDFS-16594) Many RpcCalls are blocked for a while while Decommission works

2022-05-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542319#comment-17542319 ] Wei-Chiu Chuang commented on HDFS-16594: Stephen's very experience in this area o

[jira] [Created] (HDFS-16585) Add @VisibleForTesting in Dispatcher.java after HDFS-16268

2022-05-20 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16585: -- Summary: Add @VisibleForTesting in Dispatcher.java after HDFS-16268 Key: HDFS-16585 URL: https://issues.apache.org/jira/browse/HDFS-16585 Project: Hadoop HDFS

  1   2   3   4   5   6   7   8   9   10   >