[jira] [Updated] (HDFS-14529) SetTimes to throw FileNotFoundException if inode is not found

2021-07-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14529: --- Summary: SetTimes to throw FileNotFoundException if inode is not found (was: NPE while

[jira] [Resolved] (HDFS-15936) Solve BlockSender#sendPacket() does not record SocketTimeout exception

2021-07-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15936. Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Thanks! > Solve

[jira] [Assigned] (HDFS-16129) HttpFS signature secret file misusage

2021-07-28 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16129: -- Assignee: Tamas Domok > HttpFS signature secret file misusage >

[jira] [Resolved] (HDFS-16137) Improve the comments related to FairCallQueue#queues

2021-07-28 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16137. Fix Version/s: 3.4.0 Resolution: Fixed > Improve the comments related to

[jira] [Commented] (HDFS-14529) NPE while Loading the Editlogs

2021-07-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17388406#comment-17388406 ] Wei-Chiu Chuang commented on HDFS-14529: i posted a PR #3243 let me know how you think. The PR

[jira] [Resolved] (HDFS-16111) Add a configuration to RoundRobinVolumeChoosingPolicy to avoid failed volumes at datanodes.

2021-07-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16111. Fix Version/s: 3.4.0 Resolution: Fixed Thanks! > Add a configuration to

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

2021-07-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16144: --- Target Version/s: 3.4.0, 3.3.2 (was: 3.4.0) > Revert HDFS-15372 (Files in snapshots no

[jira] [Updated] (HDFS-16136) Handle all occurrence of InvalidEncryptionKeyException

2021-07-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16136: --- Description: After HDFS-10609, HDFS-11741, we still observed InvalidEncryptionKeyException

[jira] [Created] (HDFS-16136) Handle all occurrence of InvalidEncryptionKeyException

2021-07-22 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16136: -- Summary: Handle all occurrence of InvalidEncryptionKeyException Key: HDFS-16136 URL: https://issues.apache.org/jira/browse/HDFS-16136 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-15650) Make the socket timeout for computing checksum of striped blocks configurable

2021-07-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15650. Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution:

[jira] [Assigned] (HDFS-15650) Make the socket timeout for computing checksum of striped blocks configurable

2021-07-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15650: -- Assignee: Yushi Hayasaka > Make the socket timeout for computing checksum of striped

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2021-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379531#comment-17379531 ] Wei-Chiu Chuang commented on HDFS-14703: Added a version "Fine-Grained Locking". Please use it

[jira] [Updated] (HDFS-16125) fix the iterator for PartitionedGSet

2021-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16125: --- Target Version/s: Fine-Grained Locking > fix the iterator for PartitionedGSet >

[jira] [Updated] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2021-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14703: --- Target Version/s: Fine-Grained Locking > NameNode Fine-Grained Locking via Metadata

[jira] [Commented] (HDFS-16125) fix the iterator for PartitionedGSet

2021-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379528#comment-17379528 ] Wei-Chiu Chuang commented on HDFS-16125: Thx for the contribution. I added you as a contributor

[jira] [Assigned] (HDFS-16125) fix the iterator for PartitionedGSet

2021-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16125: -- Assignee: Xing Lin > fix the iterator for PartitionedGSet >

[jira] [Resolved] (HDFS-16110) Remove unused method reportChecksumFailure in DFSClient

2021-07-05 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16110. Fix Version/s: 3.4.0 Resolution: Fixed Thanks [~tomscut] and [~tasanuma] for the

[jira] [Commented] (HDFS-14529) NPE while Loading the Editlogs

2021-07-02 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373709#comment-17373709 ] Wei-Chiu Chuang commented on HDFS-14529: Another possibility to hit this error (without

[jira] [Commented] (HDFS-14529) NPE while Loading the Editlogs

2021-07-02 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373706#comment-17373706 ] Wei-Chiu Chuang commented on HDFS-14529: We encountered this bug again, and it is reproducible

[jira] [Resolved] (HDFS-11528) NameNode load EditRecords throws NPE

2021-07-02 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11528. Resolution: Duplicate I'll resolve this one and use HDFS-14529 for further discussion. >

[jira] [Commented] (HDFS-15650) Make the socket timeout for computing checksum of striped blocks configurable

2021-07-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372509#comment-17372509 ] Wei-Chiu Chuang commented on HDFS-15650: Ok  I honestly don't remember what held me back but I

[jira] [Resolved] (HDFS-16086) Add volume information to datanode log for tracing

2021-06-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16086. Fix Version/s: 3.4.0 Resolution: Fixed > Add volume information to datanode log for

[jira] [Resolved] (HDFS-16096) Delete useless method DirectoryWithQuotaFeature#setQuota

2021-06-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16096. Resolution: Fixed Merged the PR. Thanks [~zhuxiangyi] and [~vjasani] for the review. >

[jira] [Resolved] (HDFS-16089) EC: Add metric EcReconstructionValidateTimeMillis for StripedBlockReconstructor

2021-06-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16089. Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > EC: Add metric

[jira] [Updated] (HDFS-16092) Avoid creating LayoutFlags redundant objects

2021-06-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16092: --- Fix Version/s: 3.2.3 > Avoid creating LayoutFlags redundant objects >

[jira] [Updated] (HDFS-16092) Avoid creating LayoutFlags redundant objects

2021-06-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16092: --- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Status:

[jira] [Commented] (HDFS-16095) Add lsQuotaList command and getQuotaListing api for hdfs quota

2021-06-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371193#comment-17371193 ] Wei-Chiu Chuang commented on HDFS-16095: Thanks for opening the jira. Added you as the jira

[jira] [Assigned] (HDFS-16096) Delete useless method DirectoryWithQuotaFeature#setQuota

2021-06-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16096: -- Assignee: Xiangyi Zhu > Delete useless method DirectoryWithQuotaFeature#setQuota >

[jira] [Assigned] (HDFS-16095) Add lsQuotaList command and getQuotaListing api for hdfs quota

2021-06-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16095: -- Assignee: Xiangyi Zhu > Add lsQuotaList command and getQuotaListing api for hdfs

[jira] [Commented] (HDFS-14099) Unknown frame descriptor when decompressing multiple frames in ZStandardDecompressor

2021-06-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368103#comment-17368103 ] Wei-Chiu Chuang commented on HDFS-14099: It might have been fixed by HADOOP-17096. can you apply

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff to support WebHDFS

2021-06-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367960#comment-17367960 ] Wei-Chiu Chuang commented on HDFS-13916: Looks fine to me. I'm still hold the same opinion that

[jira] [Updated] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16082: --- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Status:

[jira] [Resolved] (HDFS-16074) Remove an expensive debug string concatenation

2021-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16074. Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution:

[jira] [Commented] (HDFS-16074) Remove an expensive debug string concatenation

2021-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364643#comment-17364643 ] Wei-Chiu Chuang commented on HDFS-16074: !Screen Shot 2021-06-17 at 10.32.21 AM.png!

[jira] [Updated] (HDFS-16074) Remove an expensive debug string concatenation

2021-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16074: --- Attachment: Screen Shot 2021-06-17 at 10.32.21 AM.png > Remove an expensive debug string

[jira] [Work started] (HDFS-16074) Remove an expensive debug string concatenation

2021-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16074 started by Wei-Chiu Chuang. -- > Remove an expensive debug string concatenation >

[jira] [Commented] (HDFS-16074) Remove an expensive debug string concatenation

2021-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364091#comment-17364091 ] Wei-Chiu Chuang commented on HDFS-16074: Looks like a regression since Hadoop 3.0.0 when we

[jira] [Updated] (HDFS-16074) Remove an expensive debug string concatenation

2021-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16074: --- Affects Version/s: (was: 3.4.0) 3.0.0-alpha1 > Remove an

[jira] [Updated] (HDFS-16074) Remove an expensive debug string concatenation

2021-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16074: --- Description: Running a YCSB load query, found that we do an expensive string concatenation

[jira] [Created] (HDFS-16074) Remove an expensive debug string concatenation

2021-06-16 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16074: -- Summary: Remove an expensive debug string concatenation Key: HDFS-16074 URL: https://issues.apache.org/jira/browse/HDFS-16074 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-16074) Remove an expensive debug string concatenation

2021-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16074: -- Assignee: Wei-Chiu Chuang > Remove an expensive debug string concatenation >

[jira] [Updated] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

2021-06-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15916: --- Fix Version/s: 3.3.2 > DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop

[jira] [Commented] (HDFS-16057) Make sure the order for location in ENTERING_MAINTENANCE state

2021-06-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359697#comment-17359697 ] Wei-Chiu Chuang commented on HDFS-16057: compactor --> comparator > Make sure the order for

[jira] [Updated] (HDFS-15814) Make some parameters configurable for DataNodeDiskMetrics

2021-06-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15814: --- Fix Version/s: 3.3.2 > Make some parameters configurable for DataNodeDiskMetrics >

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-02 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355595#comment-17355595 ] Wei-Chiu Chuang commented on HDFS-16044: thanks for the report, I haven't noticed this regression

[jira] [Updated] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

2021-05-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15982: --- Target Version/s: 3.4.0, 3.3.2 (was: 3.3.1, 3.4.0) > Deleted data using HTTP API should be

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2021-05-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14694: --- Target Version/s: 3.3.2 > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-15684) EC: Call recoverLease on DFSStripedOutputStream close exception

2021-05-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15684: --- Target Version/s: 3.3.2 > EC: Call recoverLease on DFSStripedOutputStream close exception >

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

2021-05-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15359: --- Target Version/s: 3.3.2 > EC: Allow closing a file with committed blocks >

[jira] [Updated] (HDFS-15850) Superuser actions should be reported to external enforcers

2021-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15850: --- Target Version/s: 3.3.2 (was: 3.3.1) > Superuser actions should be reported to external

[jira] [Commented] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

2021-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351641#comment-17351641 ] Wei-Chiu Chuang commented on HDFS-15916: Branch-3.3 backport PR #3054

[jira] [Moved] (HDFS-16036) Datanode client is stuck, waiting for connections map to be empty

2021-05-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang moved HADOOP-17729 to HDFS-16036: - Key: HDFS-16036 (was: HADOOP-17729) Affects

[jira] [Resolved] (HDFS-15790) Make ProtobufRpcEngineProtos and ProtobufRpcEngineProtos2 Co-Exist

2021-05-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15790. Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed > Make

[jira] [Updated] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

2021-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15545: --- Target Version/s: 3.3.2 > (S)Webhdfs will not use updated delegation tokens available in the

[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

2021-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15660: --- Fix Version/s: 3.3.1 > StorageTypeProto is not compatiable between 3.x and 2.6 >

[jira] [Commented] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

2021-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350215#comment-17350215 ] Wei-Chiu Chuang commented on HDFS-15660: I'm going to cherrypick this commit to 3.3.1. We still

[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

2021-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15660: --- Target Version/s: 2.10.2, 3.3.2, 2.9.3 (was: 2.9.3, 2.10.2) > StorageTypeProto is not

[jira] [Updated] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2021-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15344: --- Target Version/s: 3.3.2 > DataNode#checkSuperuserPrivilege should use UGI#getGroups after

[jira] [Updated] (HDFS-15345) RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2021-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15345: --- Target Version/s: 3.3.2 > RBF: RouterPermissionChecker#checkSuperuserPrivilege should use

[jira] [Updated] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

2021-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15916: --- Target Version/s: 3.1.4, 3.4.0, 3.2.3, 3.3.2 (was: 3.1.4, 3.3.1, 3.4.0, 3.2.3) > DistCp:

[jira] [Updated] (HDFS-15942) Increase Quota initialization threads

2021-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15942: --- Release Note: The default quota initialization thread count during the NameNode startup

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2021-05-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13183: --- Release Note: Enable balancer to redirect getBlocks request to a Standby Namenode, thus

[jira] [Resolved] (HDFS-16027) HDFS-15245 breaks source code compatibility between 3.3.0 and 3.3.1.

2021-05-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16027. Fix Version/s: 3.3.1 Resolution: Fixed Thanks [~ayushtkn]! > HDFS-15245 breaks

[jira] [Commented] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-05-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346514#comment-17346514 ] Wei-Chiu Chuang commented on HDFS-15975: I am okay to resolve it by adding a release note. We

[jira] [Commented] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-05-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346059#comment-17346059 ] Wei-Chiu Chuang commented on HDFS-15975: Note: DFSHedgedReadMetrics is a Private scope class.

[jira] [Updated] (HDFS-15719) [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

2021-05-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15719: --- Hadoop Flags: Incompatible change Release Note: The default value of the configuration

[jira] [Comment Edited] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-05-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346042#comment-17346042 ] Wei-Chiu Chuang edited comment on HDFS-15975 at 5/17/21, 10:06 AM: ---

[jira] [Commented] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-05-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346042#comment-17346042 ] Wei-Chiu Chuang commented on HDFS-15975: Fortunately HBase accesses the hedged read metrics

[jira] [Comment Edited] (HDFS-16027) HDFS-15245 breaks source code compatibility between 3.3.0 and 3.3.1.

2021-05-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346031#comment-17346031 ] Wei-Chiu Chuang edited comment on HDFS-16027 at 5/17/21, 9:56 AM: --

[jira] [Commented] (HDFS-16027) HDFS-15245 breaks source code compatibility between 3.3.0 and 3.3.1.

2021-05-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346031#comment-17346031 ] Wei-Chiu Chuang commented on HDFS-16027: [~ayushsaxena] how do you think about using default

[jira] [Updated] (HDFS-16027) HDFS-15245 breaks source code compatibility between 3.3.0 and 3.3.1.

2021-05-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16027: --- Description: Ok, this one is on me. JournalNodeMXBean is a Public, Evolving interface. But

[jira] [Created] (HDFS-16027) HDFS-15245 breaks source code compatibility between 3.3.0 and 3.3.1.

2021-05-17 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-16027: -- Summary: HDFS-15245 breaks source code compatibility between 3.3.0 and 3.3.1. Key: HDFS-16027 URL: https://issues.apache.org/jira/browse/HDFS-16027 Project:

[jira] [Updated] (HDFS-15873) Add namenode address in logs for block report

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15873: --- Fix Version/s: 3.2.3 3.1.5 3.3.1 > Add namenode

[jira] [Commented] (HDFS-15873) Add namenode address in logs for block report

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17345871#comment-17345871 ] Wei-Chiu Chuang commented on HDFS-15873: Cherrypicked the commit to branch-3.3 ~ branch-3.1. >

[jira] [Updated] (HDFS-15873) Add namenode address in logs for block report

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15873: --- Fix Version/s: (was: 3.3.1) 3.4.0 > Add namenode address in logs for

[jira] [Commented] (HDFS-15814) Make some parameters configurable for DataNodeDiskMetrics

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17345869#comment-17345869 ] Wei-Chiu Chuang commented on HDFS-15814: Looking at git log history, it was fixed in trunk

[jira] [Updated] (HDFS-15814) Make some parameters configurable for DataNodeDiskMetrics

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15814: --- Fix Version/s: (was: 3.3.1) 3.4.0 > Make some parameters configurable

[jira] [Updated] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15148: --- Fix Version/s: (was: 3.3.1) 3.3.0 > dfs.namenode.send.qop.enabled

[jira] [Updated] (HDFS-15146) TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15146: --- Fix Version/s: (was: 3.3.1) 3.3.0 >

[jira] [Updated] (HDFS-15464) ViewFsOverloadScheme should work when -fs option pointing to remote cluster without mount links

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15464: --- Fix Version/s: (was: 3.2.2) 3.3.1 > ViewFsOverloadScheme should work

[jira] [Updated] (HDFS-15632) AbstractContractDeleteTest should set recursive parameter to true for recursive test cases.

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15632: --- Fix Version/s: 3.3.1 > AbstractContractDeleteTest should set recursive parameter to true for

[jira] [Updated] (HDFS-15430) create should work when parent dir is internalDir and fallback configured.

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15430: --- Fix Version/s: 3.3.1 > create should work when parent dir is internalDir and fallback

[jira] [Updated] (HDFS-15449) Optionally ignore port number in mount-table name when picking from initialized uri

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15449: --- Fix Version/s: 3.3.1 > Optionally ignore port number in mount-table name when picking from

[jira] [Updated] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15633: --- Fix Version/s: 3.2.3 3.3.1 > Avoid redundant RPC calls for getDiskStatus

[jira] [Resolved] (HDFS-13934) Multipart uploaders to be created through API call to FileSystem/FileContext, not service loader

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-13934. Resolution: Fixed > Multipart uploaders to be created through API call to

[jira] [Commented] (HDFS-13934) Multipart uploaders to be created through API call to FileSystem/FileContext, not service loader

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17345815#comment-17345815 ] Wei-Chiu Chuang commented on HDFS-13934: HDFS-15471 is resolved. Are we all good here? >

[jira] [Updated] (HDFS-15649) the standby namenode's ReplQueues need to keep pace with active namenode.

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15649: --- Fix Version/s: (was: 3.3.1) > the standby namenode's ReplQueues need to keep pace with

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff to support WebHDFS

2021-05-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13916: --- Target Version/s: 3.4.0, 3.3.2 (was: 3.3.1, 3.4.0) > Distcp SnapshotDiff to support WebHDFS

[jira] [Updated] (HDFS-15505) Fix NullPointerException when call getAdditionalDatanode method with null extendedBlock parameter

2021-05-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15505: --- Target Version/s: 3.4.0, 3.3.2 (was: 3.3.1, 3.4.0) > Fix NullPointerException when call

[jira] [Updated] (HDFS-15715) ReplicatorMonitor performance degrades, when the storagePolicy of many file are not match with their real datanodestorage

2021-05-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15715: --- Target Version/s: 3.3.2 (was: 3.3.1) > ReplicatorMonitor performance degrades, when the

[jira] [Updated] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

2021-05-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15289: --- Target Version/s: 3.4.0, 3.1.5, 3.2.3, 3.3.2 (was: 3.3.1, 3.4.0, 3.1.5, 3.2.3) > Allow

[jira] [Updated] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2021-05-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12920: --- Target Version/s: 3.0.2, 3.4.0, 3.1.5, 3.2.3, 3.3.2 (was: 3.0.2, 3.3.1, 3.4.0, 3.1.5,

[jira] [Updated] (HDFS-15790) Make ProtobufRpcEngineProtos and ProtobufRpcEngineProtos2 Co-Exist

2021-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15790: --- Labels: pull-request-available release-blocker (was: pull-request-available) > Make

[jira] [Commented] (HDFS-15245) Improve JournalNode web UI

2021-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343696#comment-17343696 ] Wei-Chiu Chuang commented on HDFS-15245: Pushed to branch-3.3 with trivial import conflict. >

[jira] [Updated] (HDFS-15245) Improve JournalNode web UI

2021-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15245: --- Fix Version/s: 3.3.1 > Improve JournalNode web UI > -- > >

[jira] [Updated] (HDFS-15965) Please upgrade the log4j dependency to log4j2

2021-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15965: --- Target Version/s: 3.4.0, 3.3.2 (was: 3.3.1, 3.4.0) > Please upgrade the log4j dependency to

[jira] [Updated] (HDFS-15964) Please update the okhttp version to 4.9.1

2021-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15964: --- Target Version/s: 3.4.0, 3.3.2 (was: 3.3.1, 3.4.0) > Please update the okhttp version to

[jira] [Commented] (HDFS-16019) HDFS: Inode CheckPoint

2021-05-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17341836#comment-17341836 ] Wei-Chiu Chuang commented on HDFS-16019: Sounds very similar to what NameNode Analytics provides?

[jira] [Updated] (HDFS-16001) TestOfflineEditsViewer.testStored() fails reading negative value of FSEditLogOpCodes

2021-05-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16001: --- Priority: Blocker (was: Major) > TestOfflineEditsViewer.testStored() fails reading negative

[jira] [Resolved] (HDFS-15995) Rework HDFS-15624 Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2021-05-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15995. Fix Version/s: 3.4.0 Resolution: Done > Rework HDFS-15624 Fix the

<    1   2   3   4   5   6   7   8   9   10   >