[jira] [Resolved] (HDFS-13639) SlotReleaser is not fast enough

[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-13639. Fix Version/s: 3.4.0 Resolution: Fixed > SlotReleaser is not fast enough >

[jira] [Commented] (HDFS-15366) Active NameNode went down with NPE

[ https://issues.apache.org/jira/browse/HDFS-15366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112422#comment-17112422 ] Wei-Chiu Chuang commented on HDFS-15366: To add more color, I did dig out this old stacktrace in

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111641#comment-17111641 ] Wei-Chiu Chuang commented on HDFS-15221: Kicking off a rebuild:

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111628#comment-17111628 ] Wei-Chiu Chuang commented on HDFS-13183: Thanks Jim [~hexiaoqiao] how do you think? I can revert

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111459#comment-17111459 ] Wei-Chiu Chuang commented on HDFS-15280: This is basically creating a random backoff mechanism

[jira] [Commented] (HDFS-15259) Reduce useless log information in FSNamesystemAuditLogger

[ https://issues.apache.org/jira/browse/HDFS-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111453#comment-17111453 ] Wei-Chiu Chuang commented on HDFS-15259: Are we in agreement this is a won't fix? > Reduce

[jira] [Updated] (HDFS-14627) Improvements to make slow archive storage works on HDFS

[ https://issues.apache.org/jira/browse/HDFS-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14627: --- Issue Type: New Feature (was: Improvement) > Improvements to make slow archive storage

[jira] [Commented] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111359#comment-17111359 ] Wei-Chiu Chuang commented on HDFS-15315: We did not certify HBase on EC at Cloudera so I don't

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111352#comment-17111352 ] Wei-Chiu Chuang commented on HDFS-15359: What does the test check? Looks to me the added test

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110487#comment-17110487 ] Wei-Chiu Chuang commented on HDFS-15359: Not familiar with this configuration but I suppose

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110460#comment-17110460 ] Wei-Chiu Chuang commented on HDFS-13183: Done. Pushed both to branch-3.3. Thanks! > Standby

[jira] [Updated] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15356: --- Fix Version/s: 3.3.1 > Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys >

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13183: --- Fix Version/s: 3.3.1 > Standby NameNode process getBlocks request to reduce Active load >

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110448#comment-17110448 ] Wei-Chiu Chuang commented on HDFS-15202: Reverted the breaking commit, and squashed the original

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13183: --- Fix Version/s: (was: 3.3.1) > Standby NameNode process getBlocks request to reduce

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110442#comment-17110442 ] Wei-Chiu Chuang commented on HDFS-13183: Just realized the code doesn't compile in branch-3.3 so

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110428#comment-17110428 ] Wei-Chiu Chuang commented on HDFS-15202: Thanks. Working on that. Given me a few minutes. >

[jira] [Updated] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15207: --- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Status:

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13183: --- Resolution: Fixed Status: Resolved (was: Patch Available) Merged the patch to trunk

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13183: --- Fix Version/s: 3.4.0 > Standby NameNode process getBlocks request to reduce Active load >

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13183: --- Fix Version/s: 3.3.1 > Standby NameNode process getBlocks request to reduce Active load >

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13183: --- Issue Type: New Feature (was: Improvement) > Standby NameNode process getBlocks request to

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110317#comment-17110317 ] Wei-Chiu Chuang commented on HDFS-15202: Merged the PR to trunk, and cherrypicked to branch-3.3.

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15202: --- Fix Version/s: 3.3.1 > HDFS-client: boost ShortCircuit Cache >

[jira] [Resolved] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15202. Fix Version/s: 3.4.0 Resolution: Fixed > HDFS-client: boost ShortCircuit Cache >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110306#comment-17110306 ] Wei-Chiu Chuang commented on HDFS-13183: +1 bq. BTW, I am not sure why configuration key

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15359: --- Component/s: erasure-coding > EC: Allow closing a file with committed blocks >

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108864#comment-17108864 ] Wei-Chiu Chuang commented on HDFS-15207: +1 pending Jenkins. > VolumeScanner skip to scan blocks

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108852#comment-17108852 ] Wei-Chiu Chuang commented on HDFS-15207: Would you mind to add to the hdfs-default.xml that this

[jira] [Comment Edited] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108852#comment-17108852 ] Wei-Chiu Chuang edited comment on HDFS-15207 at 5/16/20, 4:40 AM: --

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108790#comment-17108790 ] Wei-Chiu Chuang commented on HDFS-15207: It just occurred to me that certain vendors (e.g.

[jira] [Commented] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108486#comment-17108486 ] Wei-Chiu Chuang commented on HDFS-14999: Looks similar to HADOOP-15317 > Avoid Potential

[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108453#comment-17108453 ] Wei-Chiu Chuang commented on HDFS-13639: It would be really great if you can explain the charts,

[jira] [Commented] (HDFS-15270) Account for *env == NULL in hdfsThreadDestructor

[ https://issues.apache.org/jira/browse/HDFS-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104897#comment-17104897 ] Wei-Chiu Chuang commented on HDFS-15270: Thanks for the reminder. It's cherrypicked to branch-3.3

[jira] [Updated] (HDFS-15270) Account for *env == NULL in hdfsThreadDestructor

[ https://issues.apache.org/jira/browse/HDFS-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15270: --- Fix Version/s: 3.1.5 3.3.1 3.2.2 > Account for *env ==

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104641#comment-17104641 ] Wei-Chiu Chuang commented on HDFS-15098: [~Andrea_Julianos_one] can you check the error message

[jira] [Commented] (HDFS-15350) Set dfs.client.failover.random.order to true as default

[ https://issues.apache.org/jira/browse/HDFS-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104638#comment-17104638 ] Wei-Chiu Chuang commented on HDFS-15350: What would this mean when you have multiple standby

[jira] [Commented] (HDFS-15087) RBF: Balance/Rename across federation namespaces

[ https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101704#comment-17101704 ] Wei-Chiu Chuang commented on HDFS-15087: Great work here. Sorry I didn't realize. Mind if I make

[jira] [Updated] (HDFS-15087) RBF: Balance/Rename across federation namespaces

[ https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15087: --- Issue Type: New Feature (was: Improvement) > RBF: Balance/Rename across federation

[jira] [Commented] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101109#comment-17101109 ] Wei-Chiu Chuang commented on HDFS-14999: [~zgw] i saw you posted a patch. Is that the fix for

[jira] [Resolved] (HDFS-15334) INodeAttributeProvider's new API checkPermissionWithContext not getting called in for authorization

[ https://issues.apache.org/jira/browse/HDFS-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15334. Fix Version/s: 3.3.0 Resolution: Fixed PR is merged. Cherrypicked to branch-3.3 and

[jira] [Assigned] (HDFS-15334) INodeAttributeProvider's new API checkPermissionWithContext not getting called in for authorization

[ https://issues.apache.org/jira/browse/HDFS-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15334: -- Assignee: Wei-Chiu Chuang > INodeAttributeProvider's new API

[jira] [Commented] (HDFS-15334) INodeAttributeProvider's new API checkPermissionWithContext not getting called in for authorization

[ https://issues.apache.org/jira/browse/HDFS-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099902#comment-17099902 ] Wei-Chiu Chuang commented on HDFS-15334: PR: https://github.com/apache/hadoop/pull/1998 >

[jira] [Created] (HDFS-15334) INodeAttributeProvider's new API checkPermissionWithContext not getting called in for authorization

Wei-Chiu Chuang created HDFS-15334: -- Summary: INodeAttributeProvider's new API checkPermissionWithContext not getting called in for authorization Key: HDFS-15334 URL:

[jira] [Commented] (HDFS-15333) Vulnerability fixes need for jackson-databing on "HTrace"

[ https://issues.apache.org/jira/browse/HDFS-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099824#comment-17099824 ] Wei-Chiu Chuang commented on HDFS-15333: We should just remove htrace from dependency. >

[jira] [Commented] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099476#comment-17099476 ] Wei-Chiu Chuang commented on HDFS-15273: Thanks for reporting the issue! Do you have any estimate

[jira] [Updated] (HDFS-15272) Backport HDFS-12862 to branch-3.1

[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15272: --- Fix Version/s: 3.1.5 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-14599) HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty

[ https://issues.apache.org/jira/browse/HDFS-14599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099463#comment-17099463 ] Wei-Chiu Chuang commented on HDFS-14599: Sorry I missed this one. Just cherrypicked the change to

[jira] [Updated] (HDFS-14599) HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty

[ https://issues.apache.org/jira/browse/HDFS-14599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14599: --- Fix Version/s: 3.1.5 3.2.2 > HDFS-12487 breaks test >

[jira] [Commented] (HDFS-15272) Backport HDFS-12862 to branch-3.1

[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099448#comment-17099448 ] Wei-Chiu Chuang commented on HDFS-15272: +1 I'm sorry I missed this one. > Backport HDFS-12862

[jira] [Updated] (HDFS-15272) Backport HDFS-12862 to branch-3.1

[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15272: --- Fix Version/s: (was: 3.1.5) > Backport HDFS-12862 to branch-3.1 >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099434#comment-17099434 ] Wei-Chiu Chuang commented on HDFS-13183: I am really sorry I meant to review but got distracted.

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099342#comment-17099342 ] Wei-Chiu Chuang commented on HDFS-15160: [~zhuqi] did you try the latest patch and how did it go?

[jira] [Commented] (HDFS-15311) [SBN Read] High frequency reQueue cause Reader's performance to degrade

[ https://issues.apache.org/jira/browse/HDFS-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099321#comment-17099321 ] Wei-Chiu Chuang commented on HDFS-15311: [~cliang] [~xkrogen] [~shv] thoughts? > [SBN Read] High

[jira] [Resolved] (HDFS-15270) Account for *env == NULL in hdfsThreadDestructor

[ https://issues.apache.org/jira/browse/HDFS-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15270. Fix Version/s: 3.4.0 Resolution: Fixed Thanks [~babsingh] this is in the trunk. Do

[jira] [Updated] (HDFS-13571) Deadnode detection

[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13571: --- Issue Type: New Feature (was: Improvement) > Deadnode detection > -- > >

[jira] [Commented] (HDFS-13571) Deadnode detection

[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097471#comment-17097471 ] Wei-Chiu Chuang commented on HDFS-13571: This looks like a new feature rather than an

[jira] [Created] (HDFS-15317) Fix libhdfspp warnings

Wei-Chiu Chuang created HDFS-15317: -- Summary: Fix libhdfspp warnings Key: HDFS-15317 URL: https://issues.apache.org/jira/browse/HDFS-15317 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-14950) missing libhdfspp libs in dist-package

[ https://issues.apache.org/jira/browse/HDFS-14950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14950: --- Component/s: libhdfs++ > missing libhdfspp libs in dist-package >

[jira] [Assigned] (HDFS-15270) Account for *env == NULL in hdfsThreadDestructor

[ https://issues.apache.org/jira/browse/HDFS-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15270: -- Assignee: Babneet Singh > Account for *env == NULL in hdfsThreadDestructor >

[jira] [Updated] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15315: --- Component/s: ec > IOException on close() when using Erasure Coding >

[jira] [Commented] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096852#comment-17096852 ] Wei-Chiu Chuang commented on HDFS-15315: Thanks   At Cloudera we did not test EC with Solr so

[jira] [Commented] (HDFS-15314) Add concat fs command

[ https://issues.apache.org/jira/browse/HDFS-15314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096683#comment-17096683 ] Wei-Chiu Chuang commented on HDFS-15314: You can go More -> Move to move the jira to a different

[jira] [Commented] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096644#comment-17096644 ] Wei-Chiu Chuang commented on HDFS-15315: Is it reproducible always? Was decommission in progress?

[jira] [Updated] (HDFS-15303) Provide a tool that can validate/fix the block file placement in DataNode data directories

[ https://issues.apache.org/jira/browse/HDFS-15303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15303: --- Issue Type: New Feature (was: Improvement) > Provide a tool that can validate/fix the block

[jira] [Updated] (HDFS-13487) Backport HDFS-11915 to branch-2.8, branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-13487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13487: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) 2.8 and 2.7 are EOL.

[jira] [Updated] (HDFS-15301) statfs function in hdfs-fuse is not working

[ https://issues.apache.org/jira/browse/HDFS-15301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15301: --- Component/s: libhdfs > statfs function in hdfs-fuse is not working >

[jira] [Updated] (HDFS-15295) AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance.

[ https://issues.apache.org/jira/browse/HDFS-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15295: --- Fix Version/s: 3.4.0 3.3.1 3.2.2

[jira] [Updated] (HDFS-15287) HDFS rollingupgrade prepare never finishes

[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15287: --- Target Version/s: 3.3.0, 2.10.1 (was: 2.10.1) > HDFS rollingupgrade prepare never finishes

[jira] [Updated] (HDFS-15293) Relax FSImage upload time delta check restriction

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15293: --- Labels: multi-sbnn (was: ) > Relax FSImage upload time delta check restriction >

[jira] [Commented] (HDFS-15295) AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance.

[ https://issues.apache.org/jira/browse/HDFS-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089901#comment-17089901 ] Wei-Chiu Chuang commented on HDFS-15295: [~sodonnell] [~ayushsaxena] fyi >From a quick look the

[jira] [Updated] (HDFS-13101) Yet another fsimage corruption related to snapshot

[ https://issues.apache.org/jira/browse/HDFS-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13101: --- Release Note: Fix a corner case in deleting HDFS snapshots. A regression was later found

[jira] [Updated] (HDFS-13101) Yet another fsimage corruption related to snapshot

[ https://issues.apache.org/jira/browse/HDFS-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13101: --- Priority: Critical (was: Major) > Yet another fsimage corruption related to snapshot >

[jira] [Updated] (HDFS-14004) TestLeaseRecovery2#testCloseWhileRecoverLease fails intermittently in trunk

[ https://issues.apache.org/jira/browse/HDFS-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14004: --- Fix Version/s: 3.2.2 3.1.4 >

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088045#comment-17088045 ] Wei-Chiu Chuang commented on HDFS-15287: Does it require multiple standby namenodes, observer

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087949#comment-17087949 ] Wei-Chiu Chuang commented on HDFS-15287: [~cliang] [~shv] could you look into this? > HDFS

[jira] [Updated] (HDFS-15283) Cache pool MAXTTL is not persisted and restored on cluster restart

[ https://issues.apache.org/jira/browse/HDFS-15283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15283: --- Fix Version/s: 2.10.1 3.2.2 3.1.4

[jira] [Commented] (HDFS-15283) Cache pool MAXTTL is not persisted and restored on cluster restart

[ https://issues.apache.org/jira/browse/HDFS-15283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084892#comment-17084892 ] Wei-Chiu Chuang commented on HDFS-15283: +1 > Cache pool MAXTTL is not persisted and restored on

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081127#comment-17081127 ] Wei-Chiu Chuang commented on HDFS-14476: We need HDFS-15048 too. > lock too long when fix

[jira] [Updated] (HDFS-15253) Set default throttle value on dfs.image.transfer.bandwidthPerSec

[ https://issues.apache.org/jira/browse/HDFS-15253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15253: --- Target Version/s: 3.4.0 > Set default throttle value on dfs.image.transfer.bandwidthPerSec >

[jira] [Commented] (HDFS-15253) Set default throttle value on dfs.image.transfer.bandwidthPerSec

[ https://issues.apache.org/jira/browse/HDFS-15253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081008#comment-17081008 ] Wei-Chiu Chuang commented on HDFS-15253: Sounds like we have a consensus here. [~kpalanisamy]

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080850#comment-17080850 ] Wei-Chiu Chuang commented on HDFS-15160: [~zhuqi] which of the patch did you apply? 004 or 005?

[jira] [Resolved] (HDFS-15269) NameNode should check the authorization API version only once during initialization

[ https://issues.apache.org/jira/browse/HDFS-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15269. Fix Version/s: 3.3.0 Resolution: Fixed PR is merged in trunk, and cherrypicked to

[jira] [Commented] (HDFS-15245) Improve JournalNode web UI

[ https://issues.apache.org/jira/browse/HDFS-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078355#comment-17078355 ] Wei-Chiu Chuang commented on HDFS-15245: Apache Knox doesn't support JournalNode web UI write

[jira] [Commented] (HDFS-15269) NameNode should check the authorization API version only once during initialization

[ https://issues.apache.org/jira/browse/HDFS-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078271#comment-17078271 ] Wei-Chiu Chuang commented on HDFS-15269: [~brahma] fyi. blocker for 3.3.0 > NameNode should

[jira] [Updated] (HDFS-15269) NameNode should check the authorization API version only once during initialization

[ https://issues.apache.org/jira/browse/HDFS-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15269: --- Description: After HDFS-14743, every authorization check logs a messages like the following

[jira] [Commented] (HDFS-15269) NameNode should check the authorization API version only once during initialization

[ https://issues.apache.org/jira/browse/HDFS-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077715#comment-17077715 ] Wei-Chiu Chuang commented on HDFS-15269: [~xyao] fyi > NameNode should check the authorization

[jira] [Created] (HDFS-15269) NameNode should check the authorization API version only once during initialization

Wei-Chiu Chuang created HDFS-15269: -- Summary: NameNode should check the authorization API version only once during initialization Key: HDFS-15269 URL: https://issues.apache.org/jira/browse/HDFS-15269

[jira] [Assigned] (HDFS-15269) NameNode should check the authorization API version only once during initialization

[ https://issues.apache.org/jira/browse/HDFS-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15269: -- Assignee: Wei-Chiu Chuang > NameNode should check the authorization API version only

[jira] [Commented] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077575#comment-17077575 ] Wei-Chiu Chuang commented on HDFS-14575: Thanks for reporting the issue & the patch. The

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17075219#comment-17075219 ] Wei-Chiu Chuang commented on HDFS-15207: LGTM > VolumeScanner skip to scan blocks accessed

[jira] [Comment Edited] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074851#comment-17074851 ] Wei-Chiu Chuang edited comment on HDFS-15207 at 4/3/20, 7:38 PM: - Patch

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074851#comment-17074851 ] Wei-Chiu Chuang commented on HDFS-15207: Patch makes sense tom me. Thanks for working on this

[jira] [Updated] (HDFS-5242) Reduce contention on DatanodeInfo instances

[ https://issues.apache.org/jira/browse/HDFS-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-5242: -- Target Version/s: (was: ) Resolution: Duplicate Status: Resolved

[jira] [Commented] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073282#comment-17073282 ] Wei-Chiu Chuang commented on HDFS-14578: Thanks! > AvailableSpaceBlockPlacementPolicy always

[jira] [Updated] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15242: --- Fix Version/s: (was: 3.3.0) 3.4.0 > Add metrics for operations hold

[jira] [Updated] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15242: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073258#comment-17073258 ] Wei-Chiu Chuang commented on HDFS-15242: LGTM committing 003 patch. > Add metrics for operations

[jira] [Commented] (HDFS-15253) Set default throttle value on dfs.image.transfer.bandwidthPerSec

[ https://issues.apache.org/jira/browse/HDFS-15253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072244#comment-17072244 ] Wei-Chiu Chuang commented on HDFS-15253: Not sure about dfs.image.compress. I can count the

[jira] [Updated] (HDFS-15201) SnapshotCounter hits MaxSnapshotID limit

[ https://issues.apache.org/jira/browse/HDFS-15201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15201: --- Fix Version/s: 3.3.0 > SnapshotCounter hits MaxSnapshotID limit >

<    1   2   3   4   5   6   7   8   9   10   >