[jira] [Assigned] (HDFS-14375) DataNode cannot serve BlockPool to multiple NameNodes in the different realm

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14375: -- Assignee: Jihyun Cho > DataNode cannot serve BlockPool to multiple NameNodes in the di

[jira] [Updated] (HDFS-14375) DataNode cannot serve BlockPool to multiple NameNodes in the different realm

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14375: --- Status: Patch Available (was: Open) > DataNode cannot serve BlockPool to multiple NameNodes

[jira] [Resolved] (HDFS-14408) HttpFS handles paths with special charactes different than WebHdfs

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14408. Resolution: Duplicate > HttpFS handles paths with special charactes different than WebHdfs

[jira] [Updated] (HDFS-14450) Erasure Coding: decommissioning datanodes cause replicate a large number of duplicate EC internal blocks

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14450: --- Status: Patch Available (was: Open) > Erasure Coding: decommissioning datanodes cause replic

[jira] [Updated] (HDFS-14489) fix naming issue for ScmBlockLocationTestingClient

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14489: --- Status: Patch Available (was: Open) > fix naming issue for ScmBlockLocationTestingClient > -

[jira] [Updated] (HDFS-14515) The proto type of quota should change to int64.

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14515: --- Status: Patch Available (was: Open) > The proto type of quota should change to int64. >

[jira] [Updated] (HDFS-14523) Remove excess read lock for NetworkToplogy

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14523: --- Status: Patch Available (was: Open) > Remove excess read lock for NetworkToplogy > -

[jira] [Updated] (HDFS-13495) RBF: Support Router Admin REST API

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13495: --- Status: Patch Available (was: Open) Submit for precommit check > RBF: Support Router Admin

[jira] [Updated] (HDFS-14423) Percent (%) and plus (+) characters no longer work in WebHDFS

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14423: --- Status: Patch Available (was: Open) > Percent (%) and plus (+) characters no longer work in

[jira] [Commented] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904196#comment-16904196 ] Wei-Chiu Chuang commented on HDFS-14595: Looks good. [~ayushtkn] anything you'd l

[jira] [Updated] (HDFS-14378) Simplify the design of multiple NN and both logic of edit log roll and checkpoint

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14378: --- Priority: Major (was: Minor) > Simplify the design of multiple NN and both logic of edit log

[jira] [Commented] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904156#comment-16904156 ] Wei-Chiu Chuang commented on HDFS-13709: The quick solution is to replace {code}

[jira] [Commented] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904146#comment-16904146 ] Wei-Chiu Chuang commented on HDFS-14706: Thanks [~sodonnell] for the very detaile

[jira] [Commented] (HDFS-14519) NameQuota is not update after concat operation, so namequota is wrong

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904108#comment-16904108 ] Wei-Chiu Chuang commented on HDFS-14519: [~RANith] would you address the comments

[jira] [Commented] (HDFS-14625) Make DefaultAuditLogger class in FSnamesystem to Abstract

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904107#comment-16904107 ] Wei-Chiu Chuang commented on HDFS-14625: [~hemanthboyina] patch no longer applies

[jira] [Commented] (HDFS-14423) Percent (%) and plus (+) characters no longer work in WebHDFS

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904097#comment-16904097 ] Wei-Chiu Chuang commented on HDFS-14423: I updated TestWebHdfsUrl which was added

[jira] [Assigned] (HDFS-14423) Percent (%) and plus (+) characters no longer work in WebHDFS

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14423: -- Assignee: Wei-Chiu Chuang > Percent (%) and plus (+) characters no longer work in WebH

[jira] [Updated] (HDFS-14423) Percent (%) and plus (+) characters no longer work in WebHDFS

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14423: --- Attachment: HDFS-14423.001.patch > Percent (%) and plus (+) characters no longer work in WebH

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904090#comment-16904090 ] Wei-Chiu Chuang commented on HDFS-12749: I am late in the game. Reviewing the pat

[jira] [Resolved] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14696. Resolution: Fixed Fix Version/s: 2.10.0 Merge the PR, resolve this jira. Thanks [~sm

[jira] [Updated] (HDFS-14042) Fix NPE when PROVIDED storage is missing

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14042: --- Fix Version/s: 3.1.2 3.2.1 > Fix NPE when PROVIDED storage is missing > --

[jira] [Updated] (HDFS-14693) NameNode should log a warning when EditLog IPC logger's pending size exceeds limit.

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14693: --- Resolution: Fixed Fix Version/s: 3.1.3 3.2.1 3.3.

[jira] [Updated] (HDFS-14705) Remove unused configuration dfs.min.replication

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14705: --- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Availab

[jira] [Updated] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14701: --- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Availab

[jira] [Updated] (HDFS-14662) Document the usage of the new Balancer "asService" parameter

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14662: --- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Availab

[jira] [Updated] (HDFS-14459) ClosedChannelException silently ignored in FsVolumeList.addBlockPool()

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14459: --- Fix Version/s: 3.1.3 3.2.1 > ClosedChannelException silently ignored in Fs

[jira] [Updated] (HDFS-14459) ClosedChannelException silently ignored in FsVolumeList.addBlockPool()

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14459: --- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to trunk, branch-3.

[jira] [Commented] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903313#comment-16903313 ] Wei-Chiu Chuang commented on HDFS-14701: +1 > Change Log Level to warn in SlotRe

[jira] [Commented] (HDFS-14459) ClosedChannelException silently ignored in FsVolumeList.addBlockPool()

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903122#comment-16903122 ] Wei-Chiu Chuang commented on HDFS-14459: +1 Thanks [~sodonnell] [~smeng] bq. It

[jira] [Updated] (HDFS-14678) Allow triggerBlockReport to a specific namenode

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14678: --- Status: Patch Available (was: Open) A patch is available in Github PR. https://github.com/ap

[jira] [Created] (HDFS-14709) Add encryption zone related REST APIs to WebHDFS

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-14709: -- Summary: Add encryption zone related REST APIs to WebHDFS Key: HDFS-14709 URL: https://issues.apache.org/jira/browse/HDFS-14709 Project: Hadoop HDFS Issu

[jira] [Updated] (HDFS-14709) Add encryption zone related REST APIs to WebHDFS

2019-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14709: --- Description: Webhdfs doesn't handle encryption zone related REST APIs: createEncryptionZone,

[jira] [Commented] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

2019-08-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902657#comment-16902657 ] Wei-Chiu Chuang commented on HDFS-14617: {quote} Test with fsimage of over 165M i

[jira] [Commented] (HDFS-14455) Fix typo in HAState.java

2019-08-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902639#comment-16902639 ] Wei-Chiu Chuang commented on HDFS-14455: Duplicates HDFS-14398 > Fix typo in HAS

[jira] [Commented] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902636#comment-16902636 ] Wei-Chiu Chuang commented on HDFS-14696: +1 bq. (I can't run them directly in In

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Resolution: Fixed Status: Resolved (was: Patch Available) I gave up on branch-2.8. I

[jira] [Commented] (HDFS-13603) Warmup NameNode EDEK thread retries continuously if there's an invalid key

2019-08-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902248#comment-16902248 ] Wei-Chiu Chuang commented on HDFS-13603: We see this in our internal tests as wel

[jira] [Commented] (HDFS-14616) Add the warn log when the volume available space isn't enough

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901650#comment-16901650 ] Wei-Chiu Chuang commented on HDFS-14616: +1 from me > Add the warn log when the

[jira] [Commented] (HDFS-14662) Document the usage of the new Balancer "asService" parameter

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901648#comment-16901648 ] Wei-Chiu Chuang commented on HDFS-14662: LGTM. Any one else like to review before

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901645#comment-16901645 ] Wei-Chiu Chuang commented on HDFS-14476: [~seanlook] please follow the How to con

[jira] [Resolved] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11273. Resolution: Fixed > Move TransferFsImage#doGetUrl function to a Util class > --

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Attachment: HDFS-12914.branch-2.8.002.patch > Block report leases cause missing blocks until

[jira] [Commented] (HDFS-14705) Remove unused configuration dfs.min.replication

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901581#comment-16901581 ] Wei-Chiu Chuang commented on HDFS-14705: LGTM +1  > Remove unused configuration

[jira] [Commented] (HDFS-13843) RBF: When we add/update mount entry to multiple destinations, unable to see the order information in mount entry points and in federation router UI

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901533#comment-16901533 ] Wei-Chiu Chuang commented on HDFS-13843: I don't think [~zvenczel] would mind. [~

[jira] [Assigned] (HDFS-13843) RBF: When we add/update mount entry to multiple destinations, unable to see the order information in mount entry points and in federation router UI

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-13843: -- Assignee: Ayush Saxena (was: Zsolt Venczel) > RBF: When we add/update mount entry to

[jira] [Commented] (HDFS-12125) Document the missing -removePolicy command of ec

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901529#comment-16901529 ] Wei-Chiu Chuang commented on HDFS-12125: [~smeng] thanks for the heads up. Please

[jira] [Assigned] (HDFS-12125) Document the missing -removePolicy command of ec

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-12125: -- Assignee: Siyao Meng (was: Wenxin He) > Document the missing -removePolicy command of

[jira] [Commented] (HDFS-14693) NameNode should log a warning when EditLog IPC logger's pending size exceeds limit.

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901528#comment-16901528 ] Wei-Chiu Chuang commented on HDFS-14693: LGTM +1. Test failure looks unrelated.

[jira] [Commented] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901527#comment-16901527 ] Wei-Chiu Chuang commented on HDFS-14696: [~smeng] care to clean up the checkstyle

[jira] [Updated] (HDFS-14692) Upload button should not encode complete url

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14692: --- Resolution: Fixed Fix Version/s: 3.1.3 3.2.1 3.3.

[jira] [Commented] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901524#comment-16901524 ] Wei-Chiu Chuang commented on HDFS-14701: Thanks for explanation. Now it makes sen

[jira] [Updated] (HDFS-14652) HealthMonitor connection retry times should be configurable

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14652: --- Resolution: Fixed Status: Resolved (was: Patch Available) > HealthMonitor connection

[jira] [Commented] (HDFS-14652) HealthMonitor connection retry times should be configurable

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901522#comment-16901522 ] Wei-Chiu Chuang commented on HDFS-14652: +1 addendum. Pushed to trunk. Thanks! >

[jira] [Commented] (HDFS-14623) In NameNode Web UI, for Head the file (first 32K) old data is showing

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901520#comment-16901520 ] Wei-Chiu Chuang commented on HDFS-14623: [~hemanthboyina] the patch is corrupt, a

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Attachment: HDFS-12914.branch-2.8.001.patch > Block report leases cause missing blocks until

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901495#comment-16901495 ] Wei-Chiu Chuang commented on HDFS-12914: Doesn't reproduce any more. Pushed the p

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Fix Version/s: 2.9.3 > Block report leases cause missing blocks until next report > -

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Fix Version/s: 2.10.0 > Block report leases cause missing blocks until next report >

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901462#comment-16901462 ] Wei-Chiu Chuang commented on HDFS-14476: Sean, please offer patch for trunk branc

[jira] [Updated] (HDFS-14557) JournalNode error: Can't scan a pre-transactional edit log

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14557: --- Resolution: Fixed Fix Version/s: 3.1.3 Status: Resolved (was: Patch Availab

[jira] [Commented] (HDFS-14557) JournalNode error: Can't scan a pre-transactional edit log

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901455#comment-16901455 ] Wei-Chiu Chuang commented on HDFS-14557: Test failures looks unrelated. Pushed to

[jira] [Updated] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14674: --- Status: Patch Available (was: Reopened) > [SBN read] Got an unexpected txid when tail editlo

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901393#comment-16901393 ] Wei-Chiu Chuang commented on HDFS-14313: +1 > Get hdfs used space from FsDataset

[jira] [Created] (HDFS-14705) Remove unused configuration dfs.min.replication

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-14705: -- Summary: Remove unused configuration dfs.min.replication Key: HDFS-14705 URL: https://issues.apache.org/jira/browse/HDFS-14705 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901227#comment-16901227 ] Wei-Chiu Chuang commented on HDFS-14694: Note a nasty race condition between clos

[jira] [Updated] (HDFS-14557) JournalNode error: Can't scan a pre-transactional edit log

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14557: --- Attachment: HDFS-14557.branch-3.1.001.patch > JournalNode error: Can't scan a pre-transaction

[jira] [Commented] (HDFS-14557) JournalNode error: Can't scan a pre-transactional edit log

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901204#comment-16901204 ] Wei-Chiu Chuang commented on HDFS-14557: Pushed the patch to trunk and branch-3.2

[jira] [Updated] (HDFS-14557) JournalNode error: Can't scan a pre-transactional edit log

2019-08-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14557: --- Fix Version/s: 3.2.1 3.3.0 > JournalNode error: Can't scan a pre-transacti

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900549#comment-16900549 ] Wei-Chiu Chuang commented on HDFS-14313: Hi [~leosun08] thanks a lot for continue

[jira] [Commented] (HDFS-14557) JournalNode error: Can't scan a pre-transactional edit log

2019-08-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900459#comment-16900459 ] Wei-Chiu Chuang commented on HDFS-14557: Looks good to me. Thanks for the explana

[jira] [Comment Edited] (HDFS-14195) OIV: print out storage policy id in oiv Delimited output

2019-08-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900337#comment-16900337 ] Wei-Chiu Chuang edited comment on HDFS-14195 at 8/5/19 7:24 PM: ---

[jira] [Commented] (HDFS-14195) OIV: print out storage policy id in oiv Delimited output

2019-08-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900337#comment-16900337 ] Wei-Chiu Chuang commented on HDFS-14195: Thanks [~suxingfate] really appreciate y

[jira] [Comment Edited] (HDFS-14195) OIV: print out storage policy id in oiv Delimited output

2019-08-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900337#comment-16900337 ] Wei-Chiu Chuang edited comment on HDFS-14195 at 8/5/19 7:23 PM: ---

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2019-08-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900210#comment-16900210 ] Wei-Chiu Chuang commented on HDFS-9668: --- I think there's definitely a value in optim

[jira] [Reopened] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-14674: [~wangzhaohui] this patch is not yet committed. Reopen this jira for now. > [SBN read] Got an

[jira] [Commented] (HDFS-14652) HealthMonitor connection retry times should be configurable

2019-08-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900173#comment-16900173 ] Wei-Chiu Chuang commented on HDFS-14652: Can you add an addendum patch attached t

[jira] [Commented] (HDFS-14099) Unknown frame descriptor when decompressing multiple frames in ZStandardDecompressor

2019-08-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900172#comment-16900172 ] Wei-Chiu Chuang commented on HDFS-14099: I am not sure I can do a quality review

[jira] [Updated] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14674: --- Summary: [SBN read] Got an unexpected txid when tail editlog (was: Got an unexpected txid wh

[jira] [Commented] (HDFS-11393) Hadoop KMS contacted by jobs which don’t use KMS encryption

2019-08-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899530#comment-16899530 ] Wei-Chiu Chuang commented on HDFS-11393: I think this is addressed by HADOOP-1635

[jira] [Resolved] (HDFS-13483) Crypto command should give proper exception when user is trying to create an EZ with the same key with which it is already created

2019-08-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-13483. Resolution: Duplicate > Crypto command should give proper exception when user is trying to

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899527#comment-16899527 ] Wei-Chiu Chuang commented on HDFS-12914: One of the test failure in my branch-2 b

[jira] [Commented] (HDFS-13759) [HDFS Pagination]Does HDFS Java api Support Pagination?

2019-08-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899398#comment-16899398 ] Wei-Chiu Chuang commented on HDFS-13759: You should use DistributedFileSystem ins

[jira] [Commented] (HDFS-14208) A large number missingblocks happend after failover to active.

2019-08-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899388#comment-16899388 ] Wei-Chiu Chuang commented on HDFS-14208: HDFS-10399? > A large number missingblo

[jira] [Commented] (HDFS-14264) Datanode du -sk command is slow

2019-08-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899386#comment-16899386 ] Wei-Chiu Chuang commented on HDFS-14264: Use the DF implementation added in HADOO

[jira] [Commented] (HDFS-14423) Percent (%) and plus (+) characters no longer work in WebHDFS

2019-08-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899384#comment-16899384 ] Wei-Chiu Chuang commented on HDFS-14423: Does HDFS-14323 fix it? > Percent (%) a

[jira] [Commented] (HDFS-14605) Note missing on expunge command description for encrypted zones

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899378#comment-16899378 ] Wei-Chiu Chuang commented on HDFS-14605: Please see my patch at HDFS-12484 and se

[jira] [Resolved] (HDFS-14605) Note missing on expunge command description for encrypted zones

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14605. Resolution: Duplicate > Note missing on expunge command description for encrypted zones > -

[jira] [Commented] (HDFS-14627) Improvements to make slow archive storage works on HDFS

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899375#comment-16899375 ] Wei-Chiu Chuang commented on HDFS-14627: [~hadoop_yangyun] thanks for filing the

[jira] [Commented] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899369#comment-16899369 ] Wei-Chiu Chuang commented on HDFS-14617: [~hexiaoqiao] thanks for your input! It

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff to support WebHDFS

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13916: --- Summary: Distcp SnapshotDiff to support WebHDFS (was: Distcp SnapshotDiff not completely imp

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Attachment: (was: HDFS-12914.002.patch) > Block report leases cause missing blocks until

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Attachment: HDFS-12914.branch-2.002.patch > Block report leases cause missing blocks until ne

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Attachment: HDFS-12914.002.patch > Block report leases cause missing blocks until next report

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899337#comment-16899337 ] Wei-Chiu Chuang commented on HDFS-13916: Attached 006 patch to address [~xyao]'s

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13916: --- Attachment: HDFS-13916.006.patch > Distcp SnapshotDiff not completely implemented for support

[jira] [Commented] (HDFS-14623) In NameNode Web UI, for Head the file (first 32K) old data is showing

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899317#comment-16899317 ] Wei-Chiu Chuang commented on HDFS-14623: +1 I am not the expert in web UI. But se

[jira] [Commented] (HDFS-14666) When using nfs3, the renaming fails when the target file exists.

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899316#comment-16899316 ] Wei-Chiu Chuang commented on HDFS-14666: isn't this expected behavior? > When us

[jira] [Commented] (HDFS-14195) OIV: print out storage policy id in oiv Delimited output

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899304#comment-16899304 ] Wei-Chiu Chuang commented on HDFS-14195: [~suxingfate] the latest precommit was r

[jira] [Commented] (HDFS-13101) Yet another fsimage corruption related to snapshot

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899277#comment-16899277 ] Wei-Chiu Chuang commented on HDFS-13101: With my limited knowledge in the snapsho

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2019-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899099#comment-16899099 ] Wei-Chiu Chuang commented on HDFS-11273: [~smeng] I am not sure what's wrong with

<    9   10   11   12   13   14   15   16   17   18   >