[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-02-28 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381621#comment-16381621 ] maobaolong commented on HDFS-13212: --- [~wuweiwei] Shouldn't the MountTableResolver clean the

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-02-28 Thread Yiran Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381608#comment-16381608 ] Yiran Wu commented on HDFS-13212: - I have a same problem.  > RBF: Fix router location cache issue >

[jira] [Updated] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13165: Attachment: HDFS-13165-HDFS-10285-03.patch > [SPS]: Collects successfully moved block details via IBR >

[jira] [Commented] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-02-28 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381586#comment-16381586 ] maobaolong commented on HDFS-13195: --- [~bharatviswa] Whatever, thank for your kindly review. [~elgoiri]

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2018-02-28 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381584#comment-16381584 ] wangzhiyuan commented on HDFS-6489: --- Any update about this issue? I think frequent truncate will have

[jira] [Updated] (HDFS-13212) RBF: Fix router location cache issue

2018-02-28 Thread weiwei wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weiwei wu updated HDFS-13212: - Attachment: HDFS-13212-001.patch > RBF: Fix router location cache issue >

[jira] [Updated] (HDFS-13212) RBF: Fix router location cache issue

2018-02-28 Thread weiwei wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weiwei wu updated HDFS-13212: - Status: Patch Available (was: Open) > RBF: Fix router location cache issue >

[jira] [Updated] (HDFS-13212) RBF: Fix router location cache issue

2018-02-28 Thread weiwei wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weiwei wu updated HDFS-13212: - Attachment: (was: HDFS-12615-001.patch) > RBF: Fix router location cache issue >

[jira] [Created] (HDFS-13212) RBF: Fix router location cache issue

2018-02-28 Thread weiwei wu (JIRA)
weiwei wu created HDFS-13212: Summary: RBF: Fix router location cache issue Key: HDFS-13212 URL: https://issues.apache.org/jira/browse/HDFS-13212 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-13192) Change the code order in getFileEncryptionInfo to avoid unnecessary call of assignment

2018-02-28 Thread LiXin Ge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381570#comment-16381570 ] LiXin Ge commented on HDFS-13192: - [~elgoiri] Thanks for review and commit this! > Change the code order

[jira] [Commented] (HDFS-13211) Refactor Unit Tests for SnapshotSKipList

2018-02-28 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381563#comment-16381563 ] Shashikant Banerjee commented on HDFS-13211: Patch v1 refactors the unit tests for

[jira] [Updated] (HDFS-13211) Refactor Unit Tests for SnapshotSKipList

2018-02-28 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13211: --- Attachment: HDFS-13211.001.patch > Refactor Unit Tests for SnapshotSKipList >

[jira] [Updated] (HDFS-13211) Refactor Unit Tests for SnapshotSKipList

2018-02-28 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13211: --- Status: Patch Available (was: Open) > Refactor Unit Tests for SnapshotSKipList >

[jira] [Created] (HDFS-13211) Refactor Unit Tests for SnapshotSKipList

2018-02-28 Thread Shashikant Banerjee (JIRA)
Shashikant Banerjee created HDFS-13211: -- Summary: Refactor Unit Tests for SnapshotSKipList Key: HDFS-13211 URL: https://issues.apache.org/jira/browse/HDFS-13211 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-02-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381538#comment-16381538 ] Ajay Kumar commented on HDFS-13056: --- [~dennishuo], Thanks for working on this. I tested patch v3 in my

[jira] [Commented] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381483#comment-16381483 ] genericqa commented on HDFS-13207: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-02-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13210: - Description: There is a typo {{SimilatedFSDataset}} in {{MiniDFSCluster#injectBlocks}}. In line2748 and

[jira] [Created] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-02-28 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-13210: Summary: Fix the typo in MiniDFSCluster class Key: HDFS-13210 URL: https://issues.apache.org/jira/browse/HDFS-13210 Project: Hadoop HDFS Issue Type: Bug

[jira] [Assigned] (HDFS-12581) ViewFileSystem#getAllStoragePolicies aggregates storage policies across NN using policyid

2018-02-28 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-12581: Assignee: Lokesh Jain (was: Mukul Kumar Singh) >

[jira] [Commented] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381467#comment-16381467 ] Bharat Viswanadham commented on HDFS-13195: --- [~maobaolong] I am not a committer, to commit the

[jira] [Comment Edited] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381467#comment-16381467 ] Bharat Viswanadham edited comment on HDFS-13195 at 3/1/18 3:42 AM: ---

[jira] [Commented] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-02-28 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381461#comment-16381461 ] wangzhiyuan commented on HDFS-13195: +1 LGTM > DataNode conf page cannot display the current value

[jira] [Comment Edited] (HDFS-11610) sun.net.spi.nameservice.NameService has moved to a new location

2018-02-28 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381437#comment-16381437 ] Takanobu Asanuma edited comment on HDFS-11610 at 3/1/18 3:07 AM: - This

[jira] [Comment Edited] (HDFS-11610) sun.net.spi.nameservice.NameService has moved to a new location

2018-02-28 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381437#comment-16381437 ] Takanobu Asanuma edited comment on HDFS-11610 at 3/1/18 2:57 AM: - This

[jira] [Commented] (HDFS-11610) sun.net.spi.nameservice.NameService has moved to a new location

2018-02-28 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381437#comment-16381437 ] Takanobu Asanuma commented on HDFS-11610: - This patch still works fine. Yesterday, I confirmed

[jira] [Commented] (HDFS-13208) RBF: Mount path not available after ADD-REMOVE-ADD

2018-02-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381431#comment-16381431 ] Yiqun Lin commented on HDFS-13208: -- [~ywskycn], I tried to reproduce this issue, and did the test in UT

[jira] [Commented] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-02-28 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381403#comment-16381403 ] wangzhiyuan commented on HDFS-13204: Good catch, state icons should be stay the same, furthermore,

[jira] [Commented] (HDFS-13081) Datanode#checkSecureConfig should allow SASL and privileged HTTP

2018-02-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381389#comment-16381389 ] Ajay Kumar commented on HDFS-13081: --- [~xyao], [~jlowe], [~daryn] thanks for input and reviews. >

[jira] [Commented] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-02-28 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381385#comment-16381385 ] maobaolong commented on HDFS-13204: --- I think the icon can be replace to others, but it is another thing

[jira] [Commented] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-02-28 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381378#comment-16381378 ] maobaolong commented on HDFS-13195: --- [~bharatviswa] Thank you for clarify for me very much. And what

[jira] [Commented] (HDFS-13114) CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path

2018-02-28 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381301#comment-16381301 ] Hanisha Koneru commented on HDFS-13114: --- Thank you [~xyao] for committing the patch and

[jira] [Commented] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381281#comment-16381281 ] Bharat Viswanadham commented on HDFS-13207: --- [~xyao] Attached the patch to address 1 and 3

[jira] [Updated] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13207: -- Attachment: HDFS-13207.01.patch > Add blockpool used for DFSAdmin Report command >

[jira] [Created] (HDFS-13209) DistributedFileSystem.create should allow an option to provide StoragePolicy

2018-02-28 Thread Jean-Marc Spaggiari (JIRA)
Jean-Marc Spaggiari created HDFS-13209: -- Summary: DistributedFileSystem.create should allow an option to provide StoragePolicy Key: HDFS-13209 URL: https://issues.apache.org/jira/browse/HDFS-13209

[jira] [Commented] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381198#comment-16381198 ] Bharat Viswanadham commented on HDFS-13207: --- Hi [~xyao] Thank you for the comments. {quote} 1.

[jira] [Commented] (HDFS-13171) Handle Deletion of nodes in SnasphotSkipList

2018-02-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381137#comment-16381137 ] Tsz Wo Nicholas Sze commented on HDFS-13171: - Question: What if nodePath[level] == head? The

[jira] [Updated] (HDFS-13208) RBF: Mount path not available after ADD-REMOVE-ADD

2018-02-28 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13208: --- Description: To reproduce this issue, run the following commands at Router 1: {code:java} $ hdfs

[jira] [Commented] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

2018-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381092#comment-16381092 ] Hudson commented on HDFS-13102: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13741 (See

[jira] [Created] (HDFS-13208) RBF: Mount path not available after ADD-REMOVE-ADD

2018-02-28 Thread Wei Yan (JIRA)
Wei Yan created HDFS-13208: -- Summary: RBF: Mount path not available after ADD-REMOVE-ADD Key: HDFS-13208 URL: https://issues.apache.org/jira/browse/HDFS-13208 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-13143) SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree

2018-02-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13143: --- Attachment: HDFS-13143.003_committed.patch > SnapshotDiff - snapshotDiffReport might

[jira] [Updated] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

2018-02-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13102: --- Attachment: HDFS-13102.009_committed.patch > Implement SnapshotSkipList class to

[jira] [Updated] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

2018-02-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13102: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0

[jira] [Commented] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

2018-02-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381068#comment-16381068 ] Tsz Wo Nicholas Sze commented on HDFS-13102: +1 the 009 patch looks good. For the checkstyle

[jira] [Commented] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

2018-02-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381063#comment-16381063 ] genericqa commented on HDFS-13102: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-02-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381057#comment-16381057 ] Íñigo Goiri commented on HDFS-13204: A nameservice would also have those 4 states: * Active, when one

[jira] [Commented] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381048#comment-16381048 ] Xiaoyu Yao commented on HDFS-13207: --- Thanks [~bharatviswa] for reporting the issue and posting the

[jira] [Commented] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381046#comment-16381046 ] genericqa commented on HDFS-13207: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380976#comment-16380976 ] Bharat Viswanadham commented on HDFS-13207: --- Existing TestDFSAdmin test cases, covers this.

[jira] [Updated] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13207: -- Status: Patch Available (was: In Progress) > Add blockpool used for DFSAdmin Report

[jira] [Updated] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13207: -- Attachment: HDFS-13207.00.patch > Add blockpool used for DFSAdmin Report command >

[jira] [Updated] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13207: -- Issue Type: Improvement (was: Bug) > Add blockpool used for DFSAdmin Report command >

[jira] [Updated] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13207: -- Description: Add block pool used for dfsadmin -report command.  This will be helpful

[jira] [Work started] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13207 started by Bharat Viswanadham. - > Add blockpool used for DFSAdmin Report command >

[jira] [Created] (HDFS-13207) Add blockpool used for DFSAdmin Report command

2018-02-28 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-13207: - Summary: Add blockpool used for DFSAdmin Report command Key: HDFS-13207 URL: https://issues.apache.org/jira/browse/HDFS-13207 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380902#comment-16380902 ] Ted Yu commented on HDFS-13206: --- {code} devtmpfs 65906460 0 65906460 0% /dev tmpfs

[jira] [Commented] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380888#comment-16380888 ] Rushabh S Shah commented on HDFS-13206: --- {noformat} 2018-02-28 18:39:59,969 WARN

[jira] [Commented] (HDFS-13171) Handle Deletion of nodes in SnasphotSkipList

2018-02-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380859#comment-16380859 ] Tsz Wo Nicholas Sze commented on HDFS-13171: How to apply the patch? It somehow requires the

[jira] [Updated] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-02-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13166: -- Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved

[jira] [Commented] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-02-28 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380851#comment-16380851 ] Wei Yan commented on HDFS-13204: The "Safe Mode" icon under tab "Subclusters" --> "Nameservice

[jira] [Commented] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-02-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380845#comment-16380845 ] Surendra Singh Lilhore commented on HDFS-13166: --- +1 LGTM > [SPS]: Implement caching

[jira] [Commented] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380829#comment-16380829 ] Ted Yu commented on HDFS-13206: --- I don't think that was the case. I used {{df}} command on the Linux where

[jira] [Comment Edited] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380822#comment-16380822 ] Kihwal Lee edited comment on HDFS-13206 at 2/28/18 6:52 PM: It looks like the

[jira] [Commented] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380822#comment-16380822 ] Kihwal Lee commented on HDFS-13206: --- It looks like the NN went into safe mode because the disk ran out

[jira] [Commented] (HDFS-13081) Datanode#checkSecureConfig should allow SASL and privileged HTTP

2018-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380819#comment-16380819 ] Hudson commented on HDFS-13081: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13738 (See

[jira] [Commented] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

2018-02-28 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380814#comment-16380814 ] Shashikant Banerjee commented on HDFS-13102: Thanks [~szetszwo], for the review . Patch v9

[jira] [Updated] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-13206: -- Attachment: testFavoredNodeTableImport-output.txt > IllegalStateException: Unable to finalize edits file >

[jira] [Updated] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

2018-02-28 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13102: --- Attachment: HDFS-13102.009.patch > Implement SnapshotSkipList class to store Multi

[jira] [Created] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Ted Yu (JIRA)
Ted Yu created HDFS-13206: - Summary: IllegalStateException: Unable to finalize edits file Key: HDFS-13206 URL: https://issues.apache.org/jira/browse/HDFS-13206 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-13081) Datanode#checkSecureConfig should allow SASL and privileged HTTP

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13081: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.0.2

[jira] [Commented] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

2018-02-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380794#comment-16380794 ] Tsz Wo Nicholas Sze commented on HDFS-13102: The 008 patch looks good. -

[jira] [Commented] (HDFS-13081) Datanode#checkSecureConfig should allow SASL and privileged HTTP

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380736#comment-16380736 ] Xiaoyu Yao commented on HDFS-13081: --- Update the title and description, I will commit the patch shortly.

[jira] [Updated] (HDFS-13081) Datanode#checkSecureConfig should allow SASL and privileged HTTP

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13081: -- Summary: Datanode#checkSecureConfig should allow SASL and privileged HTTP (was:

[jira] [Updated] (HDFS-13081) Datanode#checkSecureConfig should allow privileged HTTP and SASL encryption

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13081: -- Description: Datanode#checkSecureConfig currently check the following to determine if secure datanode 

[jira] [Updated] (HDFS-13081) Datanode#checkSecureConfig should allow privileged HTTP and SASL encryption

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13081: -- Description: Datanode#checkSecureConfig currently check the following to determine if secure datanode 

[jira] [Updated] (HDFS-13081) Datanode#checkSecureConfig should allow privileged HTTP and SASL encryption

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13081: -- Summary: Datanode#checkSecureConfig should allow privileged HTTP and SASL encryption (was:

[jira] [Commented] (HDFS-13081) Datanode#checkSecureConfig should check HTTPS and SASL encryption

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380709#comment-16380709 ] Xiaoyu Yao commented on HDFS-13081: --- Thanks [~ajayydv] for the update. +1 for the latest patch. There

[jira] [Updated] (HDFS-12284) RBF: Support for Kerberos authentication and delegation tokens

2018-02-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12284: --- Summary: RBF: Support for Kerberos authentication and delegation tokens (was: Router support for

[jira] [Updated] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-02-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13204: --- Summary: RBF: Optimize name service safe mode icon (was: RBF: optimize name service safe mode icon)

[jira] [Commented] (HDFS-13204) RBF: optimize name service safe mode icon

2018-02-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380685#comment-16380685 ] Íñigo Goiri commented on HDFS-13204: Thanks [~liuhongtong] for opening this. I think it makes sense to

[jira] [Commented] (HDFS-13114) CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path

2018-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380662#comment-16380662 ] Hudson commented on HDFS-13114: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13737 (See

[jira] [Comment Edited] (HDFS-13114) CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380637#comment-16380637 ] Xiaoyu Yao edited comment on HDFS-13114 at 2/28/18 4:47 PM: Thanks

[jira] [Updated] (HDFS-13114) CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13114: -- Fix Version/s: 3.0.2 > CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path >

[jira] [Updated] (HDFS-13114) CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path

2018-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13114: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.1.0

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380554#comment-16380554 ] Erik Krogen commented on HDFS-13183: An {{IOException}} thrown on the ANN side will return to the

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380482#comment-16380482 ] Erik Krogen commented on HDFS-12749: I think the v003 patch is fine to resolve this issue. I am not a

[jira] [Updated] (HDFS-13205) Incorrect path is passed to checkPermission during authorization of file under a snapshot (specifically under a subdir) after original subdir is deleted

2018-02-28 Thread Raghavender Rao Guruvannagari (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghavender Rao Guruvannagari updated HDFS-13205: - Description: Steps to reproduce the issue. +As 'hdfs' superuser+

[jira] [Created] (HDFS-13205) Incorrect path is passed to checkPermission during authorization of file under a snapshot (specifically under a subdir) after original subdir is deleted

2018-02-28 Thread Raghavender Rao Guruvannagari (JIRA)
Raghavender Rao Guruvannagari created HDFS-13205: Summary: Incorrect path is passed to checkPermission during authorization of file under a snapshot (specifically under a subdir) after original subdir is deleted

[jira] [Commented] (HDFS-13171) Handle Deletion of nodes in SnasphotSkipList

2018-02-28 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380363#comment-16380363 ] Shashikant Banerjee commented on HDFS-13171: Patch v0 is dependent on HDFS-13102. Not

[jira] [Updated] (HDFS-13171) Handle Deletion of nodes in SnasphotSkipList

2018-02-28 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13171: --- Attachment: HDFS-13171.000.patch > Handle Deletion of nodes in SnasphotSkipList >

[jira] [Commented] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

2018-02-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380254#comment-16380254 ] genericqa commented on HDFS-13102: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13141) WebHDFS: Add support for getting snasphottable directory list

2018-02-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380252#comment-16380252 ] genericqa commented on HDFS-13141: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-02-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380222#comment-16380222 ] genericqa commented on HDFS-13166: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380179#comment-16380179 ] He Xiaoqiao commented on HDFS-12749: ping [~xkrogen],[~kihwal] any suggestions or feedback for this

[jira] [Commented] (HDFS-13204) RBF: optimize name service safe mode icon

2018-02-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380162#comment-16380162 ] genericqa commented on HDFS-13204: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-13204) RBF: optimize name service safe mode icon

2018-02-28 Thread tartarus (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380156#comment-16380156 ] tartarus commented on HDFS-13204: - LGTM > RBF: optimize name service safe mode icon >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380139#comment-16380139 ] He Xiaoqiao commented on HDFS-13183: [~xkrogen] Thanks for your detailed comments, and sorry for slow

[jira] [Updated] (HDFS-13204) RBF: optimize name service safe mode icon

2018-02-28 Thread liuhongtong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuhongtong updated HDFS-13204: --- Status: Patch Available (was: Open) > RBF: optimize name service safe mode icon >

[jira] [Updated] (HDFS-13204) RBF: optimize name service safe mode icon

2018-02-28 Thread liuhongtong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuhongtong updated HDFS-13204: --- Attachment: HDFS-13204.001.patch > RBF: optimize name service safe mode icon >

[jira] [Updated] (HDFS-13204) RBF: optimize name service safe mode icon

2018-02-28 Thread liuhongtong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuhongtong updated HDFS-13204: --- Description: In federation health webpage, the safe mode icons of Subclusters and Routers are 

[jira] [Updated] (HDFS-13204) RBF: optimize name service safe mode icon

2018-02-28 Thread liuhongtong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuhongtong updated HDFS-13204: --- Description: In federation health webpage, the safe mode icons of Subclusters and Routers are 

  1   2   >