[jira] [Commented] (HDFS-3370) HDFS hardlink

[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396592#comment-13396592 ] Lars Hofhansl commented on HDFS-3370: - Hardlinks would be used for temporary snapshotti

[jira] [Created] (HDFS-3545) DFSClient leak due to malfunctioning of FileSystem Cache

amith created HDFS-3545: --- Summary: DFSClient leak due to malfunctioning of FileSystem Cache Key: HDFS-3545 URL: https://issues.apache.org/jira/browse/HDFS-3545 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-3545) DFSClient leak due to malfunctioning of FileSystem Cache

[ https://issues.apache.org/jira/browse/HDFS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396677#comment-13396677 ] amith commented on HDFS-3545: - Reference in MR https://issues.apache.org/jira/browse/MAPREDUCE-

[jira] [Commented] (HDFS-3526) Standy NameNode is entering into Safemode even after HDFS-2914 due to resources low

[ https://issues.apache.org/jira/browse/HDFS-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396712#comment-13396712 ] Vinay commented on HDFS-3526: - {noformat}-1 javadoc. The javadoc tool appears to have generated

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396764#comment-13396764 ] Ashish Singhi commented on HDFS-3157: - Thanks a lot Nicholas for your time and reviewin

[jira] [Commented] (HDFS-3370) HDFS hardlink

[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396769#comment-13396769 ] Daryn Sharp commented on HDFS-3370: --- I understand hardlinks likely aren't meant to be. H

[jira] [Commented] (HDFS-3541) Deadlock between recovery, xceiver and packet responder

[ https://issues.apache.org/jira/browse/HDFS-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396850#comment-13396850 ] Kihwal Lee commented on HDFS-3541: -- With the proposed fix, the DataXceiver thread would br

[jira] [Updated] (HDFS-3545) DFSClient leak due to malfunctioning of FileSystem Cache

[ https://issues.apache.org/jira/browse/HDFS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] amith updated HDFS-3545: Priority: Critical (was: Major) > DFSClient leak due to malfunctioning of FileSystem Cache > --

[jira] [Commented] (HDFS-3545) DFSClient leak due to malfunctioning of FileSystem Cache

[ https://issues.apache.org/jira/browse/HDFS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396896#comment-13396896 ] amith commented on HDFS-3545: - Currently to fix this defect, we need to get the FileSystem obje

[jira] [Commented] (HDFS-3545) DFSClient leak due to malfunctioning of FileSystem Cache

[ https://issues.apache.org/jira/browse/HDFS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396963#comment-13396963 ] Daryn Sharp commented on HDFS-3545: --- I've looked into "fixing" this problem too, but I do

[jira] [Commented] (HDFS-2617) Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution

[ https://issues.apache.org/jira/browse/HDFS-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396957#comment-13396957 ] Kihwal Lee commented on HDFS-2617: -- I wish the hftp part was done in a backward-compatible

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396962#comment-13396962 ] Suresh Srinivas commented on HDFS-3425: --- Quick comment (have not looked at either of

[jira] [Commented] (HDFS-3370) HDFS hardlink

[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396961#comment-13396961 ] Jesse Yates commented on HDFS-3370: --- Maybe I'm missing something here... bq. Backup itse

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397014#comment-13397014 ] Brandon Li commented on HDFS-3425: -- Todd, Thanks for explaining your approach in details.

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397029#comment-13397029 ] Todd Lipcon commented on HDFS-3425: --- My plan is the following (similar to what you said:)

[jira] [Commented] (HDFS-3370) HDFS hardlink

[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397040#comment-13397040 ] Sanjay Radia commented on HDFS-3370: > ... hard links .. are very hard to support when

[jira] [Commented] (HDFS-3370) HDFS hardlink

[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397049#comment-13397049 ] Sanjay Radia commented on HDFS-3370: We should consider two kinds of hard-links: normal

[jira] [Updated] (HDFS-3521) Allow namenode to tolerate edit log corruption

[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-3521: -- Fix Version/s: (was: 1.2.0) 1.1.0 > Allow namenode to tolerate edit log corruption >

[jira] [Commented] (HDFS-3522) If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations

[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397059#comment-13397059 ] Brandon Li commented on HDFS-3522: -- Test patch result for the patch to branch-1. The findb

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397068#comment-13397068 ] Brandon Li commented on HDFS-3425: -- Todd, I think you are right. When can you commit your

[jira] [Created] (HDFS-3546) Link to authentiation doc from the WebHDFS doc

Tsz Wo (Nicholas), SZE created HDFS-3546: Summary: Link to authentiation doc from the WebHDFS doc Key: HDFS-3546 URL: https://issues.apache.org/jira/browse/HDFS-3546 Project: Hadoop HDFS

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397099#comment-13397099 ] Todd Lipcon commented on HDFS-3425: --- bq. Todd, I think you are right. When can you commit

[jira] [Commented] (HDFS-3522) If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations

[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397104#comment-13397104 ] Brandon Li commented on HDFS-3522: -- test-patch result for the patch to branch-1.0. The fin

[jira] [Commented] (HDFS-3510) Fix FSEditLog pre-allocation

[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397117#comment-13397117 ] Suresh Srinivas commented on HDFS-3510: --- Thanks for adding description of the solutio

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397124#comment-13397124 ] Brandon Li commented on HDFS-3425: -- {quote}Yes, we need to also do the work so that the 2N

[jira] [Updated] (HDFS-3510) Improve FSEditLog pre-allocation

[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3510: --- Description: It is good to avoid running out of space in the middle of writing a batch

[jira] [Commented] (HDFS-3510) Improve FSEditLog pre-allocation

[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397130#comment-13397130 ] Colin Patrick McCabe commented on HDFS-3510: bq. 1. Please retain the pre-alloc

[jira] [Commented] (HDFS-2617) Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution

[ https://issues.apache.org/jira/browse/HDFS-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397138#comment-13397138 ] Allen Wittenauer commented on HDFS-2617: Why doesn't WebHDFS work? It is supported

[jira] [Commented] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397212#comment-13397212 ] Tsz Wo (Nicholas), SZE commented on HDFS-3498: -- Questions: - How are you going

[jira] [Commented] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397230#comment-13397230 ] Junping Du commented on HDFS-3498: -- Hey Nicholas, Just update patch in HADOOP-8472 whic

[jira] [Updated] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Attachment: HDFS-3498-v2.patch Add replica removal test in TestReplicationPolicy which seems missing befor

[jira] [Commented] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397253#comment-13397253 ] Hadoop QA commented on HDFS-3498: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397256#comment-13397256 ] Junping Du commented on HDFS-3498: -- Nicholas, I will address naming enhancement when recei

[jira] [Commented] (HDFS-3541) Deadlock between recovery, xceiver and packet responder

[ https://issues.apache.org/jira/browse/HDFS-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397263#comment-13397263 ] Vinay commented on HDFS-3541: - Hi Lee, I agree your suggestion. But as of now there is no sugge

[jira] [Commented] (HDFS-3541) Deadlock between recovery, xceiver and packet responder

[ https://issues.apache.org/jira/browse/HDFS-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397265#comment-13397265 ] Vinay commented on HDFS-3541: - {quote}But as of now there is no way to stop the PacketResponder