[jira] [Reopened] (HDFS-257) Does a big delete starve other clients?

2014-07-21 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar reopened HDFS-257: Yes, it does. Reopening. Does a big delete starve other clients?

[jira] [Commented] (HDFS-6710) Archival Storage: Consider block storage policy in replica deletion

2014-07-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068254#comment-14068254 ] Vinayakumar B commented on HDFS-6710: - Patch looks good. Nit: I can see trailing

[jira] [Commented] (HDFS-6676) KMS throws AuthenticationException when enabling kerberos authentication

2014-07-21 Thread liyunzhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068314#comment-14068314 ] liyunzhang commented on HDFS-6676: -- you can enable kerberos http spnego authentication of

[jira] [Resolved] (HDFS-6676) KMS throws AuthenticationException when enabling kerberos authentication

2014-07-21 Thread liyunzhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang resolved HDFS-6676. -- Resolution: Not a Problem KMS throws AuthenticationException when enabling kerberos authentication

[jira] [Commented] (HDFS-6637) Rolling upgrade won't finish if SBN is configured without StandbyCheckpointer

2014-07-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068350#comment-14068350 ] Vinayakumar B commented on HDFS-6637: - I think, the configuration

[jira] [Updated] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6698: Attachment: HDFS-6698.txt try to optimize DFSInputStream.getFileLength()

[jira] [Updated] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6698: Status: Patch Available (was: Open) try to optimize DFSInputStream.getFileLength()

[jira] [Commented] (HDFS-6637) Rolling upgrade won't finish if SBN is configured without StandbyCheckpointer

2014-07-21 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068353#comment-14068353 ] Dian Fu commented on HDFS-6637: --- Thanks very much for the comments, Vinay. The explanation

[jira] [Created] (HDFS-6714) TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster

2014-07-21 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-6714: --- Summary: TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster Key: HDFS-6714 URL: https://issues.apache.org/jira/browse/HDFS-6714 Project:

[jira] [Updated] (HDFS-6714) TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster

2014-07-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6714: Attachment: HDFS-6714.patch Attached the patch. Please review

[jira] [Updated] (HDFS-6714) TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster

2014-07-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6714: Status: Patch Available (was: Open) TestBlocksScheduledCounter#testBlocksScheduledCounter should

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068361#comment-14068361 ] Liang Xie commented on HDFS-6698: - In normal situation, The HFiles which all of HBase

[jira] [Updated] (HDFS-6637) Rolling upgrade won't finish if SBN is configured without StandbyCheckpointer

2014-07-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6637: Resolution: Invalid Status: Resolved (was: Patch Available) Thanks [~dian.fu], Making this

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-21 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068447#comment-14068447 ] Yu Li commented on HDFS-6441: - Hi [~szetszwo] [~aagarwal] and [~benoyantony], Sorry for the

[jira] [Commented] (HDFS-6702) DFSClient should create blocks using StorageType

2014-07-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068456#comment-14068456 ] Vinayakumar B commented on HDFS-6702: - Patch looks good One nit. {code} +final

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068461#comment-14068461 ] Hadoop QA commented on HDFS-6698: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068467#comment-14068467 ] Liang Xie commented on HDFS-6698: - Those three failure cases are not related with current

[jira] [Commented] (HDFS-6714) TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068470#comment-14068470 ] Hadoop QA commented on HDFS-6714: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6702) DFSClient should create blocks using StorageType

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068496#comment-14068496 ] Tsz Wo Nicholas Sze commented on HDFS-6702: --- Thanks Vinay. I do have new

[jira] [Updated] (HDFS-6710) Archival Storage: Consider block storage policy in replica deletion

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6710: -- Attachment: h6710_20140721.patch h6710_20140721.patch: removes trailing spaces.

[jira] [Resolved] (HDFS-6710) Archival Storage: Consider block storage policy in replica deletion

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-6710. --- Resolution: Fixed Hadoop Flags: Reviewed Thank Vinay for reviewing the patch.

[jira] [Updated] (HDFS-6679) Archival Storage: Bump NameNodeLayoutVersion and update editsStored test files

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6679: -- Hadoop Flags: Reviewed +1 patch looks good. Archival Storage: Bump

[jira] [Resolved] (HDFS-6679) Archival Storage: Bump NameNodeLayoutVersion and update editsStored test files

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-6679. --- Resolution: Fixed Fix Version/s: Archival Storage (HDFS-6584) I have committed

[jira] [Updated] (HDFS-6710) Archival Storage: Consider block storage policy in replica deletion

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6710: -- Fix Version/s: Archival Storage (HDFS-6584) Archival Storage: Consider block storage

[jira] [Updated] (HDFS-6686) Archival Storage: Use fallback storage types

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6686: -- Attachment: h6710_20140721.patch Vinay, you are right that the patch depends on

[jira] [Commented] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

2014-07-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068635#comment-14068635 ] Steve Loughran commented on HDFS-49: nope, [Still

[jira] [Resolved] (HDFS-169) dfshealth.jsp: sorting on remaining doesn't actually sort

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-169. --- Resolution: Incomplete hdfs gui has been rewritten. closing as stale. dfshealth.jsp: sorting

[jira] [Commented] (HDFS-2251) Namenode does not recognize incorrectly sized blocks

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068749#comment-14068749 ] Allen Wittenauer commented on HDFS-2251: Despite Brian saying that we could close

[jira] [Resolved] (HDFS-867) Add a PowerTopology class to aid replica placement and enhance availability of blocks

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-867. --- Resolution: Fixed I'm going to close this as fixed: using either a multi-level topology or

[jira] [Commented] (HDFS-333) A State Machine for name-node blocks.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068760#comment-14068760 ] Allen Wittenauer commented on HDFS-333: --- Given the changes with HA, etc, I wonder if

[jira] [Resolved] (HDFS-201) Spring and OSGi support

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-201. --- Resolution: Duplicate Spring and OSGi support --- Key:

[jira] [Updated] (HDFS-331) hadoop fsck should ignore lost+found

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-331: -- Labels: newbie (was: ) hadoop fsck should ignore lost+found

[jira] [Commented] (HDFS-6446) NFS: Different error messages for appending/writing data from read only mount

2014-07-21 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068789#comment-14068789 ] Yesha Vora commented on HDFS-6446: -- [~abutala], The issue was not tested for trunk. It was

[jira] [Resolved] (HDFS-48) NN should check a block's length even if the block is not a new block when processing a blockreport

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-48?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-48. -- Resolution: Duplicate I'm going to close this as a dupe of HDFS-2251. NN should check a block's

[jira] [Updated] (HDFS-425) fuse has major performance drop on slower machines

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-425: -- Summary: fuse has major performance drop on slower machines (was: Major performance drop on

[jira] [Resolved] (HDFS-221) Trigger block scans for datanode

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-221. --- Resolution: Duplicate I'm going to close this a dupe of HDFS-366. Trigger block scans for

[jira] [Commented] (HDFS-366) Support manually fsck in DataNode

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068838#comment-14068838 ] Allen Wittenauer commented on HDFS-366: --- I wonder how this works in a post-security

[jira] [Commented] (HDFS-166) NameNode#invalidateBlock's requirement on more than 1 valid replica exists before scheduling a replica to delete is too strict

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068861#comment-14068861 ] Allen Wittenauer commented on HDFS-166: --- Ping! I bet this has been fixed.

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-21 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068869#comment-14068869 ] Benoy Antony commented on HDFS-6441: Thanks [~carp84], [~szetszwo] and [~arpitagarwal].

[jira] [Commented] (HDFS-6680) BlockPlacementPolicyDefault does not choose favored nodes correctly

2014-07-21 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068895#comment-14068895 ] Devaraj Das commented on HDFS-6680: --- I am not sure if that loop needs to change. Seems to

[jira] [Commented] (HDFS-6570) add api that enables checking if a user has certain permissions on a file

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068894#comment-14068894 ] Colin Patrick McCabe commented on HDFS-6570: bq. acl.proto: I'm not sure it's

[jira] [Commented] (HDFS-313) Threads in servers should not die silently.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068896#comment-14068896 ] Allen Wittenauer commented on HDFS-313: --- This probably needs to get revisited so

[jira] [Resolved] (HDFS-89) Datanode should verify block sizes vs metadata on startup

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-89?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-89. -- Resolution: Duplicate Not only was it previously reported Brian, it was done by you! :D Closing

[jira] [Resolved] (HDFS-215) Offline Namenode fsImage verification

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-215. --- Resolution: Fixed As Jakob points out, oiv does this. Closing as fixed. Offline Namenode

[jira] [Commented] (HDFS-275) FSNamesystem should have an InvalidateBlockMap class to manage blocks scheduled to remove

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068913#comment-14068913 ] Allen Wittenauer commented on HDFS-275: --- I'm going to link these, since they seem like

[jira] [Updated] (HDFS-207) add querying block's info in the fsck facility

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-207: -- Component/s: namenode add querying block's info in the fsck facility

[jira] [Commented] (HDFS-207) add querying block's info in the fsck facility

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068919#comment-14068919 ] Allen Wittenauer commented on HDFS-207: --- Ping! add querying block's info in the fsck

[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068935#comment-14068935 ] Colin Patrick McCabe commented on HDFS-6707: Good find, Yongjun. Parsing the

[jira] [Commented] (HDFS-6570) add api that enables checking if a user has certain permissions on a file

2014-07-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068931#comment-14068931 ] Chris Nauroth commented on HDFS-6570: - Thanks, Colin. add api that enables checking

[jira] [Commented] (HDFS-6701) Make seed optional in NetworkTopology#sortByDistance

2014-07-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068943#comment-14068943 ] Andrew Wang commented on HDFS-6701: --- Hi Ashwin, Just a nitty thing, otherwise +1:

[jira] [Resolved] (HDFS-118) Namenode clients should recover from connection or Namenode restarts

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-118. --- Resolution: Fixed HA! As in highly available has been added to the NN which helps mitigate

[jira] [Commented] (HDFS-125) Consistency of different replicas of the same block is not checked.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068950#comment-14068950 ] Allen Wittenauer commented on HDFS-125: --- This feels like a special case of the

[jira] [Comment Edited] (HDFS-125) Consistency of different replicas of the same block is not checked.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068950#comment-14068950 ] Allen Wittenauer edited comment on HDFS-125 at 7/21/14 6:12 PM:

[jira] [Commented] (HDFS-6455) NFS: Exception should be added in NFS log for invalid separator in allowed.hosts

2014-07-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068962#comment-14068962 ] Brandon Li commented on HDFS-6455: -- Thank you, [~abutala]. The patch looks good. It would

[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem

2014-07-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068965#comment-14068965 ] Yongjun Zhang commented on HDFS-6707: - HI Colin, thanks for the comments. Same feelings

[jira] [Updated] (HDFS-327) DataNode should warn about unknown files in storage

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-327: -- Labels: newbie (was: ) DataNode should warn about unknown files in storage

[jira] [Updated] (HDFS-327) DataNode should warn about unknown files in storage

2014-07-21 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-327: - Assignee: (was: Jakob Homan) DataNode should warn about unknown files in storage

[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068990#comment-14068990 ] Colin Patrick McCabe commented on HDFS-6707: +1 once you add a unit test to

[jira] [Updated] (HDFS-286) Move Datanode packet IO logging to its own log

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-286: -- Labels: newbie (was: ) Move Datanode packet IO logging to its own log

[jira] [Commented] (HDFS-6706) ZKFailoverController failed to recognize the quorum is not met

2014-07-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069031#comment-14069031 ] Brandon Li commented on HDFS-6706: -- With further investigation, we found this is due to a

[jira] [Updated] (HDFS-6703) NFS: Files can be deleted from a read-only mount

2014-07-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6703: - Affects Version/s: (was: 2.6.0) 2.2.0 NFS: Files can be deleted from a

[jira] [Updated] (HDFS-6703) NFS: Files can be deleted from a read-only mount

2014-07-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6703: - Affects Version/s: 2.6.0 NFS: Files can be deleted from a read-only mount

[jira] [Resolved] (HDFS-6706) ZKFailoverController failed to recognize the quorum is not met

2014-07-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-6706. -- Resolution: Invalid ZKFailoverController failed to recognize the quorum is not met

[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem

2014-07-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069032#comment-14069032 ] Yongjun Zhang commented on HDFS-6707: - Thanks Colin, will do! Intermittent failure

[jira] [Commented] (HDFS-6680) BlockPlacementPolicyDefault does not choose favored nodes correctly

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069061#comment-14069061 ] Tsz Wo Nicholas Sze commented on HDFS-6680: --- {code} - for (int i = 0; i

[jira] [Updated] (HDFS-301) Provide better error messages when fs.default.name is invalid

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-301: -- Labels: newbie (was: ) Provide better error messages when fs.default.name is invalid

[jira] [Commented] (HDFS-196) File length not reported correctly after application crash

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069093#comment-14069093 ] Allen Wittenauer commented on HDFS-196: --- Ping! I'm tempted to close this as stale,

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069099#comment-14069099 ] Tsz Wo Nicholas Sze commented on HDFS-6441: --- [~benoyantony], you may simply use

[jira] [Commented] (HDFS-402) Display the server version in dfsadmin -report

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069096#comment-14069096 ] Allen Wittenauer commented on HDFS-402: --- Is this still a viable idea, especially as we

[jira] [Resolved] (HDFS-196) File length not reported correctly after application crash

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-196. -- Resolution: Not a Problem sync() does not update the length in NN. So getFileSatus()

[jira] [Commented] (HDFS-196) File length not reported correctly after application crash

2014-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069112#comment-14069112 ] Tsz Wo Nicholas Sze commented on HDFS-196: -- ... getFileSatus() will return the

[jira] [Updated] (HDFS-219) Add md5sum facility in dfsshell

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-219: -- Labels: newbie (was: ) Add md5sum facility in dfsshell ---

[jira] [Commented] (HDFS-374) HDFS needs to support a very large number of open files.

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069139#comment-14069139 ] Colin Patrick McCabe commented on HDFS-374: --- oh, and also, using short-circuit

[jira] [Commented] (HDFS-374) HDFS needs to support a very large number of open files.

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069136#comment-14069136 ] Colin Patrick McCabe commented on HDFS-374: --- This is less of an issue than it once

[jira] [Resolved] (HDFS-405) Several unit tests failing on Windows frequently

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-405. --- Resolution: Fixed Closing as stale. Several unit tests failing on Windows frequently

[jira] [Commented] (HDFS-402) Display the server version in dfsadmin -report

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069176#comment-14069176 ] Hadoop QA commented on HDFS-402: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-465) in branch-1, libhdfs makes jni lib calls after setting errno in some places

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069184#comment-14069184 ] Colin Patrick McCabe commented on HDFS-465: --- Yeah. This was fixed in HDFS-3579.

[jira] [Resolved] (HDFS-332) hadoop fs -put should return different code for different failures

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-332. --- Resolution: Won't Fix Returning -1 for failure at the shell is pretty normal. Won't fix.

[jira] [Commented] (HDFS-97) DFS should detect slow links(nodes) and avoid them

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069192#comment-14069192 ] Colin Patrick McCabe commented on HDFS-97: -- This is also related to hedged reads.

[jira] [Commented] (HDFS-6706) ZKFailoverController failed to recognize the quorum is not met

2014-07-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069226#comment-14069226 ] Yongjun Zhang commented on HDFS-6706: - HI [~brandonli], Thanks for reporting and

[jira] [Commented] (HDFS-6696) Name node cannot start if the path of a file under construction contains .snapshot

2014-07-21 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069235#comment-14069235 ] Mit Desai commented on HDFS-6696: - [~andrew.wang], we were trying to upgrade 0.21.11 to

[jira] [Commented] (HDFS-6706) ZKFailoverController failed to recognize the quorum is not met

2014-07-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069247#comment-14069247 ] Brandon Li commented on HDFS-6706: -- [~yzhangal], I should have added more explanation. In

[jira] [Commented] (HDFS-333) A State Machine for name-node blocks.

2014-07-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069249#comment-14069249 ] Konstantin Shvachko commented on HDFS-333: -- It is still valid. It would formalize

[jira] [Commented] (HDFS-253) Method to retrieve all quotas active on HDFS

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069252#comment-14069252 ] Allen Wittenauer commented on HDFS-253: --- One of my favorite JIRAs. Still open! I

[jira] [Updated] (HDFS-253) Method to retrieve all quotas active on HDFS

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-253: -- Component/s: namenode Method to retrieve all quotas active on HDFS

[jira] [Updated] (HDFS-253) Method to retrieve all quotas active on HDFS

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-253: -- Labels: newbie (was: ) Method to retrieve all quotas active on HDFS

[jira] [Updated] (HDFS-6422) getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist

2014-07-21 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6422: --- Attachment: HDFS-6422.007.patch bq. logAuditEvent(false, getXAttr, src); -- logAuditEvent(false,

[jira] [Resolved] (HDFS-136) Not able to run randomwriter/sort on hdfs if all the nodes of same rack are killed.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-136. --- Resolution: Incomplete Probably stale. Not able to run randomwriter/sort on hdfs if all the

[jira] [Created] (HDFS-6715) webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode

2014-07-21 Thread Arpit Gupta (JIRA)
Arpit Gupta created HDFS-6715: - Summary: webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode Key: HDFS-6715 URL: https://issues.apache.org/jira/browse/HDFS-6715 Project:

[jira] [Updated] (HDFS-6715) webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6715: --- Component/s: webhdfs webhdfs wont fail over when it gets java.io.IOException: Namenode is in

[jira] [Commented] (HDFS-6680) BlockPlacementPolicyDefault does not choose favored nodes correctly

2014-07-21 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069320#comment-14069320 ] Devaraj Das commented on HDFS-6680: --- I see.. good catch. Looks good to me.

[jira] [Commented] (HDFS-279) Generation stamp value should be validated when creating a Block

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069331#comment-14069331 ] Allen Wittenauer commented on HDFS-279: --- Stale issue? Generation stamp value should

[jira] [Resolved] (HDFS-88) Hung on hdfs: writeChunk, DFSClient.java:2126, DataStreamer socketWrite

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-88?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-88. -- Resolution: Incomplete I'm going to close this as stale. I suspect this issue has gone away with

[jira] [Resolved] (HDFS-205) HDFS Tmpreaper

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-205. --- Resolution: Duplicate Closing this as a dupe of HDFS-6382. HDFS Tmpreaper --

[jira] [Commented] (HDFS-6716) Update usage of KeyProviderCryptoExtension APIs on NameNode

2014-07-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069355#comment-14069355 ] Andrew Wang commented on HDFS-6716: --- I'll add that this is somewhat urgent, as I simply

[jira] [Created] (HDFS-6716) Update usage of KeyProviderCryptoExtension APIs on NameNode

2014-07-21 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6716: - Summary: Update usage of KeyProviderCryptoExtension APIs on NameNode Key: HDFS-6716 URL: https://issues.apache.org/jira/browse/HDFS-6716 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-351) Could FSEditLog report problems more elegantly than with System.exit(-1)

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-351. --- Resolution: Incomplete edits logging got majorly reworked. closing as stale. Could FSEditLog

[jira] [Resolved] (HDFS-197) du fails on Cygwin

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-197. --- Resolution: Fixed MS has fixed Windows support. Closing as stale. du fails on Cygwin

[jira] [Commented] (HDFS-346) Version file in name-node image directory should include role field.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069384#comment-14069384 ] Allen Wittenauer commented on HDFS-346: --- Is this still valid? Actually, what would be

[jira] [Commented] (HDFS-308) Improve TransferFsImage

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069385#comment-14069385 ] Allen Wittenauer commented on HDFS-308: --- I seem to recall this got reworked, but I'm

  1   2   >