[jira] [Commented] (HDFS-6518) TestCacheDirectives#testExceedsCapacity fails intermittently

2014-06-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030330#comment-14030330 ] Yongjun Zhang commented on HDFS-6518: - HI [~andrew.wang], thanks for looking into this

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Tags: dfsadmin Target Version/s: 3.0.0, 2.5.0 (was: 3.0.0) Status: Patch Ava

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.1.patch Attached initial version of the implementation. > Improve DFSAdmin to suppo

[jira] [Updated] (HDFS-4667) Capture renamed files/directories in snapshot diff report

2014-06-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4667: Attachment: HDFS-4667.003.patch Update the patch to add several new unit tests and fix a bug for capturing t

[jira] [Created] (HDFS-6525) FsShell supports HDFS TTL

2014-06-13 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6525: Summary: FsShell supports HDFS TTL Key: HDFS-6525 URL: https://issues.apache.org/jira/browse/HDFS-6525 Project: Hadoop HDFS Issue Type: Sub-task Components

[jira] [Created] (HDFS-6526) Implement HDFS TtlManager

2014-06-13 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6526: Summary: Implement HDFS TtlManager Key: HDFS-6526 URL: https://issues.apache.org/jira/browse/HDFS-6526 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030366#comment-14030366 ] Zesheng Wu commented on HDFS-6382: -- I filed two sub-tasks to track the development of this

[jira] [Updated] (HDFS-6526) Implement HDFS TtlManager

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6526: - Description: This issue is used to track development of HDFS TtlManager, for details see HDFS-6382. (was:

[jira] [Commented] (HDFS-6524) chooseDataNode decides retry times considering with block replica number

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030374#comment-14030374 ] Hadoop QA commented on HDFS-6524: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6518) TestCacheDirectives#testExceedsCapacity fails intermittently

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030412#comment-14030412 ] Hadoop QA commented on HDFS-6518: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6524) chooseDataNode decides retry times considering with block replica number

2014-06-13 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6524: Attachment: HDFS-6524.txt > chooseDataNode decides retry times considering with block replica number > -

[jira] [Updated] (HDFS-6524) chooseDataNode decides retry times considering with block replica number

2014-06-13 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6524: Attachment: (was: HDFS-6524.txt) > chooseDataNode decides retry times considering with block replica num

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030481#comment-14030481 ] Hadoop QA commented on HDFS-6507: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030507#comment-14030507 ] Zesheng Wu commented on HDFS-6507: -- Mmm, seems that some test failed, I will figure it out

[jira] [Commented] (HDFS-4667) Capture renamed files/directories in snapshot diff report

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030511#comment-14030511 ] Hadoop QA commented on HDFS-4667: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6395) Skip checking xattr limits for non-user-visible namespaces

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030523#comment-14030523 ] Hudson commented on HDFS-6395: -- FAILURE: Integrated in Hadoop-Yarn-trunk #582 (See [https://b

[jira] [Commented] (HDFS-3493) Invalidate excess corrupted blocks as long as minimum replication is satisfied

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030529#comment-14030529 ] Hudson commented on HDFS-3493: -- FAILURE: Integrated in Hadoop-Yarn-trunk #582 (See [https://b

[jira] [Commented] (HDFS-6524) chooseDataNode decides retry times considering with block replica number

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030587#comment-14030587 ] Hadoop QA commented on HDFS-6524: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-06-13 Thread pascal oliva (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pascal oliva updated HDFS-4629: --- Attachment: HDFS-4629-1.patch Here the new patch from the trunk: i used openJDK 1.7 : java version "1.

[jira] [Created] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6527: Summary: Edit log corruption due to defered INode removal Key: HDFS-6527 URL: https://issues.apache.org/jira/browse/HDFS-6527 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-06-13 Thread pascal oliva (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030633#comment-14030633 ] pascal oliva commented on HDFS-4629: i added into the pach HDFS-4626-1 an update for h

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Status: Patch Available (was: Open) > Edit log corruption due to defered INode removal >

[jira] [Assigned] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-6527: Assignee: Kihwal Lee > Edit log corruption due to defered INode removal > --

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Attachment: HDFS-6527.trunk.patch HDFS-6527.branch-2.4.patch > Edit log corruption due to

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Affects Version/s: 2.3.0 > Edit log corruption due to defered INode removal >

[jira] [Commented] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-06-13 Thread pascal oliva (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030640#comment-14030640 ] pascal oliva commented on HDFS-4629: update from previous comment : i added into the pa

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Affects Version/s: (was: 2.3.0) > Edit log corruption due to defered INode removal > -

[jira] [Commented] (HDFS-6395) Skip checking xattr limits for non-user-visible namespaces

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030650#comment-14030650 ] Hudson commented on HDFS-6395: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1773 (See [https://

[jira] [Commented] (HDFS-3493) Invalidate excess corrupted blocks as long as minimum replication is satisfied

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030656#comment-14030656 ] Hudson commented on HDFS-3493: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1773 (See [https://

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030657#comment-14030657 ] Kihwal Lee commented on HDFS-6527: -- This bug has been there since 2.1.0-beta. It involves

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030701#comment-14030701 ] Daryn Sharp commented on HDFS-6527: --- Is it possible to avoid having fsdir up-call to the

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Description: We have seen a SBN crashing with the following error: {panel} \[Edit log tailer\] ERROR namen

[jira] [Commented] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-06-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030702#comment-14030702 ] Steve Loughran commented on HDFS-4629: -- there wasn't a dependency on xerces already?

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030707#comment-14030707 ] Kihwal Lee commented on HDFS-6527: -- Instead of moving inode removal inside lock, we could

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Status: Open (was: Patch Available) > Edit log corruption due to defered INode removal >

[jira] [Commented] (HDFS-6395) Skip checking xattr limits for non-user-visible namespaces

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030720#comment-14030720 ] Hudson commented on HDFS-6395: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1800 (See [htt

[jira] [Commented] (HDFS-3493) Invalidate excess corrupted blocks as long as minimum replication is satisfied

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030726#comment-14030726 ] Hudson commented on HDFS-3493: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1800 (See [htt

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.2.patch Fix breaked tests. > Improve DFSAdmin to support HA cluster better > --

[jira] [Commented] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030815#comment-14030815 ] Hadoop QA commented on HDFS-4629: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-13 Thread Stephen Chu (JIRA)
Stephen Chu created HDFS-6528: - Summary: Add XAttrs to TestOfflineImageViewer Key: HDFS-6528 URL: https://issues.apache.org/jira/browse/HDFS-6528 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-13 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6528: -- Attachment: HDFS-6528.001.patch > Add XAttrs to TestOfflineImageViewer > ---

[jira] [Updated] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-13 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6528: -- Status: Patch Available (was: Open) Small patch to make sure the fsimage tested in TestOfflineImageView

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Status: Patch Available (was: Open) > Edit log corruption due to defered INode removal >

[jira] [Commented] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030899#comment-14030899 ] Andrew Wang commented on HDFS-6528: --- Hey Stephen, correct me if I'm wrong, but doesn't de

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Attachment: HDFS-6527.v2.patch The new patch simply checks the parent of inode against null. This is done

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Status: Open (was: Patch Available) > Edit log corruption due to defered INode removal >

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Status: Patch Available (was: Open) > Edit log corruption due to defered INode removal >

[jira] [Updated] (HDFS-6470) TestBPOfferService.testBPInitErrorHandling is flaky

2014-06-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6470: -- Assignee: Ming Ma > TestBPOfferService.testBPInitErrorHandling is flaky > --

[jira] [Commented] (HDFS-6480) Move waitForReady() from FSDirectory to FSNamesystem

2014-06-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030924#comment-14030924 ] Haohui Mai commented on HDFS-6480: -- The v1 patch is rebased on to the current trunk. > Mo

[jira] [Updated] (HDFS-6480) Move waitForReady() from FSDirectory to FSNamesystem

2014-06-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6480: - Status: Patch Available (was: Open) > Move waitForReady() from FSDirectory to FSNamesystem >

[jira] [Updated] (HDFS-6480) Move waitForReady() from FSDirectory to FSNamesystem

2014-06-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6480: - Attachment: HDFS-6480.001.patch > Move waitForReady() from FSDirectory to FSNamesystem > -

[jira] [Updated] (HDFS-6330) Move mkdirs() to FSNamesystem

2014-06-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6330: - Resolution: Fixed Fix Version/s: 2.5.0 Hadoop Flags: Reviewed Status: Resolved (was

[jira] [Updated] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-13 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6528: -- Attachment: HDFS-6528.002.patch Thanks, Andrew. You're right. Uploaded a new patch that doesn't remove

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030944#comment-14030944 ] Jing Zhao commented on HDFS-6527: - Thanks for the fix, [~kihwal]! bq. The new patch simpl

[jira] [Updated] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-13 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6528: -- Attachment: HDFS-6528.003.patch Sorry, one last thing. Take out removal of an XAttr, as that step is rel

[jira] [Comment Edited] (HDFS-6330) Move mkdirs() to FSNamesystem

2014-06-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030925#comment-14030925 ] Jing Zhao edited comment on HDFS-6330 at 6/13/14 6:17 PM: -- I've co

[jira] [Commented] (HDFS-6470) TestBPOfferService.testBPInitErrorHandling is flaky

2014-06-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030960#comment-14030960 ] Andrew Wang commented on HDFS-6470: --- +1 makes sense to me, thanks Ming. Will commit short

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030978#comment-14030978 ] Hadoop QA commented on HDFS-6507: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6330) Move mkdirs() to FSNamesystem

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030988#comment-14030988 ] Hudson commented on HDFS-6330: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5702 (See [https:

[jira] [Commented] (HDFS-6480) Move waitForReady() from FSDirectory to FSNamesystem

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030994#comment-14030994 ] Hadoop QA commented on HDFS-6480: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6470) TestBPOfferService.testBPInitErrorHandling is flaky

2014-06-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6470: -- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch Available) Commit

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031018#comment-14031018 ] Steve Loughran commented on HDFS-6382: -- My comments # this can be done as an MR job.

[jira] [Commented] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031077#comment-14031077 ] Hadoop QA commented on HDFS-6528: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6470) TestBPOfferService.testBPInitErrorHandling is flaky

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031086#comment-14031086 ] Hudson commented on HDFS-6470: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5703 (See [https:

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031114#comment-14031114 ] Kihwal Lee commented on HDFS-6527: -- Thanks for the comment, [~jingzhao]. We can null out t

[jira] [Created] (HDFS-6529) Debug logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created HDFS-6529: --- Summary: Debug logging for RemoteBlockReader2 to identify remote datanode and file being read Key: HDFS-6529 URL: https://issues.apache.org/jira/browse/HDFS-6529 Projec

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031142#comment-14031142 ] Hadoop QA commented on HDFS-6527: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6529) Debug logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated HDFS-6529: Description: The scenario is some download is stuck and we dont know which data node is the client

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Attachment: HDFS-6527.v3.patch The new v3 patch implements what I suggested above. It nulls out the client

[jira] [Updated] (HDFS-6529) Debug logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated HDFS-6529: Status: Patch Available (was: Open) > Debug logging for RemoteBlockReader2 to identify remote datan

[jira] [Updated] (HDFS-6529) Debug logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated HDFS-6529: Attachment: HDFS-6529.patch Verified it compiles fine and ran some sample jobs that show logging hap

[jira] [Assigned] (HDFS-6529) Debug logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-6529: Assignee: Anubhav Dhoot > Debug logging for RemoteBlockReader2 to identify remote datanode a

[jira] [Updated] (HDFS-6529) Debug logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6529: - Target Version/s: 2.5.0 Affects Version/s: 2.4.0 > Debug logging for RemoteBlockReader2 to id

[jira] [Commented] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031199#comment-14031199 ] Hadoop QA commented on HDFS-6528: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-13 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031237#comment-14031237 ] Stephen Chu commented on HDFS-6528: --- The first test run was on the first rev of the patch

[jira] [Updated] (HDFS-6530) Fix Balancer documentation

2014-06-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6530: -- Attachment: h6530_20140613.patch h6530_20140613.patch: 1st patch. > Fix Balancer docume

[jira] [Created] (HDFS-6530) Fix Balancer documentation

2014-06-13 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-6530: - Summary: Fix Balancer documentation Key: HDFS-6530 URL: https://issues.apache.org/jira/browse/HDFS-6530 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6530) Fix Balancer documentation

2014-06-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031280#comment-14031280 ] Arpit Agarwal commented on HDFS-6530: - +1 for the patch. > Fix Balancer documentation

[jira] [Commented] (HDFS-6480) Move waitForReady() from FSDirectory to FSNamesystem

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031284#comment-14031284 ] Hadoop QA commented on HDFS-6480: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5546) race condition crashes "hadoop ls -R" when directories are moved/removed

2014-06-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-5546: Attachment: HDFS-5546.2.000.patch [~cmccabe] This new patch is just catching the FNF exception right

[jira] [Updated] (HDFS-6386) HDFS Encryption Zones

2014-06-13 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6386: --- Attachment: HDFS-6386.8.patch Andrew, Thanks for the detailed preliminary review. I agree with you th

[jira] [Commented] (HDFS-6529) Debug logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031345#comment-14031345 ] Aaron T. Myers commented on HDFS-6529: -- Patch looks fine to me. +1 pending Jenkins. >

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031346#comment-14031346 ] Hadoop QA commented on HDFS-6527: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6529) Debug logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031348#comment-14031348 ] Hadoop QA commented on HDFS-6529: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6530) Fix Balancer documentation

2014-06-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6530: -- Attachment: h6530_20140613b.patch h6530_20140613b.patch: slightly improves the doc. > F

[jira] [Commented] (HDFS-6529) Debug logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031375#comment-14031375 ] Aaron T. Myers commented on HDFS-6529: -- No tests are needed since this is a logging-on

[jira] [Updated] (HDFS-6529) Trace logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6529: - Summary: Trace logging for RemoteBlockReader2 to identify remote datanode and file being read (wa

[jira] [Updated] (HDFS-6529) Trace logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6529: - Resolution: Fixed Fix Version/s: 2.5.0 Hadoop Flags: Reviewed Status: Resolv

[jira] [Commented] (HDFS-6529) Trace logging for RemoteBlockReader2 to identify remote datanode and file being read

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031382#comment-14031382 ] Hudson commented on HDFS-6529: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5705 (See [https:

[jira] [Commented] (HDFS-6499) can't tell why FileJournalManager's call to java.io.File.renameTo() fails

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031387#comment-14031387 ] Aaron T. Myers commented on HDFS-6499: -- The latest patch looks pretty good to me. One

[jira] [Updated] (HDFS-6403) Add metrics for log warnings reported by JVM pauses

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6403: - Target Version/s: 2.5.0 Summary: Add metrics for log warnings reported by JVM pauses

[jira] [Commented] (HDFS-6499) can't tell why FileJournalManager's call to java.io.File.renameTo() fails

2014-06-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031399#comment-14031399 ] Yongjun Zhang commented on HDFS-6499: - Thanks a lot ATM! I'd prefer committing it now

[jira] [Commented] (HDFS-6499) can't tell why FileJournalManager's call to java.io.File.renameTo() fails

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031405#comment-14031405 ] Aaron T. Myers commented on HDFS-6499: -- OK then, I'll commit this momentarily. > can'

[jira] [Updated] (HDFS-6499) Use NativeIO#renameTo instead of File#renameTo in FileJournalManager

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6499: - Summary: Use NativeIO#renameTo instead of File#renameTo in FileJournalManager (was: can't tell wh

[jira] [Updated] (HDFS-6499) Use NativeIO#renameTo instead of File#renameTo in FileJournalManager

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6499: - Resolution: Fixed Fix Version/s: 2.5.0 Hadoop Flags: Reviewed Status: Resolv

[jira] [Commented] (HDFS-6499) Use NativeIO#renameTo instead of File#renameTo in FileJournalManager

2014-06-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031411#comment-14031411 ] Yongjun Zhang commented on HDFS-6499: - Many thanks ATM! I just filed HDFS-6531 as a fol

[jira] [Created] (HDFS-6531) Create a native api to delete file, like the renameTo method in NativeIO, for better error reporting

2014-06-13 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-6531: --- Summary: Create a native api to delete file, like the renameTo method in NativeIO, for better error reporting Key: HDFS-6531 URL: https://issues.apache.org/jira/browse/HDFS-6531

[jira] [Commented] (HDFS-6499) Use NativeIO#renameTo instead of File#renameTo in FileJournalManager

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031413#comment-14031413 ] Hudson commented on HDFS-6499: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5706 (See [https:

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031415#comment-14031415 ] Aaron T. Myers commented on HDFS-6475: -- The latest patch looks pretty good to me. Two

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031461#comment-14031461 ] Yongjun Zhang commented on HDFS-6475: - Hi ATM, Thanks a lot for the review! Sorry I di

  1   2   >