[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433906#comment-13433906 ] Hadoop QA commented on HDFS-3788: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3801) Provide a way to disable browsing of files from the web UI

2012-08-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433896#comment-13433896 ] Suresh Srinivas commented on HDFS-3801: --- bq. we've had requests from users who wish t

[jira] [Updated] (HDFS-3801) Provide a way to disable browsing of files from the web UI

2012-08-13 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-3801: -- Summary: Provide a way to disable browsing of files from the web UI (was: Provide a way to disable browsing of

[jira] [Updated] (HDFS-3763) TestNameNodeMXBean fails on Windows

2012-08-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3763: -- Fix Version/s: 1-win > TestNameNodeMXBean fails on Windows > ---

[jira] [Resolved] (HDFS-3766) Fix TestStorageRestore on Windows

2012-08-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-3766. --- Resolution: Fixed Fix Version/s: 1-win Hadoop Flags: Reviewed I committed the patc

[jira] [Updated] (HDFS-3766) Fix TestStorageRestore on Windows

2012-08-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3766: -- Summary: Fix TestStorageRestore on Windows (was: Release stream and storage directory for remov

[jira] [Resolved] (HDFS-3763) TestNameNodeMXBean fails on Windows

2012-08-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-3763. --- Resolution: Fixed Hadoop Flags: Reviewed I committed the patch. Thank you Brandon.

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-13 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433886#comment-13433886 ] Tsz Wo (Nicholas), SZE commented on HDFS-3788: -- Do you mean "fs -get"? No way

[jira] [Created] (HDFS-3801) Provide a way to disable browsing of the files from the web UI

2012-08-13 Thread Harsh J (JIRA)
Harsh J created HDFS-3801: - Summary: Provide a way to disable browsing of the files from the web UI Key: HDFS-3801 URL: https://issues.apache.org/jira/browse/HDFS-3801 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-3763) TestNameNodeMXBean fails on Windows

2012-08-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433882#comment-13433882 ] Suresh Srinivas commented on HDFS-3763: --- +1 for the patch. > TestNam

[jira] [Commented] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433881#comment-13433881 ] Tsz Wo (Nicholas), SZE commented on HDFS-3794: -- Took a second look at the patc

[jira] [Commented] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433878#comment-13433878 ] Ravi Prakash commented on HDFS-3794: Thanks a lot Nicholas! Could you please commit the

[jira] [Commented] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433875#comment-13433875 ] Tsz Wo (Nicholas), SZE commented on HDFS-3794: -- The findbugs warnings and the

[jira] [Updated] (HDFS-3150) Add option for clients to contact DNs via hostname

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3150: -- Attachment: hdfs-3150.txt Updated patch attached. > Add option for clients to contact D

[jira] [Commented] (HDFS-3150) Add option for clients to contact DNs via hostname

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433869#comment-13433869 ] Eli Collins commented on HDFS-3150: --- @Daryn, On the client side it requires you configure

[jira] [Updated] (HDFS-3048) Small race in BlockManager#close

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3048: -- Attachment: hdfs-3787-2.txt Posting the patch from HDFS-3787 since that jira seems broken.

[jira] [Updated] (HDFS-3048) Small race in BlockManager#close

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3048: -- Target Version/s: 2.2.0-alpha (was: 0.23.3) Affects Version/s: (was: 0.23.2)

[jira] [Assigned] (HDFS-3048) Small race in BlockManager#close

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3048: - Assignee: Andy Isaacson (was: Eli Collins) > Small race in BlockManager#close > -

[jira] [Reopened] (HDFS-3048) Small race in BlockManager#close

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reopened HDFS-3048: --- > Small race in BlockManager#close > > > Key: HDFS-30

[jira] [Updated] (HDFS-3658) TestDFSClientRetries#testNamenodeRestart failed

2012-08-13 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3658: - Hadoop Flags: Reviewed Summary: TestDFSClientRetries#testNamenodeRestart f

[jira] [Updated] (HDFS-3658) TestDFSClientRetries#testNamenodeRestart failed

2012-08-13 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3658: - Resolution: Fixed Fix Version/s: 2.1.0-alpha 1.2.0

[jira] [Commented] (HDFS-3150) Add option for clients to contact DNs via hostname

2012-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433851#comment-13433851 ] Hadoop QA commented on HDFS-3150: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433849#comment-13433849 ] Eli Collins commented on HDFS-3788: --- Note that a get of a 3gb file works but not distcp,

[jira] [Commented] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433841#comment-13433841 ] Hadoop QA commented on HDFS-3796: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433839#comment-13433839 ] Hadoop QA commented on HDFS-3794: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3658) TestDFSClientRetries#testNamenodeRestart failed due to MD5 mismatch

2012-08-13 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433837#comment-13433837 ] Sanjay Radia commented on HDFS-3658: +1 > TestDFSClientRetries#testNam

[jira] [Updated] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-13 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3788: - Attachment: h3788_20120813.patch h3788_20120813.patch: check content-length only f

[jira] [Updated] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-13 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3788: - Assignee: Tsz Wo (Nicholas), SZE Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-3586) Blocks are not getting replicate even DN's are availble.

2012-08-13 Thread Han Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433835#comment-13433835 ] Han Xiao commented on HDFS-3586: Uma, you are right. In my comments, there also be a condit

[jira] [Updated] (HDFS-3800) QJM: improvements to QJM fault testing

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3800: -- Attachment: hdfs-3800.txt This patch applies on top of the following other staged patches: pick fac7f15

[jira] [Created] (HDFS-3800) QJM: improvements to QJM fault testing

2012-08-13 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3800: - Summary: QJM: improvements to QJM fault testing Key: HDFS-3800 URL: https://issues.apache.org/jira/browse/HDFS-3800 Project: Hadoop HDFS Issue Type: Sub-task A

[jira] [Updated] (HDFS-3723) All commands should support meaningful --help

2012-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3723: Attachment: HDFS-3723.001.patch > All commands should support meaningful --help > --

[jira] [Updated] (HDFS-3799) QJM: handle empty log segments during recovery

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3799: -- Attachment: hdfs-3799.txt The solution is as follows: - during recovery, when we validate a log, if the

[jira] [Created] (HDFS-3799) QJM: handle empty log segments during recovery

2012-08-13 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3799: - Summary: QJM: handle empty log segments during recovery Key: HDFS-3799 URL: https://issues.apache.org/jira/browse/HDFS-3799 Project: Hadoop HDFS Issue Type: Sub-ta

[jira] [Commented] (HDFS-3765) Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storages

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433800#comment-13433800 ] Todd Lipcon commented on HDFS-3765: --- The findbugs warnings are from HDFS-3695. They have

[jira] [Commented] (HDFS-3765) Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storages

2012-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433797#comment-13433797 ] Hadoop QA commented on HDFS-3765: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3792) Fix two findbugs introduced by HDFS-3695

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3792: -- Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved (w

[jira] [Updated] (HDFS-3795) QJM: validate journal dir at startup

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3795: -- Attachment: hdfs-3795.txt Updated patch addresses ATM's feedback. > QJM: validate journ

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433788#comment-13433788 ] Andrew Wang commented on HDFS-3672: --- Thanks everyone for all your input! Here's another s

[jira] [Commented] (HDFS-3792) Fix two findbugs introduced by HDFS-3695

2012-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433787#comment-13433787 ] Hadoop QA commented on HDFS-3792: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3672: -- Attachment: hdfs-3672-9.patch > Expose disk-location information for blocks to enable better schedul

[jira] [Commented] (HDFS-3795) QJM: validate journal dir at startup

2012-08-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433773#comment-13433773 ] Aaron T. Myers commented on HDFS-3795: -- # Instead of "!dir.getPath().startsWith("/")"

[jira] [Updated] (HDFS-3790) test_fuse_dfs.c doesn't compile on centos 5

2012-08-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3790: - Resolution: Fixed Fix Version/s: 2.2.0-alpha Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-3790) test_fuse_dfs.c doesn't compile on centos 5

2012-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433736#comment-13433736 ] Hadoop QA commented on HDFS-3790: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3766) Release stream and storage directory for removed streams, and fix TestStorageRestore on Windows

2012-08-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433723#comment-13433723 ] Brandon Li commented on HDFS-3766: -- Patch uploaded for branch-1-win > Rel

[jira] [Commented] (HDFS-3150) Add option for clients to contact DNs via hostname

2012-08-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433724#comment-13433724 ] Aaron T. Myers commented on HDFS-3150: -- The trunk patch looks pretty good to me. One l

[jira] [Updated] (HDFS-3766) Release stream and storage directory for removed streams, and fix TestStorageRestore on Windows

2012-08-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-3766: - Attachment: HDFS-3766.patch > Release stream and storage directory for removed streams, and fix > Tes

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-13 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433716#comment-13433716 ] Tsz Wo (Nicholas), SZE commented on HDFS-3788: -- How about first check the tran

[jira] [Commented] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433710#comment-13433710 ] Tsz Wo (Nicholas), SZE commented on HDFS-3794: -- +1 on the patch. Good catch!

[jira] [Commented] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433704#comment-13433704 ] Suresh Srinivas commented on HDFS-3796: --- Well I thought we use a specific LOG to do t

[jira] [Commented] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433699#comment-13433699 ] Todd Lipcon commented on HDFS-3796: --- Hey Suresh. Nope, each junit class file runs in its

[jira] [Commented] (HDFS-3276) initializeSharedEdits should have a -nonInteractive flag

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433696#comment-13433696 ] Hudson commented on HDFS-3276: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2597 (See [https

[jira] [Updated] (HDFS-3798) Avoid throwing NPE when finalizeSegment() is called on invalid segment

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3798: -- Attachment: hdfs-3798.txt > Avoid throwing NPE when finalizeSegment() is called on invalid segment >

[jira] [Created] (HDFS-3798) Avoid throwing NPE when finalizeSegment() is called on invalid segment

2012-08-13 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3798: - Summary: Avoid throwing NPE when finalizeSegment() is called on invalid segment Key: HDFS-3798 URL: https://issues.apache.org/jira/browse/HDFS-3798 Project: Hadoop HDFS

[jira] [Commented] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433692#comment-13433692 ] Suresh Srinivas commented on HDFS-3796: --- Todd, do multiple junit tests reuse JVM? If

[jira] [Created] (HDFS-3797) QJM: add segment txid as a parameter to journal() RPC

2012-08-13 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3797: - Summary: QJM: add segment txid as a parameter to journal() RPC Key: HDFS-3797 URL: https://issues.apache.org/jira/browse/HDFS-3797 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3796: -- Attachment: hdfs-3796.txt > Speed up edit log tests by avoiding fsync() > --

[jira] [Updated] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3796: -- Status: Patch Available (was: Open) > Speed up edit log tests by avoiding fsync() > ---

[jira] [Created] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-13 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3796: - Summary: Speed up edit log tests by avoiding fsync() Key: HDFS-3796 URL: https://issues.apache.org/jira/browse/HDFS-3796 Project: Hadoop HDFS Issue Type: Improveme

[jira] [Updated] (HDFS-3150) Add option for clients to contact DNs via hostname

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3150: -- Attachment: hdfs-3150.txt Patch attached again since it looks like jira lost the old version.

[jira] [Commented] (HDFS-3723) All commands should support meaningful --help

2012-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433630#comment-13433630 ] Hadoop QA commented on HDFS-3723: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2330) In NNStorage.java, IOExceptions of stream closures can mask root exceptions.

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433629#comment-13433629 ] Hudson commented on HDFS-2330: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2596 (See [https

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433628#comment-13433628 ] Hudson commented on HDFS-3190: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2596 (See [https

[jira] [Commented] (HDFS-2330) In NNStorage.java, IOExceptions of stream closures can mask root exceptions.

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433624#comment-13433624 ] Hudson commented on HDFS-2330: -- Integrated in Hadoop-Common-trunk-Commit #2574 (See [https://

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433623#comment-13433623 ] Hudson commented on HDFS-3190: -- Integrated in Hadoop-Common-trunk-Commit #2574 (See [https://

[jira] [Commented] (HDFS-3276) initializeSharedEdits should have a -nonInteractive flag

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433625#comment-13433625 ] Hudson commented on HDFS-3276: -- Integrated in Hadoop-Common-trunk-Commit #2574 (See [https://

[jira] [Commented] (HDFS-3276) initializeSharedEdits should have a -nonInteractive flag

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433614#comment-13433614 ] Hudson commented on HDFS-3276: -- Integrated in Hadoop-Hdfs-trunk-Commit #2639 (See [https://bu

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433612#comment-13433612 ] Hudson commented on HDFS-3190: -- Integrated in Hadoop-Hdfs-trunk-Commit #2639 (See [https://bu

[jira] [Commented] (HDFS-2330) In NNStorage.java, IOExceptions of stream closures can mask root exceptions.

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433613#comment-13433613 ] Hudson commented on HDFS-2330: -- Integrated in Hadoop-Hdfs-trunk-Commit #2639 (See [https://bu

[jira] [Updated] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-3794: --- Attachment: HDFS-3794.patch Attaching a patch that fixes the issue. Its too trivial to write a unit te

[jira] [Commented] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433609#comment-13433609 ] Ravi Prakash commented on HDFS-3794: The same patch applies to branch 0.23, 2, and trun

[jira] [Updated] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-3794: --- Status: Patch Available (was: Open) > WebHDFS Open used with Offset returns the original (and inc

[jira] [Updated] (HDFS-3795) QJM: validate journal dir at startup

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3795: -- Attachment: hdfs-3795.txt Simple patch attached. > QJM: validate journal dir at startup

[jira] [Created] (HDFS-3795) QJM: validate journal dir at startup

2012-08-13 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3795: - Summary: QJM: validate journal dir at startup Key: HDFS-3795 URL: https://issues.apache.org/jira/browse/HDFS-3795 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433603#comment-13433603 ] Ravi Prakash commented on HDFS-3794: {noformat} e.g. $ curl -L "http://HOST:PORT/webhd

[jira] [Updated] (HDFS-3723) All commands should support meaningful --help

2012-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3723: Attachment: HDFS-3723.001.patch Suresh, thanks for the comments. I have addressed the comments and added a h

[jira] [Updated] (HDFS-3793) Implement genericized format() in QJM

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3793: -- Attachment: hdfs-3793.txt Attached patch implements the formatting behavior. In addition to changing th

[jira] [Created] (HDFS-3794) WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.

2012-08-13 Thread Ravi Prakash (JIRA)
Ravi Prakash created HDFS-3794: -- Summary: WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header. Key: HDFS-3794 URL: https://issues.apache.org/jira/browse/HDFS-3794

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-13 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433582#comment-13433582 ] Andrew Purtell commented on HDFS-3672: -- bq. Is there a timeline where someone will wor

[jira] [Created] (HDFS-3793) Implement genericized format() in QJM

2012-08-13 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3793: - Summary: Implement genericized format() in QJM Key: HDFS-3793 URL: https://issues.apache.org/jira/browse/HDFS-3793 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-3276) initializeSharedEdits should have a -nonInteractive flag

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3276: -- Resolution: Fixed Fix Version/s: 2.2.0-alpha 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-3276) initializeSharedEdits should have a -nonInteractive flag

2012-08-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433550#comment-13433550 ] Aaron T. Myers commented on HDFS-3276: -- +1, the patch looks good to me.

[jira] [Commented] (HDFS-3792) Fix two findbugs introduced by HDFS-3695

2012-08-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433544#comment-13433544 ] Aaron T. Myers commented on HDFS-3792: -- +1 pending Jenkins. > Fix two

[jira] [Updated] (HDFS-3792) Fix two findbugs introduced by HDFS-3695

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3792: -- Status: Patch Available (was: Open) > Fix two findbugs introduced by HDFS-3695 > --

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433538#comment-13433538 ] Suresh Srinivas commented on HDFS-3672: --- bq. Perhaps Storage(BlockLocation|Id)? Volum

[jira] [Commented] (HDFS-3276) initializeSharedEdits should have a -nonInteractive flag

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433539#comment-13433539 ] Todd Lipcon commented on HDFS-3276: --- The two new findbugs warnings are HDFS-3792 - not ca

[jira] [Updated] (HDFS-3792) Fix two findbugs introduced by HDFS-3695

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3792: -- Attachment: hdfs-3792.txt Trivial fix: forgot to add synchronized to these two methods and missed it in

[jira] [Commented] (HDFS-3787) BlockManager#close races with ReplicationMonitor#run

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433530#comment-13433530 ] Eli Collins commented on HDFS-3787: --- I kicked the pre-commit build manually.

[jira] [Created] (HDFS-3792) Fix two findbugs introduced by HDFS-3695

2012-08-13 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3792: - Summary: Fix two findbugs introduced by HDFS-3695 Key: HDFS-3792 URL: https://issues.apache.org/jira/browse/HDFS-3792 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-3787) BlockManager#close races with ReplicationMonitor#run

2012-08-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3787: -- Attachment: hdfs-3787-2.txt Same patch attached to kick jira which doesn't seem to be showing the submit

[jira] [Commented] (HDFS-3276) initializeSharedEdits should have a -nonInteractive flag

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433527#comment-13433527 ] Todd Lipcon commented on HDFS-3276: --- Hudson built this here: https://builds.apache.org/jo

[jira] [Updated] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3190: -- Fix Version/s: 2.2.0-alpha Backported this to branch-2, since it was causing some conflicts in other ba

[jira] [Updated] (HDFS-2330) In NNStorage.java, IOExceptions of stream closures can mask root exceptions.

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2330: -- Fix Version/s: 2.2.0-alpha Backported this small fix to branch-2 to avoid some merge conflicts in furthe

[jira] [Updated] (HDFS-3765) Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storages

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3765: -- Attachment: hdfs-3765.txt Trying patch upload again... this applies clean on trunk for me.

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433506#comment-13433506 ] Aaron T. Myers commented on HDFS-3672: -- bq. I'd really encourage you to put this into

[jira] [Commented] (HDFS-3789) JournalManager#format() should be able to throw IOException

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433497#comment-13433497 ] Hudson commented on HDFS-3789: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2594 (See [https

[jira] [Commented] (HDFS-3771) Namenode can't restart due to corrupt edit logs, timing issue with shutdown and edit log rolling

2012-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433466#comment-13433466 ] Todd Lipcon commented on HDFS-3771: --- Hey Patrick. I think this behavior might have been f

[jira] [Commented] (HDFS-3789) JournalManager#format() should be able to throw IOException

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433463#comment-13433463 ] Hudson commented on HDFS-3789: -- Integrated in Hadoop-Common-trunk-Commit #2573 (See [https://

[jira] [Commented] (HDFS-3789) JournalManager#format() should be able to throw IOException

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433462#comment-13433462 ] Hudson commented on HDFS-3789: -- Integrated in Hadoop-Hdfs-trunk-Commit #2638 (See [https://bu

[jira] [Commented] (HDFS-3770) TestFileConcurrentReader#testUnfinishedBlockCRCErrorTransferToAppend failed

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433458#comment-13433458 ] Hudson commented on HDFS-3770: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2593 (See [https

  1   2   >