[jira] [Commented] (HDFS-1952) FSEditLog.open() appears to succeed even if all EDITS directories fail

2011-05-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13037746#comment-13037746 ] Matt Foley commented on HDFS-1952: -- +1 on the v22 version. Confirmed compiles

[jira] [Updated] (HDFS-1727) fsck command can display command usage if user passes any illegal argument

2011-05-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-1727: -- Description: In fsck command if user passes the arguments like ./hadoop fsck -test

[jira] [Created] (HDFS-1981) When namenode goes down while checkpointing and if is started again subsequent Checkpointing is always failing

2011-05-23 Thread ramkrishna.s.vasudevan (JIRA)
When namenode goes down while checkpointing and if is started again subsequent Checkpointing is always failing -- Key: HDFS-1981 URL:

[jira] [Commented] (HDFS-1978) All but first option in LIBHDFS_OPTS is ignored

2011-05-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13037912#comment-13037912 ] Hudson commented on HDFS-1978: -- Integrated in Hadoop-Hdfs-trunk #675 (See

[jira] [Created] (HDFS-1982) Null pointer exception is thrown when NN restarts with a block lesser in size than the block that is present in DN1 but the generation stamp is greater in the NN

2011-05-23 Thread ramkrishna.s.vasudevan (JIRA)
Null pointer exception is thrown when NN restarts with a block lesser in size than the block that is present in DN1 but the generation stamp is greater in the NN

[jira] [Commented] (HDFS-1981) When namenode goes down while checkpointing and if is started again subsequent Checkpointing is always failing

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13037949#comment-13037949 ] Todd Lipcon commented on HDFS-1981: --- Hi Ramkrishna. Can you provide a unit test which

[jira] [Updated] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

2011-05-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HDFS-1950: - Attachment: HDFS-1950-2.patch Blocks that are under construction are not getting

[jira] [Updated] (HDFS-1949) Number format Exception is displayed in Namenode UI when the chunk size field is blank or string value..

2011-05-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HDFS-1949: - Attachment: hdfs-1949.patch Number format Exception is displayed in Namenode UI

[jira] [Updated] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

2011-05-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HDFS-1950: - Status: Patch Available (was: Open) Blocks that are under construction are not

[jira] [Updated] (HDFS-1949) Number format Exception is displayed in Namenode UI when the chunk size field is blank or string value..

2011-05-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HDFS-1949: - Status: Patch Available (was: Open) Number format Exception is displayed in

[jira] [Updated] (HDFS-1949) Number format Exception is displayed in Namenode UI when the chunk size field is blank or string value..

2011-05-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HDFS-1949: - Status: Open (was: Patch Available) Number format Exception is displayed in

[jira] [Commented] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

2011-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13037981#comment-13037981 ] Hadoop QA commented on HDFS-1950: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

2011-05-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13037985#comment-13037985 ] ramkrishna.s.vasudevan commented on HDFS-1950: -- This patch applies for 0.20

[jira] [Commented] (HDFS-1787) Not enough xcievers error should propagate to client

2011-05-23 Thread Jonathan Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13037996#comment-13037996 ] Jonathan Hsieh commented on HDFS-1787: -- Actually, I assumed that the test focused on

[jira] [Commented] (HDFS-1949) Number format Exception is displayed in Namenode UI when the chunk size field is blank or string value..

2011-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038005#comment-13038005 ] Hadoop QA commented on HDFS-1949: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1965) IPCs done using block token-based tickets can't reuse connections

2011-05-23 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038055#comment-13038055 ] Tsz Wo (Nicholas), SZE commented on HDFS-1965: -- Came up a question: By setting

[jira] [Resolved] (HDFS-1828) TestBlocksWithNotEnoughRacks intermittently fails assert

2011-05-23 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-1828. -- Resolution: Fixed Assignee: Matt Foley Since we are not reverting the

[jira] [Commented] (HDFS-1965) IPCs done using block token-based tickets can't reuse connections

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038072#comment-13038072 ] Todd Lipcon commented on HDFS-1965: --- I think in trunk, it's not possible, since the

[jira] [Commented] (HDFS-1965) IPCs done using block token-based tickets can't reuse connections

2011-05-23 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038076#comment-13038076 ] Tsz Wo (Nicholas), SZE commented on HDFS-1965: -- Okay, I fine with it since it

[jira] [Updated] (HDFS-1853) refactor TestNodeCount to import standard node counting and wait for replication methods

2011-05-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1853: - Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-1852) refactor TestNodeCount to

[jira] [Commented] (HDFS-1853) refactor TestNodeCount to import standard node counting and wait for replication methods

2011-05-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038098#comment-13038098 ] Matt Foley commented on HDFS-1853: -- Removed from HDFS-1852 umbrella task, since not

[jira] [Assigned] (HDFS-1853) refactor TestNodeCount to import standard node counting and wait for replication methods

2011-05-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reassigned HDFS-1853: Assignee: Matt Foley refactor TestNodeCount to import standard node counting and wait for

[jira] [Commented] (HDFS-1401) TestFileConcurrentReader test case is still timing out / failing

2011-05-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038112#comment-13038112 ] Matt Foley commented on HDFS-1401: -- As of build 611 (May 23), we see:

[jira] [Commented] (HDFS-1401) TestFileConcurrentReader test case is still timing out / failing

2011-05-23 Thread sam rash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038119#comment-13038119 ] sam rash commented on HDFS-1401: see todd's find in:

[jira] [Commented] (HDFS-1852) Umbrella task: Clean up HDFS unit test recurring failures

2011-05-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038135#comment-13038135 ] Matt Foley commented on HDFS-1852: -- Besides the three remaining open issues above, we also

[jira] [Updated] (HDFS-236) Random read benchmark for DFS

2011-05-23 Thread Dave Thompson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Thompson updated HDFS-236: --- Attachment: RndRead-TestDFSIO.patch I've taken Raghu's patch from 6/27/09 with random read TestDFSIO

[jira] [Created] (HDFS-1983) Fix path display for copy rm

2011-05-23 Thread Daryn Sharp (JIRA)
Fix path display for copy rm -- Key: HDFS-1983 URL: https://issues.apache.org/jira/browse/HDFS-1983 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.23.0

[jira] [Updated] (HDFS-988) saveNamespace can corrupt edits log

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-988: - Status: Open (was: Patch Available) removing patch available status since this still needs to be finished

[jira] [Updated] (HDFS-1965) IPCs done using block token-based tickets can't reuse connections

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1965: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed the 22 patch. Thanks,

[jira] [Updated] (HDFS-988) saveNamespace can corrupt edits log, apparently due to race conditions

2011-05-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-988: Summary: saveNamespace can corrupt edits log, apparently due to race conditions (was: saveNamespace can

[jira] [Commented] (HDFS-1603) Namenode gets sticky if one of namenode storage volumes disappears (removed, unmounted, etc.)

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038245#comment-13038245 ] Todd Lipcon commented on HDFS-1603: --- ATM and I just brainstormed about this a little bit

[jira] [Updated] (HDFS-1967) TestHDFSTrash failing on trunk and 22

2011-05-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1967: - Issue Type: Sub-task (was: Bug) Parent: HDFS-1852 TestHDFSTrash failing on trunk and 22

[jira] [Commented] (HDFS-1967) TestHDFSTrash failing on trunk and 22

2011-05-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038276#comment-13038276 ] Matt Foley commented on HDFS-1967: -- TestHDFSTrash.testTrashEmptier() was failing on almost

[jira] [Updated] (HDFS-1984) HDFS-1073: Enable multiple checkpointers to run simultaneously

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1984: -- Component/s: name-node Description: One of the motivations of HDFS-1073 is that it

[jira] [Commented] (HDFS-1984) HDFS-1073: Enable multiple checkpointers to run simultaneously

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038288#comment-13038288 ] Todd Lipcon commented on HDFS-1984: --- Currently this test scenario fails after a few

[jira] [Updated] (HDFS-1963) HDFS rpm integration project

2011-05-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HDFS-1963: Attachment: HDFS-1963-3.patch Change configuration directory from $PREFIX/conf to $PREFIX/etc/hadoop per

[jira] [Created] (HDFS-1985) HDFS-1073: Cleanup in image transfer servlet

2011-05-23 Thread Todd Lipcon (JIRA)
HDFS-1073: Cleanup in image transfer servlet Key: HDFS-1985 URL: https://issues.apache.org/jira/browse/HDFS-1985 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Todd Lipcon

[jira] [Updated] (HDFS-1985) HDFS-1073: Cleanup in image transfer servlet

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1985: -- Component/s: name-node Description: The TransferFsImage class has grown several heads

[jira] [Updated] (HDFS-1985) HDFS-1073: Cleanup in image transfer servlet

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1985: -- Attachment: hdfs-1985.txt Attached patch does the above refactoring and cleanup. While I was at it, I

[jira] [Created] (HDFS-1986) Add an option for user to return http or https ports regardless of security is on/off in DFSUtil.getInfoServer()

2011-05-23 Thread Tanping Wang (JIRA)
Add an option for user to return http or https ports regardless of security is on/off in DFSUtil.getInfoServer() Key: HDFS-1986 URL:

[jira] [Resolved] (HDFS-422) fuse-dfs leaks FileSystem handles as it never disconnects them because the FileSystem.Cache does not do reference counting

2011-05-23 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-422. -- Resolution: Duplicate fuse-dfs leaks FileSystem handles as it never disconnects them because the

[jira] [Updated] (HDFS-1986) Add an option for user to return http or https ports regardless of security is on/off in DFSUtil.getInfoServer()

2011-05-23 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1986: --- Attachment: HDFS-1986.patch Add an option for user to return http or https ports regardless of

[jira] [Commented] (HDFS-1985) HDFS-1073: Cleanup in image transfer servlet

2011-05-23 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038311#comment-13038311 ] Eli Collins commented on HDFS-1985: --- +1 pending Hudson. This is much nicer. Nit: indent

[jira] [Commented] (HDFS-1985) HDFS-1073: Cleanup in image transfer servlet

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038341#comment-13038341 ] Todd Lipcon commented on HDFS-1985: --- Will fix indentation nits on commit. This is on the

[jira] [Resolved] (HDFS-1985) HDFS-1073: Cleanup in image transfer servlet

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-1985. --- Resolution: Fixed Hadoop Flags: [Reviewed] HDFS-1073: Cleanup in image transfer servlet

[jira] [Commented] (HDFS-1969) Running rollback on new-version namenode destroys namespace

2011-05-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038345#comment-13038345 ] Konstantin Shvachko commented on HDFS-1969: --- Todd, what I meant is that

[jira] [Created] (HDFS-1987) HDFS-1073: Test for 2NN downloading image is not running

2011-05-23 Thread Todd Lipcon (JIRA)
HDFS-1073: Test for 2NN downloading image is not running Key: HDFS-1987 URL: https://issues.apache.org/jira/browse/HDFS-1987 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-1987) HDFS-1073: Test for 2NN downloading image is not running

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1987: -- Component/s: name-node Description: TestCheckpoint.testSecondaryImageDownload was

[jira] [Commented] (HDFS-1969) Running rollback on new-version namenode destroys namespace

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038351#comment-13038351 ] Todd Lipcon commented on HDFS-1969: --- bq. I actually don't see where it is triggered. The

[jira] [Updated] (HDFS-1987) HDFS-1073: Test for 2NN downloading image is not running

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1987: -- Attachment: hdfs-1987.txt Attached patch makes this test case actually run, and fixes it up to work

[jira] [Updated] (HDFS-1984) HDFS-1073: Enable multiple checkpointers to run simultaneously

2011-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1984: -- Attachment: hdfs-1984.txt Here's a patch that does the above, and also adds two new test cases: 1)