[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-12-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966448#action_12966448 ] Konstantin Shvachko commented on HDFS-1508: --- I am unable to write a unit test

[jira] Updated: (HDFS-1526) Dfs client name for a map/reduce task should have some randomness

2010-12-03 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1526: Attachment: clientName.patch Here comes the patch. Dfs client name for a map/reduce task should

[jira] Updated: (HDFS-1506) Refactor fsimage loading code

2010-12-03 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1506: Attachment: refactorImageLoader1.patch refactorImageLoader1.patch addressed Todd and Cos's review

[jira] Commented: (HDFS-1526) Dfs client name for a map/reduce task should have some randomness

2010-12-03 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966579#action_12966579 ] Koji Noguchi commented on HDFS-1526: Hairong, using a random number (with time as a

[jira] Commented: (HDFS-1526) Dfs client name for a map/reduce task should have some randomness

2010-12-03 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966589#action_12966589 ] Hairong Kuang commented on HDFS-1526: - Koji, your comment makes sense if all threads

[jira] Commented: (HDFS-1506) Refactor fsimage loading code

2010-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966608#action_12966608 ] Todd Lipcon commented on HDFS-1506: --- +1 looks good to me assuming tests pass Refactor

[jira] Commented: (HDFS-1473) Refactor storage management into separate classes than fsimage file reading/writing

2010-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966614#action_12966614 ] Todd Lipcon commented on HDFS-1473: --- I'll fix the save() - write() momentarily. As for

[jira] Updated: (HDFS-1473) Refactor storage management into separate classes than fsimage file reading/writing

2010-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1473: -- Attachment: hdfs-1473-followup.2.txt New patch fixes write-save, written-saved, etc. Refactor storage

[jira] Commented: (HDFS-1506) Refactor fsimage loading code

2010-12-03 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966636#action_12966636 ] Hairong Kuang commented on HDFS-1506: - [exec] -1 overall. [exec]

[jira] Updated: (HDFS-1506) Refactor fsimage loading code

2010-12-03 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1506: -- Hadoop Flags: [Reviewed] +1. Looks good. Refactor fsimage loading code

[jira] Commented: (HDFS-1526) Dfs client name for a map/reduce task should have some randomness

2010-12-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1298#action_1298 ] Allen Wittenauer commented on HDFS-1526: -1 on random without some sort of check for

[jira] Commented: (HDFS-1506) Refactor fsimage loading code

2010-12-03 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966677#action_12966677 ] Hairong Kuang commented on HDFS-1506: - Failed tests are all known: TestBlockRecovery

[jira] Updated: (HDFS-1506) Refactor fsimage loading code

2010-12-03 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1506: Fix Version/s: 0.23.0 Status: Patch Available (was: Open) I've just committed this!

[jira] Commented: (HDFS-1306) TestFileAppend4 fails

2010-12-03 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966730#action_12966730 ] Konstantin Boudnik commented on HDFS-1306: -- That's seems to be the dup of hdfs-1286

[jira] Updated: (HDFS-1497) Write pipeline sequence numbers should be sequential with no skips or duplicates

2010-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1497: -- Attachment: hdfs-1497.txt Rebased patch against trunk Write pipeline sequence numbers should be

[jira] Commented: (HDFS-1523) TestLargeBlock is failing on trunk

2010-12-03 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966744#action_12966744 ] Suresh Srinivas commented on HDFS-1523: --- Cos, is there any change you made in this

[jira] Commented: (HDFS-1525) TestLargeBlock is failing on 32-bit VMs

2010-12-03 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966746#action_12966746 ] Suresh Srinivas commented on HDFS-1525: --- BTW this test may also fail on 64 bit VMs,

[jira] Commented: (HDFS-1525) TestLargeBlock is failing on 32-bit VMs

2010-12-03 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966754#action_12966754 ] Konstantin Boudnik commented on HDFS-1525: -- If this test fails because of the

[jira] Commented: (HDFS-1523) TestLargeBlock is failing on trunk

2010-12-03 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966756#action_12966756 ] Konstantin Boudnik commented on HDFS-1523: -- The essence of the change is here

[jira] Updated: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command

2010-12-03 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1509: --- Attachment: resyncBadNameDir1.txt Unit test doe snot pass yet, this is a draft version of the

[jira] Commented: (HDFS-1523) TestLargeBlock is failing on trunk

2010-12-03 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966758#action_12966758 ] Konstantin Boudnik commented on HDFS-1523: -- I have fixed wrong JIRA number in

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-12-03 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966759#action_12966759 ] dhruba borthakur commented on HDFS-1508: This addresses Konstanitin's request to

[jira] Updated: (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2010-12-03 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Attachment: trunkLocalNameImage4.patch Since HDFS-1526 is committed, I am uploading a new patch

[jira] Created: (HDFS-1527) SocketOutputStream.transferToFully fails for blocks = 2GB on 32 bit JVM

2010-12-03 Thread Patrick Kling (JIRA)
SocketOutputStream.transferToFully fails for blocks = 2GB on 32 bit JVM Key: HDFS-1527 URL: https://issues.apache.org/jira/browse/HDFS-1527 Project: Hadoop HDFS Issue

[jira] Updated: (HDFS-1527) SocketOutputStream.transferToFully fails for blocks = 2GB on 32 bit JVM

2010-12-03 Thread Patrick Kling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Kling updated HDFS-1527: Attachment: HDFS-1527.patch This patch uses a regular transfer instead of transferTo if we are on a

[jira] Updated: (HDFS-1527) SocketOutputStream.transferToFully fails for blocks = 2GB on 32 bit JVM

2010-12-03 Thread Patrick Kling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Kling updated HDFS-1527: Assignee: Patrick Kling Status: Patch Available (was: Open)

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966779#action_12966779 ] Todd Lipcon commented on HDFS-1508: --- I'm not arguing one way or the other, but I'm curious

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-12-03 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966791#action_12966791 ] dhruba borthakur commented on HDFS-1508: Thanks Todd for your comments. I like your

[jira] Commented: (HDFS-1525) TestLargeBlock is failing on 32-bit VMs

2010-12-03 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966794#action_12966794 ] Konstantin Boudnik commented on HDFS-1525: -- When HDFS-1527 is committed

[jira] Resolved: (HDFS-1525) TestLargeBlock is failing on 32-bit VMs

2010-12-03 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik resolved HDFS-1525. -- Resolution: Duplicate Closing is dup of HDFS-1527 TestLargeBlock is failing on 32-bit

[jira] Commented: (HDFS-1527) SocketOutputStream.transferToFully fails for blocks = 2GB on 32 bit JVM

2010-12-03 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12966799#action_12966799 ] Konstantin Boudnik commented on HDFS-1527: -- This line needs to go to for it become