[jira] [Commented] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293393#comment-13293393 ] Hudson commented on HDFS-3520: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2367 (See [https

[jira] [Commented] (HDFS-3504) Configurable retry in DFSClient

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293392#comment-13293392 ] Hudson commented on HDFS-3504: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2367 (See [https

[jira] [Updated] (HDFS-3518) Provide API to check HDFS operational state

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3518: - Status: Patch Available (was: Open) > Provide API to check HDFS operational s

[jira] [Updated] (HDFS-3518) Provide API to check HDFS operational state

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3518: - Attachment: h3518_20120611.patch I still think that isHealthy and isInSafeMode are

[jira] [Updated] (HDFS-3483) Better error message when hdfs fsck is run against a ViewFS config

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3483: -- Summary: Better error message when hdfs fsck is run against a ViewFS config (was: hdfs fsck doesn't run

[jira] [Commented] (HDFS-3483) hdfs fsck doesn't run with ViewFS path

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293385#comment-13293385 ] Eli Collins commented on HDFS-3483: --- For now let's just make fsck like dfsadmin tell the

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-06-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293381#comment-13293381 ] Uma Maheswara Rao G commented on HDFS-3157: --- Thanks a lot Nicholas. Even though

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293380#comment-13293380 ] Tsz Wo (Nicholas), SZE commented on HDFS-3157: -- Hi Uma, I just have started a

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-06-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293373#comment-13293373 ] Uma Maheswara Rao G commented on HDFS-3157: --- Test failure seems to be due to HDFS

[jira] [Commented] (HDFS-3477) FormatZK and ZKFC startup can fail due to zkclient connection establishment delay

2012-06-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293374#comment-13293374 ] Rakesh R commented on HDFS-3477: Thanks Todd. I have updated the patch by fixing the commen

[jira] [Updated] (HDFS-3477) FormatZK and ZKFC startup can fail due to zkclient connection establishment delay

2012-06-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-3477: --- Attachment: HDFS-3477.3.patch > FormatZK and ZKFC startup can fail due to zkclient connection establishmen

[jira] [Assigned] (HDFS-3524) TestFileLengthOnClusterRestart.testFileLengthWithHSyncAndClusterRestartWithOutDNsRegister failed

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE reassigned HDFS-3524: Assignee: Brandon Li > TestFileLengthOnClusterRestart.testFileLengthWith

[jira] [Resolved] (HDFS-3525) TestFileLengthOnClusterRestart may fail

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-3525. -- Resolution: Duplicate > TestFileLengthOnClusterRestart may fail > --

[jira] [Commented] (HDFS-3522) If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293372#comment-13293372 ] Tsz Wo (Nicholas), SZE commented on HDFS-3522: -- Hi Todd, I think it is not inc

[jira] [Commented] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293368#comment-13293368 ] Hudson commented on HDFS-3049: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2366 (See [https

[jira] [Updated] (HDFS-3504) Configurable retry in DFSClient

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3504: - Resolution: Fixed Fix Version/s: 2.0.1-alpha Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-3061) Backport HDFS-1487 to branch-1

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3061: -- Summary: Backport HDFS-1487 to branch-1 (was: Cached directory size in INodeDirectory can get permanten

[jira] [Commented] (HDFS-3504) Configurable retry in DFSClient

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293364#comment-13293364 ] Tsz Wo (Nicholas), SZE commented on HDFS-3504: -- The javadoc warning is due to

[jira] [Created] (HDFS-3525) TestFileLengthOnClusterRestart may fail

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-3525: Summary: TestFileLengthOnClusterRestart may fail Key: HDFS-3525 URL: https://issues.apache.org/jira/browse/HDFS-3525 Project: Hadoop HDFS Iss

[jira] [Updated] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3520: -- Target Version/s: 2.0.1-alpha (was: 1.2.0, 2.0.1-alpha) Affects Version/s: (was: 1.2.0)

[jira] [Updated] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3520: -- Resolution: Fixed Fix Version/s: 2.0.1-alpha Target Version/s: (was: 2.0.1-alpha)

[jira] [Commented] (HDFS-3507) DFS#isInSafeMode needs to execute only on Active NameNode

2012-06-11 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293354#comment-13293354 ] Vinay commented on HDFS-3507: - Hi Nicholas, {quote}For option 1, we may simply add a parameter

[jira] [Commented] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293351#comment-13293351 ] Hudson commented on HDFS-3049: -- Integrated in Hadoop-Common-trunk-Commit #2344 (See [https://

[jira] [Commented] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293350#comment-13293350 ] Eli Collins commented on HDFS-3520: --- The test failure is unrelated, filed HDFS-3524 for i

[jira] [Commented] (HDFS-3524) TestFileLengthOnClusterRestart.testFileLengthWithHSyncAndClusterRestartWithOutDNsRegister failed

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293349#comment-13293349 ] Eli Collins commented on HDFS-3524: --- Here's the full stracktrace: org.junit.ComparisonFa

[jira] [Created] (HDFS-3524) TestFileLengthOnClusterRestart.testFileLengthWithHSyncAndClusterRestartWithOutDNsRegister failed

2012-06-11 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3524: - Summary: TestFileLengthOnClusterRestart.testFileLengthWithHSyncAndClusterRestartWithOutDNsRegister failed Key: HDFS-3524 URL: https://issues.apache.org/jira/browse/HDFS-3524

[jira] [Commented] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293347#comment-13293347 ] Hudson commented on HDFS-3049: -- Integrated in Hadoop-Hdfs-trunk-Commit #2417 (See [https://bu

[jira] [Commented] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293346#comment-13293346 ] Hadoop QA commented on HDFS-3520: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3389) Document the BKJM usage in Namenode HA.

2012-06-11 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293341#comment-13293341 ] surendra singh lilhore commented on HDFS-3389: -- @Uma , Yes, I will setup clus

[jira] [Updated] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-06-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3049: -- Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved (w

[jira] [Commented] (HDFS-3522) If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293322#comment-13293322 ] Hudson commented on HDFS-3522: -- Integrated in Hadoop-Hdfs-trunk-Commit #2416 (See [https://bu

[jira] [Commented] (HDFS-3522) If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293319#comment-13293319 ] Hudson commented on HDFS-3522: -- Integrated in Hadoop-Common-trunk-Commit #2343 (See [https://

[jira] [Commented] (HDFS-3504) Configurable retry in DFSClient

2012-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293315#comment-13293315 ] Hadoop QA commented on HDFS-3504: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3522) If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3522: -- Release Note: getBlockLocations(), and hence open() for read, will now throw SafeModeException if the Na

[jira] [Commented] (HDFS-3522) If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293307#comment-13293307 ] Hudson commented on HDFS-3522: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2365 (See [https

[jira] [Updated] (HDFS-3522) If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3522: - Summary: If NN is in safemode, it should throw SafeModeException when getBlockLoca

[jira] [Updated] (HDFS-3522) If NN is in saftmode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3522: - Resolution: Fixed Fix Version/s: 2.0.1-alpha Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-3052) HA: hdfs balancer throws StandbyException

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293277#comment-13293277 ] Hudson commented on HDFS-3052: -- Integrated in Hadoop-Hdfs-trunk-Commit #2415 (See [https://bu

[jira] [Commented] (HDFS-3517) TestStartup should bind ephemeral ports

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293279#comment-13293279 ] Hudson commented on HDFS-3517: -- Integrated in Hadoop-Hdfs-trunk-Commit #2415 (See [https://bu

[jira] [Commented] (HDFS-3052) HA: hdfs balancer throws StandbyException

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293272#comment-13293272 ] Hudson commented on HDFS-3052: -- Integrated in Hadoop-Common-trunk-Commit #2342 (See [https://

[jira] [Commented] (HDFS-3517) TestStartup should bind ephemeral ports

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293274#comment-13293274 ] Hudson commented on HDFS-3517: -- Integrated in Hadoop-Common-trunk-Commit #2342 (See [https://

[jira] [Updated] (HDFS-3521) Allow namenode to tolerate edit log corruption

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3521: - Fix Version/s: 1.2.0 Ran all the tests again. The result was the same. Also chec

[jira] [Resolved] (HDFS-3521) Allow namenode to tolerate edit log corruption

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-3521. -- Resolution: Fixed Hadoop Flags: Reviewed > Allow namenode to tolerate

[jira] [Commented] (HDFS-3508) avoid OOM while deserializing DelegationTokenIdentifer

2012-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293253#comment-13293253 ] Hadoop QA commented on HDFS-3508: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3504) Configurable retry in DFSClient

2012-06-11 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293247#comment-13293247 ] Sanjay Radia commented on HDFS-3504: +1 > Configurable retry in DFSCli

[jira] [Commented] (HDFS-3521) Allow namenode to tolerate edit log corruption

2012-06-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293229#comment-13293229 ] Suresh Srinivas commented on HDFS-3521: --- +1 for the patch. Thanks for fixing the seco

[jira] [Commented] (HDFS-3518) Provide API to check HDFS operational state

2012-06-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293224#comment-13293224 ] Aaron T. Myers commented on HDFS-3518: -- bq. Hi Aaron, you are right that HDFS-3507 and

[jira] [Commented] (HDFS-3518) Provide API to check HDFS operational state

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293221#comment-13293221 ] Tsz Wo (Nicholas), SZE commented on HDFS-3518: -- Hi Aaron, you are right that H

[jira] [Commented] (HDFS-3507) DFS#isInSafeMode needs to execute only on Active NameNode

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293219#comment-13293219 ] Tsz Wo (Nicholas), SZE commented on HDFS-3507: -- For option 1, we may simply ad

[jira] [Commented] (HDFS-3522) If NN is in saftmode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293209#comment-13293209 ] Hadoop QA commented on HDFS-3522: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3520: -- Attachment: hdfs-3520.txt findbugs wants the division to be on it's own line. Verified this by running

[jira] [Updated] (HDFS-3521) Allow namenode to tolerate edit log corruption

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3521: - Attachment: h3521_20120611_b-1.patch h3521_20120611_b-1.patch: SecondaryNameNode s

[jira] [Commented] (HDFS-3521) Allow namenode to tolerate edit log corruption

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293193#comment-13293193 ] Tsz Wo (Nicholas), SZE commented on HDFS-3521: -- Ran all unit tests. TestFileC

[jira] [Created] (HDFS-3523) TestFileCreation fails in branch-1

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-3523: Summary: TestFileCreation fails in branch-1 Key: HDFS-3523 URL: https://issues.apache.org/jira/browse/HDFS-3523 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-3518) Provide API to check HDFS operational state

2012-06-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293192#comment-13293192 ] Aaron T. Myers commented on HDFS-3518: -- bq. I think this is different from HDFS-2413.

[jira] [Commented] (HDFS-3522) If NN is in saftmode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293173#comment-13293173 ] Brandon Li commented on HDFS-3522: -- Todd, Basically it's for better debug-ability and err

[jira] [Commented] (HDFS-3517) TestStartup should bind ephemeral ports

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293158#comment-13293158 ] Hudson commented on HDFS-3517: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2363 (See [https

[jira] [Commented] (HDFS-3504) Configurable retry in DFSClient

2012-06-11 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293144#comment-13293144 ] Sanjay Radia commented on HDFS-3504: Multi linear random retry :-) is very flexible. Th

[jira] [Updated] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3510: --- Attachment: HDFS-3510.003.patch > Fix FSEditLog pre-allocation > -

[jira] [Updated] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3510: --- Description: In the FSEditLog, we want to avoid running out of space in the middle of

[jira] [Commented] (HDFS-3052) HA: hdfs balancer throws StandbyException

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293113#comment-13293113 ] Hudson commented on HDFS-3052: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2362 (See [https

[jira] [Commented] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293109#comment-13293109 ] Hadoop QA commented on HDFS-3520: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3502) Change INodeFile and INodeFileUnderConstruction to package private

2012-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293103#comment-13293103 ] Hadoop QA commented on HDFS-3502: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3520: -- Attachment: (was: hdfs-3520.txt) > Add transfer rate logging to TransferFsImage > --

[jira] [Updated] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3520: -- Attachment: hdfs-3520.txt Right patch this time. > Add transfer rate logging to Transfe

[jira] [Updated] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3520: -- Attachment: hdfs-3520.txt Updated patch to fix the findbugs warning. > Add transfer rat

[jira] [Updated] (HDFS-3504) Configurable retry in DFSClient

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3504: - Attachment: h3504_20120611.patch h3504_20120611.patch: support MultipleLinearRando

[jira] [Updated] (HDFS-3517) TestStartup should bind ephemeral ports

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3517: -- Resolution: Fixed Fix Version/s: 2.0.1-alpha Target Version/s: (was: 2.0.1-alpha)

[jira] [Commented] (HDFS-2797) Fix misuses of InputStream#skip in the edit log code

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293069#comment-13293069 ] Hudson commented on HDFS-2797: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2361 (See [https

[jira] [Updated] (HDFS-3502) Change INodeFile and INodeFileUnderConstruction to package private

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3502: - Resolution: Fixed Fix Version/s: 2.0.1-alpha Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-3518) Provide API to check HDFS operational state

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293045#comment-13293045 ] Tsz Wo (Nicholas), SZE commented on HDFS-3518: -- I think this is different from

[jira] [Commented] (HDFS-2797) Fix misuses of InputStream#skip in the edit log code

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293024#comment-13293024 ] Hudson commented on HDFS-2797: -- Integrated in Hadoop-Common-trunk-Commit #2341 (See [https://

[jira] [Commented] (HDFS-2797) Fix misuses of InputStream#skip in the edit log code

2012-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293020#comment-13293020 ] Hudson commented on HDFS-2797: -- Integrated in Hadoop-Hdfs-trunk-Commit #2414 (See [https://bu

[jira] [Commented] (HDFS-3522) If NN is in saftmode, it should throw SafeModeException when getBlockLocations has zero locations

2012-06-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293010#comment-13293010 ] Todd Lipcon commented on HDFS-3522: --- Can you explain the use case for this change, please

[jira] [Commented] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293003#comment-13293003 ] Todd Lipcon commented on HDFS-3520: --- Looks good to me. I might change the Math.max arg to

[jira] [Commented] (HDFS-3502) Change INodeFile and INodeFileUnderConstruction to package private

2012-06-11 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292999#comment-13292999 ] John George commented on HDFS-3502: --- Great. +1 > Change INodeFile and IN

[jira] [Commented] (HDFS-3517) TestStartup should bind ephemeral ports

2012-06-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292998#comment-13292998 ] Todd Lipcon commented on HDFS-3517: --- +1 > TestStartup should bind epheme

[jira] [Updated] (HDFS-3508) avoid OOM while deserializing DelegationTokenIdentifer

2012-06-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3508: --- Attachment: HDFS-3508.007.patch * update parameter name in unit test

[jira] [Commented] (HDFS-3504) Configurable retry in DFSClient

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292963#comment-13292963 ] Tsz Wo (Nicholas), SZE commented on HDFS-3504: -- > Not sure if exponential back

[jira] [Commented] (HDFS-3508) avoid OOM while deserializing DelegationTokenIdentifer

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292953#comment-13292953 ] Eli Collins commented on HDFS-3508: --- Nit: need to update doTestLimitedIO parameter name s

[jira] [Updated] (HDFS-3502) Change INodeFile and INodeFileUnderConstruction to package private

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3502: - Attachment: h3502_20120611.patch John, good point. I added @InterfaceAudience.Pri

[jira] [Updated] (HDFS-2797) Fix misuses of InputStream#skip in the edit log code

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2797: -- Resolution: Fixed Fix Version/s: 2.0.1-alpha Target Version/s: (was: 0.24.0) H

[jira] [Updated] (HDFS-3508) avoid OOM while deserializing DelegationTokenIdentifer

2012-06-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3508: --- Attachment: HDFS-3508.006.patch * update unit test > avoid OOM while

[jira] [Updated] (HDFS-3520) Add transfer rate logging to TransferFsImage

2012-06-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3520: -- Attachment: hdfs-3520.txt Good suggestion, updated patch. > Add transfer rate logging t

[jira] [Commented] (HDFS-3502) Change INodeFile and INodeFileUnderConstruction to package private

2012-06-11 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292838#comment-13292838 ] John George commented on HDFS-3502: --- The patch looks good generally. A couple of question

[jira] [Commented] (HDFS-3389) Document the BKJM usage in Namenode HA.

2012-06-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292728#comment-13292728 ] Uma Maheswara Rao G commented on HDFS-3389: --- I was on vacation for last few days.

[jira] [Commented] (HDFS-2224) The libhdfs test is broken

2012-06-11 Thread Nishchay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292719#comment-13292719 ] Nishchay commented on HDFS-2224: Thanks Eli, I was trying to compile on Mac and realised la

[jira] [Updated] (HDFS-2224) The libhdfs test is broken

2012-06-11 Thread Nishchay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishchay updated HDFS-2224: --- Attachment: HDFS-2224.patch > The libhdfs test is broken > -- > >

[jira] [Commented] (HDFS-3408) BKJM : Namenode format fails, if there is no BK root

2012-06-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292710#comment-13292710 ] Uma Maheswara Rao G commented on HDFS-3408: --- Patch looks great Rakesh. One small

[jira] [Updated] (HDFS-3521) Allow namenode to tolerate edit log corruption

2012-06-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3521: - Attachment: h3521_20120610_b-1.patch h3521_20120610_b-1.patch: 1st patch.

[jira] [Commented] (HDFS-3518) Provide API to check HDFS operational state

2012-06-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292664#comment-13292664 ] Aaron T. Myers commented on HDFS-3518: -- bq. Seems like the most useful information we