[jira] [Updated] (HDFS-3507) DFS#isInSafeMode needs to execute only on Active NameNode

2012-06-06 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-3507: Summary: DFS#isInSafeMode needs to execute only on Active NameNode (was: DFS#isInSafeNode needs to execute only on

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290035#comment-13290035 ] Hadoop QA commented on HDFS-3157: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-06-06 Thread Ashish Singhi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290049#comment-13290049 ] Ashish Singhi commented on HDFS-3157: - {quote} -1 core tests. The patch failed these

[jira] [Assigned] (HDFS-3507) DFS#isInSafeMode needs to execute only on Active NameNode

2012-06-06 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HDFS-3507: --- Assignee: Vinay DFS#isInSafeMode needs to execute only on Active NameNode

[jira] [Commented] (HDFS-3508) avoid OOM while deserializing DelegationTokenIdentifer

2012-06-06 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290141#comment-13290141 ] Daryn Sharp commented on HDFS-3508: --- Looks good! Could you add a quick test that tries

[jira] [Commented] (HDFS-3509) WebHdfsFilesystem does not work within a proxyuser doAs call in secure mode

2012-06-06 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290208#comment-13290208 ] Daryn Sharp commented on HDFS-3509: --- Instead of solely relying on a better try/catch

[jira] [Commented] (HDFS-3509) WebHdfsFilesystem does not work within a proxyuser doAs call in secure mode

2012-06-06 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290209#comment-13290209 ] Alejandro Abdelnur commented on HDFS-3509: -- @Daryn, that sounds right, but fixing

[jira] [Commented] (HDFS-3113) httpfs does not support delegation tokens

2012-06-06 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290211#comment-13290211 ] Daryn Sharp commented on HDFS-3113: --- A lot of the patch doesn't apply, so could you

[jira] [Commented] (HDFS-3509) WebHdfsFilesystem does not work within a proxyuser doAs call in secure mode

2012-06-06 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290217#comment-13290217 ] Daryn Sharp commented on HDFS-3509: --- Sure. I'd suggest that maybe it should be

[jira] [Commented] (HDFS-3113) httpfs does not support delegation tokens

2012-06-06 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290252#comment-13290252 ] Alejandro Abdelnur commented on HDFS-3113: -- @Daryn, please se the requires linked

[jira] [Created] (HDFS-3513) HttpFS should cache filesystems

2012-06-06 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created HDFS-3513: Summary: HttpFS should cache filesystems Key: HDFS-3513 URL: https://issues.apache.org/jira/browse/HDFS-3513 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-3513) HttpFS should cache filesystems

2012-06-06 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-3513: - Attachment: HDFS-3513.patch Time based cache that purges cached filesystem after an idle

[jira] [Updated] (HDFS-3513) HttpFS should cache filesystems

2012-06-06 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-3513: - Assignee: Alejandro Abdelnur Status: Patch Available (was: Open) HttpFS

[jira] [Updated] (HDFS-2988) Improve error message when storage directory lock fails

2012-06-06 Thread Miomir Boljanovic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miomir Boljanovic updated HDFS-2988: Attachment: HDFS-2988.patch The patch comprises required error message improvements, a new

[jira] [Created] (HDFS-3514) Add missing TestParallelLocalRead

2012-06-06 Thread Henry Robinson (JIRA)
Henry Robinson created HDFS-3514: Summary: Add missing TestParallelLocalRead Key: HDFS-3514 URL: https://issues.apache.org/jira/browse/HDFS-3514 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-3514) Add missing TestParallelLocalRead

2012-06-06 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3514: - Attachment: HDFS-3514.patch Add missing TestParallelLocalRead

[jira] [Assigned] (HDFS-3514) Add missing TestParallelLocalRead

2012-06-06 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson reassigned HDFS-3514: Assignee: Henry Robinson Add missing TestParallelLocalRead

[jira] [Updated] (HDFS-3514) Add missing TestParallelLocalRead

2012-06-06 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3514: - Status: Patch Available (was: Open) Add missing TestParallelLocalRead

[jira] [Commented] (HDFS-3513) HttpFS should cache filesystems

2012-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290336#comment-13290336 ] Hadoop QA commented on HDFS-3513: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3514) Add missing TestParallelLocalRead

2012-06-06 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3514: - Target Version/s: 3.0.0 Affects Version/s: 3.0.0 Add missing TestParallelLocalRead

[jira] [Updated] (HDFS-3514) Add missing TestParallelLocalRead

2012-06-06 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3514: - Component/s: test Add missing TestParallelLocalRead -

[jira] [Commented] (HDFS-3479) backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1

2012-06-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290341#comment-13290341 ] Colin Patrick McCabe commented on HDFS-3479: I ran all the tests, and also

[jira] [Updated] (HDFS-3490) DN WebHDFS methods throw NPE if Namenode RPC address param not specified

2012-06-06 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3490: - Attachment: h3490_20120606.patch NamenodeRpcAddressParam have be created

[jira] [Updated] (HDFS-3513) HttpFS should cache filesystems

2012-06-06 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-3513: - Status: Open (was: Patch Available) cache should keep track of lease reference count

[jira] [Updated] (HDFS-3513) HttpFS should cache filesystems

2012-06-06 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-3513: - Attachment: HDFS-3513.patch adding lease count to the cache and taking care of the

[jira] [Updated] (HDFS-3513) HttpFS should cache filesystems

2012-06-06 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-3513: - Status: Patch Available (was: Open) HttpFS should cache filesystems

[jira] [Updated] (HDFS-2988) Improve error message when storage directory lock fails

2012-06-06 Thread Miomir Boljanovic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miomir Boljanovic updated HDFS-2988: Status: Patch Available (was: Open) Improve error message when storage directory lock

[jira] [Commented] (HDFS-3514) Add missing TestParallelLocalRead

2012-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290372#comment-13290372 ] Hadoop QA commented on HDFS-3514: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3513) HttpFS should cache filesystems

2012-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290373#comment-13290373 ] Hadoop QA commented on HDFS-3513: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2224) The libhdfs test is broken

2012-06-06 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290384#comment-13290384 ] Eli Collins commented on HDFS-2224: --- mvn compile -Pnative runs the native build, please

[jira] [Commented] (HDFS-3490) DN WebHDFS methods throw NPE if Namenode RPC address param not specified

2012-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290382#comment-13290382 ] Hadoop QA commented on HDFS-3490: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3505) DirectoryScanner does not join all threads in shutdown

2012-06-06 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290388#comment-13290388 ] Eli Collins commented on HDFS-3505: --- +1 looks good DirectoryScanner

[jira] [Commented] (HDFS-2988) Improve error message when storage directory lock fails

2012-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290391#comment-13290391 ] Hadoop QA commented on HDFS-2988: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3505) DirectoryScanner does not join all threads in shutdown

2012-06-06 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3505: -- Resolution: Fixed Fix Version/s: 2.0.1-alpha Target Version/s: (was: 2.0.0-alpha)

[jira] [Commented] (HDFS-3505) DirectoryScanner does not join all threads in shutdown

2012-06-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290402#comment-13290402 ] Hudson commented on HDFS-3505: -- Integrated in Hadoop-Hdfs-trunk-Commit #2400 (See

[jira] [Commented] (HDFS-3505) DirectoryScanner does not join all threads in shutdown

2012-06-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290405#comment-13290405 ] Hudson commented on HDFS-3505: -- Integrated in Hadoop-Common-trunk-Commit #2327 (See

[jira] [Updated] (HDFS-3478) -setQuota, -setSpaceQuota Issues with Long.Max_Value

2012-06-06 Thread Sujay Rau (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujay Rau updated HDFS-3478: Status: Patch Available (was: Open) -setQuota, -setSpaceQuota Issues with Long.Max_Value

[jira] [Updated] (HDFS-3478) -setQuota, -setSpaceQuota Issues with Long.Max_Value

2012-06-06 Thread Sujay Rau (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujay Rau updated HDFS-3478: Status: Open (was: Patch Available) -setQuota, -setSpaceQuota Issues with Long.Max_Value

[jira] [Updated] (HDFS-3478) -setQuota, -setSpaceQuota Issues with Long.Max_Value

2012-06-06 Thread Sujay Rau (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujay Rau updated HDFS-3478: Attachment: hdfs-123.txt Adds test that confirms current behavior of setting quotas at and around

[jira] [Commented] (HDFS-3479) backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1

2012-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290416#comment-13290416 ] Todd Lipcon commented on HDFS-3479: --- Patch looks good to me. +1. Any further comments,

[jira] [Updated] (HDFS-3478) -setQuota, -setSpaceQuota Issues with Long.Max_Value

2012-06-06 Thread Sujay Rau (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujay Rau updated HDFS-3478: Attachment: (was: hdfs-123.txt) -setQuota, -setSpaceQuota Issues with Long.Max_Value

[jira] [Updated] (HDFS-3478) -setQuota, -setSpaceQuota Issues with Long.Max_Value

2012-06-06 Thread Sujay Rau (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujay Rau updated HDFS-3478: Attachment: hdfs-3478.txt Adds test that confirms current behavior of setting quotas at and around

[jira] [Updated] (HDFS-3478) -setQuota, -setSpaceQuota Issues with Long.Max_Value

2012-06-06 Thread Sujay Rau (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujay Rau updated HDFS-3478: Status: Patch Available (was: Open) -setQuota, -setSpaceQuota Issues with Long.Max_Value

[jira] [Commented] (HDFS-3479) backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1

2012-06-06 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290439#comment-13290439 ] Tsz Wo (Nicholas), SZE commented on HDFS-3479: -- {code} +int written =

[jira] [Commented] (HDFS-3446) HostsFileReader silently ignores bad includes/excludes

2012-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290455#comment-13290455 ] Todd Lipcon commented on HDFS-3446: --- {code} +String includesFilename =

[jira] [Commented] (HDFS-3505) DirectoryScanner does not join all threads in shutdown

2012-06-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290501#comment-13290501 ] Hudson commented on HDFS-3505: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2346 (See

[jira] [Commented] (HDFS-2988) Improve error message when storage directory lock fails

2012-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290516#comment-13290516 ] Todd Lipcon commented on HDFS-2988: --- Hi Miomir, thanks for the patch. A few comments: -

[jira] [Commented] (HDFS-3492) fix some misuses of InputStream#skip

2012-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290527#comment-13290527 ] Todd Lipcon commented on HDFS-3492: --- +1, looks good to me. Thanks Colin.

[jira] [Updated] (HDFS-3492) fix some misuses of InputStream#skip

2012-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3492: -- Resolution: Fixed Fix Version/s: 2.0.1-alpha Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-3371) EditLogFileInputStream: be more careful about closing streams when we're done with them.

2012-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290545#comment-13290545 ] Todd Lipcon commented on HDFS-3371: --- I'm not sure I see the point of this change. It only

[jira] [Commented] (HDFS-3478) -setQuota, -setSpaceQuota Issues with Long.Max_Value

2012-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290549#comment-13290549 ] Hadoop QA commented on HDFS-3478: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3492) fix some misuses of InputStream#skip

2012-06-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290553#comment-13290553 ] Hudson commented on HDFS-3492: -- Integrated in Hadoop-Common-trunk-Commit #2329 (See

[jira] [Commented] (HDFS-3479) backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1

2012-06-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290558#comment-13290558 ] Colin Patrick McCabe commented on HDFS-3479: bq. written could be less than

[jira] [Commented] (HDFS-3492) fix some misuses of InputStream#skip

2012-06-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290560#comment-13290560 ] Hudson commented on HDFS-3492: -- Integrated in Hadoop-Hdfs-trunk-Commit #2402 (See

[jira] [Commented] (HDFS-3490) DN WebHDFS methods throw NPE if Namenode RPC address param not specified

2012-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290564#comment-13290564 ] Todd Lipcon commented on HDFS-3490: --- +1, looks good to me, thanks Nicholas!

[jira] [Commented] (HDFS-3371) EditLogFileInputStream: be more careful about closing streams when we're done with them.

2012-06-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290579#comment-13290579 ] Colin Patrick McCabe commented on HDFS-3371: Currently, this code gets an NPE:

[jira] [Commented] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290586#comment-13290586 ] Todd Lipcon commented on HDFS-3049: --- {code} + streams[curIdx].getName() + .

[jira] [Commented] (HDFS-3510) FSEditLog pre-allocation does not work in branch-1

2012-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290590#comment-13290590 ] Todd Lipcon commented on HDFS-3510: --- - writeFully: should probably take a

[jira] [Commented] (HDFS-3510) FSEditLog pre-allocation does not work in branch-1

2012-06-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290603#comment-13290603 ] Colin Patrick McCabe commented on HDFS-3510: bq. writeFully: should probably

[jira] [Updated] (HDFS-3508) avoid OOM while deserializing DelegationTokenIdentifer

2012-06-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3508: --- Attachment: HDFS-3508.003.patch * add unit tests avoid OOM while

[jira] [Commented] (HDFS-3492) fix some misuses of InputStream#skip

2012-06-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290615#comment-13290615 ] Hudson commented on HDFS-3492: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2348 (See

[jira] [Commented] (HDFS-3508) avoid OOM while deserializing DelegationTokenIdentifer

2012-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290652#comment-13290652 ] Hadoop QA commented on HDFS-3508: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-06-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3049: --- Attachment: HDFS-3049.028.patch sorry about that. Fixes: * remove WATERMELON * fix

[jira] [Commented] (HDFS-3479) backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1

2012-06-06 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290676#comment-13290676 ] Tsz Wo (Nicholas), SZE commented on HDFS-3479: -- I am okay if you are going to

[jira] [Commented] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290696#comment-13290696 ] Hadoop QA commented on HDFS-3049: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-06-06 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290702#comment-13290702 ] Tsz Wo (Nicholas), SZE commented on HDFS-3049: -- Tests were not executed in the

[jira] [Commented] (HDFS-3377) While Balancing more than 10 Blocks are being moved from one DN even though the maximum number of blocks to be moved in an iterations is hard coded to 5

2012-06-06 Thread Ashish Singhi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290770#comment-13290770 ] Ashish Singhi commented on HDFS-3377: - Marking it as Invalid. While

[jira] [Resolved] (HDFS-3377) While Balancing more than 10 Blocks are being moved from one DN even though the maximum number of blocks to be moved in an iterations is hard coded to 5

2012-06-06 Thread Ashish Singhi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Singhi resolved HDFS-3377. - Resolution: Invalid While Balancing more than 10 Blocks are being moved from one DN even