[jira] [Commented] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445690#comment-13445690 ] Eli Collins commented on HDFS-2911: --- Makes sense =) > Gracefully handle

[jira] [Commented] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-08-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445688#comment-13445688 ] Suresh Srinivas commented on HDFS-2911: --- I actually thought about it. But given title

[jira] [Commented] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445656#comment-13445656 ] Eli Collins commented on HDFS-2911: --- No longer think we should do the kill -9 option?

[jira] [Resolved] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-08-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-2911. --- Resolution: Won't Fix I am going to mark this as won't fix. If anyone disagrees, then reopen w

[jira] [Updated] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3733: -- Resolution: Fixed Fix Version/s: 2.2.0-alpha Target Version/s: (was: 2.2.0-alpha)

[jira] [Resolved] (HDFS-2782) HA: Support multiple shared edits dirs

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2782. --- Resolution: Won't Fix Assignee: (was: Eli Collins) Target Version/s: (was:

[jira] [Assigned] (HDFS-2896) The 2NN incorrectly daemonizes

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-2896: - Assignee: (was: Eli Collins) > The 2NN incorrectly daemonizes > --

[jira] [Assigned] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-2911: - Assignee: (was: Eli Collins) > Gracefully handle OutOfMemoryErrors > -

[jira] [Assigned] (HDFS-2918) HA: Update HA docs to cover dfsadmin

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-2918: - Assignee: (was: Eli Collins) > HA: Update HA docs to cover dfsadmin >

[jira] [Assigned] (HDFS-3233) Move IP to FQDN conversion from DatanodeJSPHelper to DatanodeID

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3233: - Assignee: (was: Eli Collins) > Move IP to FQDN conversion from DatanodeJSPHelper to Datano

[jira] [Assigned] (HDFS-3232) Cleanup DatanodeInfo vs DatanodeID handling in DN servlets

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3232: - Assignee: (was: Eli Collins) > Cleanup DatanodeInfo vs DatanodeID handling in DN servlets

[jira] [Assigned] (HDFS-3640) Don't use Util#now or System#currentTimeMillis for calculating intervals

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3640: - Assignee: (was: Eli Collins) > Don't use Util#now or System#currentTimeMillis for calculat

[jira] [Commented] (HDFS-3135) Build a war file for HttpFS instead of packaging the server (tomcat) along with the application.

2012-08-30 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445608#comment-13445608 ] Alejandro Abdelnur commented on HDFS-3135: -- Bundling a Tomcat Server with HttpFS i

[jira] [Commented] (HDFS-3866) HttpFS build should download Tomcat via Maven instead of directly

2012-08-30 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445605#comment-13445605 ] Alejandro Abdelnur commented on HDFS-3866: -- HttpFS uses a Tomcat server to run the

[jira] [Commented] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445583#comment-13445583 ] Hadoop QA commented on HDFS-3873: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445565#comment-13445565 ] Hadoop QA commented on HDFS-3733: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3876) NN should not RPC to self to find trash defaults (causes deadlock)

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445531#comment-13445531 ] Eli Collins commented on HDFS-3876: --- I'll try to get a patch up tonight, if it's blocking

[jira] [Assigned] (HDFS-3876) NN should not RPC to self to find trash defaults (causes deadlock)

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3876: - Assignee: Eli Collins > NN should not RPC to self to find trash defaults (causes deadlock) > -

[jira] [Commented] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445510#comment-13445510 ] Eli Collins commented on HDFS-3733: --- Looks great Andy. +1 pending jenkins.

[jira] [Commented] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445490#comment-13445490 ] Daryn Sharp commented on HDFS-3873: --- Failed test precedes this patch, it's fixed by HDFS-

[jira] [Updated] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3733: Attachment: hdfs-3733-7.txt > Audit logs should include WebHDFS access > ---

[jira] [Commented] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445468#comment-13445468 ] Andy Isaacson commented on HDFS-3733: - bq. I have to logAuditEvent(false under any exce

[jira] [Commented] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445466#comment-13445466 ] Hadoop QA commented on HDFS-3873: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3863) QJM: track last "committed" txid

2012-08-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3863: -- Attachment: hdfs-3863.txt I've put this through a few thousand runs of the {{testRandomized}} fault test

[jira] [Updated] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3873: -- Attachment: (was: HDFS-3873.patch) > Hftp assumes security is disabled if token fetch fails > --

[jira] [Updated] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3873: -- Attachment: HDFS-3873.patch Re-attaching trunk patch since build tried to use 23 patch.

[jira] [Created] (HDFS-3876) NN should not RPC to self to find trash defaults (causes deadlock)

2012-08-30 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3876: - Summary: NN should not RPC to self to find trash defaults (causes deadlock) Key: HDFS-3876 URL: https://issues.apache.org/jira/browse/HDFS-3876 Project: Hadoop HDFS

[jira] [Commented] (HDFS-3875) Issue handling checksum errors in write pipeline

2012-08-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445411#comment-13445411 ] Todd Lipcon commented on HDFS-3875: --- Just to brainstorm, here's one potential solution: -

[jira] [Commented] (HDFS-3875) Issue handling checksum errors in write pipeline

2012-08-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445385#comment-13445385 ] Todd Lipcon commented on HDFS-3875: --- Here's the recovery from the perspective of the NN:

[jira] [Created] (HDFS-3875) Issue handling checksum errors in write pipeline

2012-08-30 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3875: - Summary: Issue handling checksum errors in write pipeline Key: HDFS-3875 URL: https://issues.apache.org/jira/browse/HDFS-3875 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-3871) Change NameNodeProxies to use HADOOP-8748

2012-08-30 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445378#comment-13445378 ] Arun C Murthy commented on HDFS-3871: - The test failures and findbugs warnings are not

[jira] [Commented] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445372#comment-13445372 ] Hadoop QA commented on HDFS-3873: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3873: -- Attachment: HDFS-3873.branch-23.patch Update test to expect different exception from 23.

[jira] [Updated] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3873: -- Status: Patch Available (was: Open) > Hftp assumes security is disabled if token fetch fails >

[jira] [Updated] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3873: -- Attachment: HDFS-3873.patch Only considers a connection refused exception as "security disabled" since a

[jira] [Commented] (HDFS-3874) Exception when client reports bad checksum to NN

2012-08-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445350#comment-13445350 ] Todd Lipcon commented on HDFS-3874: --- The bug seems to be that the datanode doesn't report

[jira] [Updated] (HDFS-3837) Fix DataNode.recoverBlock findbugs warning

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3837: -- Resolution: Fixed Fix Version/s: 2.2.0-alpha Target Version/s: (was: 2.2.0-alpha)

[jira] [Created] (HDFS-3874) Exception when client reports bad checksum to NN

2012-08-30 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3874: - Summary: Exception when client reports bad checksum to NN Key: HDFS-3874 URL: https://issues.apache.org/jira/browse/HDFS-3874 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-3833) TestDFSShell fails on Windows due to file concurrent read write

2012-08-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445330#comment-13445330 ] Brandon Li commented on HDFS-3833: -- The failed tests are not related with this change.

[jira] [Commented] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445327#comment-13445327 ] Hadoop QA commented on HDFS-3733: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3833) TestDFSShell fails on Windows due to file concurrent read write

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445315#comment-13445315 ] Hadoop QA commented on HDFS-3833: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3863) QJM: track last "committed" txid

2012-08-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445301#comment-13445301 ] Todd Lipcon commented on HDFS-3863: --- Hi Chao. I tried to add the sanity checks you sugges

[jira] [Updated] (HDFS-3869) QJM: expose non-file journal manager details in web UI

2012-08-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3869: -- Attachment: hdfs-3869.txt Attached patch has a little cleanup (formatting and javadoc) and also adds the

[jira] [Updated] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3733: Attachment: hdfs-3733-6.txt > Audit logs should include WebHDFS access > ---

[jira] [Commented] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445259#comment-13445259 ] Andy Isaacson commented on HDFS-3733: - bq. In FSN#getFileInfo why catch UnresolvedLinkE

[jira] [Updated] (HDFS-3861) Deadlock in DFSClient

2012-08-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3861: -- Resolution: Fixed Fix Version/s: (was: 0.23.4) 0.23.3 Target V

[jira] [Commented] (HDFS-3837) Fix DataNode.recoverBlock findbugs warning

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445248#comment-13445248 ] Hadoop QA commented on HDFS-3837: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3833) TestDFSShell fails on Windows due to file concurrent read write

2012-08-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-3833: - Affects Version/s: 3.0.0 > TestDFSShell fails on Windows due to file concurrent read write > -

[jira] [Updated] (HDFS-3833) TestDFSShell fails on Windows due to file concurrent read write

2012-08-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-3833: - Status: Patch Available (was: Open) > TestDFSShell fails on Windows due to file concurrent read write

[jira] [Updated] (HDFS-3833) TestDFSShell fails on Windows due to file concurrent read write

2012-08-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-3833: - Attachment: HDFS-3833.patch > TestDFSShell fails on Windows due to file concurrent read write > --

[jira] [Updated] (HDFS-3869) QJM: expose non-file journal manager details in web UI

2012-08-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3869: -- Attachment: lagging-jn.png dir-failed.png open-for-write.png

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-08-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445179#comment-13445179 ] Colin Patrick McCabe commented on HDFS-3540: bq. Before HDFS-3521, there is a U

[jira] [Updated] (HDFS-2261) AOP unit tests are not getting compiled or run

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2261: -- Component/s: test Description: The tests in src/test/aop are not getting compiled or run

[jira] [Updated] (HDFS-3837) Fix DataNode.recoverBlock findbugs warning

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3837: -- Attachment: hdfs-3837.txt No problem, can always do cleanup in another change. Updated patch just does

[jira] [Created] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-08-30 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-3873: - Summary: Hftp assumes security is disabled if token fetch fails Key: HDFS-3873 URL: https://issues.apache.org/jira/browse/HDFS-3873 Project: Hadoop HDFS Issue Type

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-08-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445159#comment-13445159 ] Colin Patrick McCabe commented on HDFS-3540: bq. It seems to me that recovery m

[jira] [Commented] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445155#comment-13445155 ] Eli Collins commented on HDFS-3733: --- Andy, looking good! - In FSN#getFileInfo why catch

[jira] [Commented] (HDFS-3871) Change NameNodeProxies to use HADOOP-8748

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445123#comment-13445123 ] Hadoop QA commented on HDFS-3871: - -1 overall. Here are the results of testing the latest

[jira] [Created] (HDFS-3872) Store block ID in block metadata header

2012-08-30 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3872: - Summary: Store block ID in block metadata header Key: HDFS-3872 URL: https://issues.apache.org/jira/browse/HDFS-3872 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-2695) ReadLock should be enough for FsNameSystem#renewLease.

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445070#comment-13445070 ] Hadoop QA commented on HDFS-2695: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1490) TransferFSImage should timeout

2012-08-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445065#comment-13445065 ] Steve Loughran commented on HDFS-1490: -- # typo in DFS_IMAGE_TRANFER_TIMEOUT_KEY # tim

[jira] [Commented] (HDFS-3859) QJM: implement md5sum verification

2012-08-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445061#comment-13445061 ] Steve Loughran commented on HDFS-3859: -- @Todd : this is why a CRC check would be simpl

[jira] [Updated] (HDFS-3871) Change NameNodeProxies to use HADOOP-8748

2012-08-30 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3871: - Component/s: hdfs client Hadoop Flags: Reviewed +1 for both the trunk and the

[jira] [Updated] (HDFS-3871) Change NameNodeProxies to use HADOOP-8748

2012-08-30 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3871: - Status: Patch Available (was: Open) > Change NameNodeProxies to use HADOOP-87

[jira] [Updated] (HDFS-2695) ReadLock should be enough for FsNameSystem#renewLease.

2012-08-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-2695: -- Target Version/s: 3.0.0 Status: Patch Available (was: Open) > ReadLoc

[jira] [Updated] (HDFS-2695) ReadLock should be enough for FsNameSystem#renewLease.

2012-08-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-2695: -- Attachment: HDFS-2695.patch > ReadLock should be enough for FsNameSystem#renewLease.

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-08-30 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444975#comment-13444975 ] Tsz Wo (Nicholas), SZE commented on HDFS-3540: -- {quote} Recovery mode will alw

[jira] [Commented] (HDFS-3870) QJM: add metrics to JournalNode

2012-08-30 Thread Chao Shi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444971#comment-13444971 ] Chao Shi commented on HDFS-3870: One more: How often a JN is lagging (by counting the numbe

[jira] [Updated] (HDFS-3871) Change NameNodeProxies to use HADOOP-8748

2012-08-30 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HDFS-3871: Attachment: HDFS-3781_branch1.patch Patch for branch-1. > Change NameNodeProxies to

[jira] [Updated] (HDFS-3871) Change NameNodeProxies to use HADOOP-8748

2012-08-30 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HDFS-3871: Attachment: HDFS-3781.patch Patch for trunk. > Change NameNodeProxies to use HADOOP

[jira] [Commented] (HDFS-3863) QJM: track last "committed" txid

2012-08-30 Thread Chao Shi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444946#comment-13444946 ] Chao Shi commented on HDFS-3863: Todd, your patch looks good to me. How about these: 1) Co

[jira] [Created] (HDFS-3871) Change NameNodeProxies to use HADOOP-8748

2012-08-30 Thread Arun C Murthy (JIRA)
Arun C Murthy created HDFS-3871: --- Summary: Change NameNodeProxies to use HADOOP-8748 Key: HDFS-3871 URL: https://issues.apache.org/jira/browse/HDFS-3871 Project: Hadoop HDFS Issue Type: Improve

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-08-30 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444890#comment-13444890 ] Luke Lu commented on HDFS-3540: --- It seems to me that recovery mode and edit log toleration se

[jira] [Commented] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444794#comment-13444794 ] Hadoop QA commented on HDFS-3733: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-08-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444776#comment-13444776 ] Colin Patrick McCabe commented on HDFS-3540: bq. If I have not missed anything,

[jira] [Updated] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3733: - Hadoop Flags: Reviewed +1 Andy, thanks for the update. The new patch looks good.

[jira] [Commented] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444748#comment-13444748 ] Andy Isaacson commented on HDFS-3733: - bq. How about moving isWebHdfsInvocation() and g

[jira] [Updated] (HDFS-3733) Audit logs should include WebHDFS access

2012-08-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3733: Attachment: hdfs-3733-4.txt Attaching latest version of patch. > Audit logs should