[jira] [Commented] (HDFS-4518) Finer grained metrics for HDFS capacity

2013-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590418#comment-13590418 ] Hudson commented on HDFS-4518: -- Integrated in Hadoop-Yarn-trunk #142 (See

[jira] [Updated] (HDFS-4525) Provide an API for knowing that whether file is closed or not.

2013-03-01 Thread SreeHari (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SreeHari updated HDFS-4525: --- Attachment: HDFS-4525.patch Attached the patch Provide an API for knowing that whether file

[jira] [Commented] (HDFS-4518) Finer grained metrics for HDFS capacity

2013-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590489#comment-13590489 ] Hudson commented on HDFS-4518: -- Integrated in Hadoop-Hdfs-trunk #1331 (See

[jira] [Commented] (HDFS-4518) Finer grained metrics for HDFS capacity

2013-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590538#comment-13590538 ] Hudson commented on HDFS-4518: -- Integrated in Hadoop-Mapreduce-trunk #1359 (See

[jira] [Commented] (HDFS-4128) 2NN gets stuck in inconsistent state if edit log replay fails in the middle

2013-03-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590586#comment-13590586 ] Daryn Sharp commented on HDFS-4128: --- Patch looks straightforward. A few comments: *

[jira] [Updated] (HDFS-4540) namenode http server should use the web authentication keytab for spnego principal

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HDFS-4540: -- Fix Version/s: (was: 2.0.4-beta) namenode http server should use the web authentication keytab

[jira] [Updated] (HDFS-4540) namenode http server should use the web authentication keytab for spnego principal

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HDFS-4540: -- Target Version/s: 2.0.4-beta namenode http server should use the web authentication keytab for

[jira] [Commented] (HDFS-4532) RPC call queue may fill due to current user lookup

2013-03-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590656#comment-13590656 ] Kihwal Lee commented on HDFS-4532: -- The patch itself looks good, but there is one thing I

[jira] [Commented] (HDFS-4128) 2NN gets stuck in inconsistent state if edit log replay fails in the middle

2013-03-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590671#comment-13590671 ] Kihwal Lee commented on HDFS-4128: -- I agree that exceptions during merge will rarely be

[jira] [Created] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Arpit Gupta (JIRA)
Arpit Gupta created HDFS-4541: - Summary: set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default Key: HDFS-4541 URL:

[jira] [Updated] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HDFS-4541: -- Attachment: HDFS-4541.patch set hadoop.log.dir and hadoop.id.str when starting secure datanode so

[jira] [Commented] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590735#comment-13590735 ] Arpit Gupta commented on HDFS-4541: --- Attached a patch with it applied secure datanode

[jira] [Updated] (HDFS-4128) 2NN gets stuck in inconsistent state if edit log replay fails in the middle

2013-03-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4128: - Attachment: hdfs-4128.b023.patch 2NN gets stuck in inconsistent state if edit log replay fails in

[jira] [Updated] (HDFS-4128) 2NN gets stuck in inconsistent state if edit log replay fails in the middle

2013-03-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4128: - Attachment: hdfs-4128.patch 2NN gets stuck in inconsistent state if edit log replay fails in the

[jira] [Commented] (HDFS-4412) Support HDFS IO throttling

2013-03-01 Thread Denis Petrov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590743#comment-13590743 ] Denis Petrov commented on HDFS-4412: It would be nice to throttle on per-datanode

[jira] [Commented] (HDFS-4128) 2NN gets stuck in inconsistent state if edit log replay fails in the middle

2013-03-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590744#comment-13590744 ] Kihwal Lee commented on HDFS-4128: -- The revised patch includes the improved test case that

[jira] [Commented] (HDFS-4540) namenode http server should use the web authentication keytab for spnego principal

2013-03-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590748#comment-13590748 ] Suresh Srinivas commented on HDFS-4540: --- {noformat} + String httpKeytabKey =

[jira] [Commented] (HDFS-4540) namenode http server should use the web authentication keytab for spnego principal

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590763#comment-13590763 ] Arpit Gupta commented on HDFS-4540: --- Good point Suresh. Let me update the patch with more

[jira] [Updated] (HDFS-4540) namenode http server should use the web authentication keytab for spnego principal

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HDFS-4540: -- Attachment: HDFS-4540.patch updated the patch with the check. namenode http server

[jira] [Updated] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HDFS-4541: -- Attachment: HDFS-4541.patch regenerated the patch --no-prefix set hadoop.log.dir and

[jira] [Commented] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590798#comment-13590798 ] Chris Nauroth commented on HDFS-4541: - Hi, Arpit. With this patch, does a secure data

[jira] [Commented] (HDFS-4530) return buffer into direct bufferPool in BlockReaderLocal as possible

2013-03-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590812#comment-13590812 ] Colin Patrick McCabe commented on HDFS-4530: looks good to me.

[jira] [Commented] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590819#comment-13590819 ] Arpit Gupta commented on HDFS-4541: --- @Chris Actually it will appear 3 times after this

[jira] [Commented] (HDFS-4412) Support HDFS IO throttling

2013-03-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590824#comment-13590824 ] Colin Patrick McCabe commented on HDFS-4412: I think you need to decide what

[jira] [Commented] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590828#comment-13590828 ] Chris Nauroth commented on HDFS-4541: - {quote} It appears twice for any hdfs service

[jira] [Updated] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HDFS-4541: -- Status: Patch Available (was: Open) set hadoop.log.dir and hadoop.id.str when starting secure

[jira] [Commented] (HDFS-4128) 2NN gets stuck in inconsistent state if edit log replay fails in the middle

2013-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590835#comment-13590835 ] Hadoop QA commented on HDFS-4128: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4532) RPC call queue may fill due to current user lookup

2013-03-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590840#comment-13590840 ] Suresh Srinivas commented on HDFS-4532: --- Other than the same concern as Kihwal: #

[jira] [Commented] (HDFS-4540) namenode http server should use the web authentication keytab for spnego principal

2013-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590884#comment-13590884 ] Hadoop QA commented on HDFS-4540: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4412) Support HDFS IO throttling

2013-03-01 Thread Denis Petrov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590895#comment-13590895 ] Denis Petrov commented on HDFS-4412: I am trying to avoid a problem with hot spots in

[jira] [Commented] (HDFS-4532) RPC call queue may fill due to current user lookup

2013-03-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590915#comment-13590915 ] Daryn Sharp commented on HDFS-4532: --- @Kihwal: Good questions, and a cursory scan of the

[jira] [Updated] (HDFS-4532) RPC call queue may fill due to current user lookup

2013-03-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-4532: -- Attachment: HDFS-4532.patch Removed the tab gremlin. RPC call queue may fill due to

[jira] [Commented] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590924#comment-13590924 ] Hadoop QA commented on HDFS-4541: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4541) set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default

2013-03-01 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590926#comment-13590926 ] Arpit Gupta commented on HDFS-4541: --- No tests added as this is a change to shell scripts.

[jira] [Commented] (HDFS-3367) WebHDFS doesn't use the logged in user when opening connections

2013-03-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590946#comment-13590946 ] Daryn Sharp commented on HDFS-3367: --- I think I've got a patch ready, so I'm going to file

[jira] [Created] (HDFS-4542) Webhdfs doesn't support secure proxy users

2013-03-01 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4542: - Summary: Webhdfs doesn't support secure proxy users Key: HDFS-4542 URL: https://issues.apache.org/jira/browse/HDFS-4542 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-4542) Webhdfs doesn't support secure proxy users

2013-03-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-4542: -- Attachment: HDFS-4542.patch Will soon post back-port to 23. Webhdfs doesn't support

[jira] [Updated] (HDFS-4542) Webhdfs doesn't support secure proxy users

2013-03-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-4542: -- Status: Patch Available (was: Open) Webhdfs doesn't support secure proxy users

[jira] [Updated] (HDFS-3277) fail over to loading a different FSImage if the first one we try to load is corrupt

2013-03-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3277: -- Attachment: HDFS-3277.005.patch Forgot a license header. fail over to loading a

[jira] [Commented] (HDFS-4542) Webhdfs doesn't support secure proxy users

2013-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590961#comment-13590961 ] Hadoop QA commented on HDFS-4542: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4542) Webhdfs doesn't support secure proxy users

2013-03-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590964#comment-13590964 ] Alejandro Abdelnur commented on HDFS-4542: -- the doAs user should be the current

[jira] [Commented] (HDFS-3277) fail over to loading a different FSImage if the first one we try to load is corrupt

2013-03-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590969#comment-13590969 ] Colin Patrick McCabe commented on HDFS-3277: Thanks for picking this up,

[jira] [Commented] (HDFS-4542) Webhdfs doesn't support secure proxy users

2013-03-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13590991#comment-13590991 ] Daryn Sharp commented on HDFS-4542: --- Unfortunately, no... The user is context sensitive.

[jira] [Commented] (HDFS-4532) RPC call queue may fill due to current user lookup

2013-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591016#comment-13591016 ] Hadoop QA commented on HDFS-4532: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2576) Namenode should have a favored nodes hint to enable clients to have control over block placement.

2013-03-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591017#comment-13591017 ] Devaraj Das commented on HDFS-2576: --- Thanks to everyone who chimed in on this issue. I

[jira] [Commented] (HDFS-2576) Namenode should have a favored nodes hint to enable clients to have control over block placement.

2013-03-01 Thread Jonathan Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591028#comment-13591028 ] Jonathan Hsieh commented on HDFS-2576: -- yup, I agree. Namenode

[jira] [Commented] (HDFS-3277) fail over to loading a different FSImage if the first one we try to load is corrupt

2013-03-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591068#comment-13591068 ] Andrew Wang commented on HDFS-3277: --- I think it's okay, since the restore-on-failure in

[jira] [Commented] (HDFS-3277) fail over to loading a different FSImage if the first one we try to load is corrupt

2013-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591075#comment-13591075 ] Hadoop QA commented on HDFS-3277: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4542) Webhdfs doesn't support secure proxy users

2013-03-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591107#comment-13591107 ] Daryn Sharp commented on HDFS-4542: --- Sorry Alejandro, I read your comment backwards and

[jira] [Commented] (HDFS-4542) Webhdfs doesn't support secure proxy users

2013-03-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591117#comment-13591117 ] Alejandro Abdelnur commented on HDFS-4542: -- Argh, it is OK, was reading wrong the

[jira] [Created] (HDFS-4543) Activate native-win profile by default on Windows

2013-03-01 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-4543: --- Summary: Activate native-win profile by default on Windows Key: HDFS-4543 URL: https://issues.apache.org/jira/browse/HDFS-4543 Project: Hadoop HDFS Issue