[jira] [Updated] (HDFS-5067) Support symlink operations

2013-09-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5067: - Status: Patch Available (was: Open) > Support symlink operations > -- > >

[jira] [Updated] (HDFS-5067) Support symlink operations

2013-09-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5067: - Attachment: HDFS-5067.patch > Support symlink operations > -- > >

[jira] [Commented] (HDFS-5067) Support symlink operations

2013-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761670#comment-13761670 ] Hadoop QA commented on HDFS-5067: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5157) Datanode should allow choosing the target storage

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761677#comment-13761677 ] Junping Du commented on HDFS-5157: -- Oh. I see. Just notice the field of targets in write/r

[jira] [Commented] (HDFS-5157) Datanode should allow choosing the target storage

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761682#comment-13761682 ] Junping Du commented on HDFS-5157: -- BTW, can we address volume policy first (as no depende

[jira] [Commented] (HDFS-4680) Audit logging of delegation tokens for MR tracing

2013-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761683#comment-13761683 ] Hadoop QA commented on HDFS-4680: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5157) Datanode should allow choosing the target storage

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5157: - Attachment: HDFS-5157-v1.patch Attach the first patch with addressing volumeChoosePolicy only. Test compil

[jira] [Updated] (HDFS-4990) Block placement for storage types

2013-09-09 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4990: - Attachment: h4990_20130909.patch h4990_20130909.patch: clean up some code. Still

[jira] [Commented] (HDFS-5170) BlockPlacementPolicyDefault uses the wrong classname when alerting to enable debug logging

2013-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761765#comment-13761765 ] Hudson commented on HDFS-5170: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #327 (See [https://b

[jira] [Commented] (HDFS-5170) BlockPlacementPolicyDefault uses the wrong classname when alerting to enable debug logging

2013-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761836#comment-13761836 ] Hudson commented on HDFS-5170: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1517 (See [https://

[jira] [Commented] (HDFS-5170) BlockPlacementPolicyDefault uses the wrong classname when alerting to enable debug logging

2013-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761870#comment-13761870 ] Hudson commented on HDFS-5170: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1543 (See [htt

[jira] [Updated] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5085: Status: Patch Available (was: Open) > Refactor o.a.h.nfs to support different types of authentications

[jira] [Updated] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5085: Attachment: HDFS-5085.002.patch Update the patch. > Refactor o.a.h.nfs to support different

[jira] [Commented] (HDFS-3564) Design enhancements to the pluggable blockplacementpolicy

2013-09-09 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762103#comment-13762103 ] Eli Collins commented on HDFS-3564: --- Looks like this change went in branch-1-win but not

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross rack/node group dependencies

2013-09-09 Thread Nikola Vujic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762003#comment-13762003 ] Nikola Vujic commented on HDFS-5168: That's righ, Junping. This is for the case when VM

[jira] [Commented] (HDFS-5120) add command-line support for manipulating cache pools

2013-09-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762122#comment-13762122 ] Colin Patrick McCabe commented on HDFS-5120: bq. listCachePools javadoc says Ca

[jira] [Created] (HDFS-5173) prettier dfsadmin -listCachePools output

2013-09-09 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5173: -- Summary: prettier dfsadmin -listCachePools output Key: HDFS-5173 URL: https://issues.apache.org/jira/browse/HDFS-5173 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-5173) prettier dfsadmin -listCachePools output

2013-09-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5173: --- Description: We can make the output of {{-listCachePools}} prettier by doing the same

[jira] [Created] (HDFS-5175) Provide clients a way to set IP header bits on connections

2013-09-09 Thread Lohit Vijayarenu (JIRA)
Lohit Vijayarenu created HDFS-5175: -- Summary: Provide clients a way to set IP header bits on connections Key: HDFS-5175 URL: https://issues.apache.org/jira/browse/HDFS-5175 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762062#comment-13762062 ] Hadoop QA commented on HDFS-5085: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5120) add command-line support for manipulating cache pools

2013-09-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5120: --- Attachment: HDFS-5120-caching.003.patch > add command-line support for manipulatin

[jira] [Updated] (HDFS-5120) add command-line support for manipulating cache pools

2013-09-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5120: --- Status: Patch Available (was: In Progress) committed to branch > add

[jira] [Updated] (HDFS-5120) add command-line support for manipulating cache pools

2013-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5120: -- Resolution: Fixed Fix Version/s: HDFS-4949 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-5120) add command-line support for manipulating cache pools

2013-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762131#comment-13762131 ] Andrew Wang commented on HDFS-5120: --- +1, thanks for addressing my feedback Colin. I'll fi

[jira] [Created] (HDFS-5174) Convert DFSAdmin to use Commons CLI for parsing arguments

2013-09-09 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-5174: - Summary: Convert DFSAdmin to use Commons CLI for parsing arguments Key: HDFS-5174 URL: https://issues.apache.org/jira/browse/HDFS-5174 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762127#comment-13762127 ] Hadoop QA commented on HDFS-5085: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5176) WebHDFS should support logical service names in URIs

2013-09-09 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762428#comment-13762428 ] Arpit Gupta commented on HDFS-5176: --- Is this a dup of HDFS-5122? > WebHD

[jira] [Commented] (HDFS-5175) Provide clients a way to set IP header bits on connections

2013-09-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762421#comment-13762421 ] Chris Nauroth commented on HDFS-5175: - Hi Lohit, {{DFSClient}} currently allows config

[jira] [Created] (HDFS-5176) WebHDFS should support logical service names in URIs

2013-09-09 Thread Eli Collins (JIRA)
Eli Collins created HDFS-5176: - Summary: WebHDFS should support logical service names in URIs Key: HDFS-5176 URL: https://issues.apache.org/jira/browse/HDFS-5176 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762506#comment-13762506 ] Brandon Li commented on HDFS-5085: -- Some early comments: The patch introduced a new packa

[jira] [Commented] (HDFS-4990) Block placement for storage types

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762509#comment-13762509 ] Junping Du commented on HDFS-4990: -- Hi Nicholas, thanks for the patch. Just some initial c

[jira] [Commented] (HDFS-5067) Support symlink operations

2013-09-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762540#comment-13762540 ] Brandon Li commented on HDFS-5067: -- I will add tests in a new patch. > Su

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross rack/node group dependencies

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762553#comment-13762553 ] Junping Du commented on HDFS-5168: -- IMO, this is a more generic scope effort as proposing

[jira] [Resolved] (HDFS-5176) WebHDFS should support logical service names in URIs

2013-09-09 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-5176. --- Resolution: Duplicate Yes, thanks for the reference Arpit. I didn't find that when searching. Closing

[jira] [Updated] (HDFS-5122) WebHDFS should support logical service names in URIs

2013-09-09 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-5122: -- Component/s: webhdfs Summary: WebHDFS should support logical service names in URIs (was: webhdf

[jira] [Updated] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5085: Attachment: HDFS-5085.003.patch Thanks for the comments Brandon! So I've renamed o.a.h.security to o.a.h.on

[jira] [Commented] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762608#comment-13762608 ] Hadoop QA commented on HDFS-5085: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5143) Hadoop cryptographic file system

2013-09-09 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762609#comment-13762609 ] Binglin Chang commented on HDFS-5143: - Hi Yi Liu, Nice document. I think one drawback

[jira] [Commented] (HDFS-3564) Design enhancements to the pluggable blockplacementpolicy

2013-09-09 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762622#comment-13762622 ] Suresh Srinivas commented on HDFS-3564: --- bq. Looks like this change went in branch-1-

[jira] [Updated] (HDFS-5053) NameNode should invoke DataNode APIs to coordinate caching

2013-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5053: -- Attachment: hdfs-5053-1.patch Here's a mondo patch that hooks everything up. At a high-level, I added so

[jira] [Work started] (HDFS-5053) NameNode should invoke DataNode APIs to coordinate caching

2013-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5053 started by Andrew Wang. > NameNode should invoke DataNode APIs to coordinate caching > -- > >

[jira] [Work started] (HDFS-5158) add command-line support for manipulating cache directives

2013-09-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5158 started by Colin Patrick McCabe. > add command-line support for manipulating cache directives > -

[jira] [Updated] (HDFS-5158) add command-line support for manipulating cache directives

2013-09-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5158: --- Attachment: HDFS-5158-caching.003.patch add support. there isn't a test in testHDFSCo

[jira] [Commented] (HDFS-5157) Datanode should allow choosing the target storage

2013-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762736#comment-13762736 ] Arpit Agarwal commented on HDFS-5157: - Hi Junping, thanks for posting the patch! I wil

[jira] [Updated] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5085: Attachment: HDFS-5085.004.patch Update the patch: fix small bugs in XDR and RpcProgramNfs3.

[jira] [Commented] (HDFS-5157) Datanode should allow choosing the target storage

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762760#comment-13762760 ] Junping Du commented on HDFS-5157: -- Ok.Thanks! > Datanode should allow ch

[jira] [Created] (HDFS-5177) blocksScheduled count should be decremented for abandoned blocks

2013-09-09 Thread Vinay (JIRA)
Vinay created HDFS-5177: --- Summary: blocksScheduled count should be decremented for abandoned blocks Key: HDFS-5177 URL: https://issues.apache.org/jira/browse/HDFS-5177 Project: Hadoop HDFS Issue Type

[jira] [Commented] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762762#comment-13762762 ] Hadoop QA commented on HDFS-5085: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

2013-09-09 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762769#comment-13762769 ] Vinay commented on HDFS-2956: - Hi [~atm], could you please take a look at the patch as you alre

[jira] [Commented] (HDFS-5085) Refactor o.a.h.nfs to support different types of authentications

2013-09-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762795#comment-13762795 ] Brandon Li commented on HDFS-5085: -- The new patch look good. Some minor comments and quest