Re: Proposal: abandon protocol translator layer for cluster-internal RPCs

2012-03-19 Thread Jitendra Pandey
Wire compatibility in hdfs private protocols between different components is also important for rolling upgrades. We do want to support upgrading different components of a cluster independent of each other and wire compatibility is one of the essential prerequisites. Therefore, even if some

Re: Proposal: abandon protocol translator layer for cluster-internal RPCs

2012-03-19 Thread Robert Evans
I think what we are talking about here is removing some of the extra layers of abstraction in java. The wire protocol used will be identical in either case. It is just that we would have to use the Protocol Buffer Builder APIs instead of wrapping them with our own custom getters/setters. I

[jira] [Created] (HDFS-3113) httpfs does not support delegation tokens

2012-03-19 Thread Alejandro Abdelnur (Created) (JIRA)
httpfs does not support delegation tokens - Key: HDFS-3113 URL: https://issues.apache.org/jira/browse/HDFS-3113 Project: Hadoop HDFS Issue Type: New Feature Affects Versions: 0.23.3

Re: Proposal: abandon protocol translator layer for cluster-internal RPCs

2012-03-19 Thread Todd Lipcon
Exactly. We still have wire compatibility, we just avoid the redundant work of wrapping the whole thing. -Todd On Mon, Mar 19, 2012 at 8:11 AM, Robert Evans ev...@yahoo-inc.com wrote: I think what we are talking about here is removing some of the extra layers of abstraction in java.  The wire

Re: Proposal: abandon protocol translator layer for cluster-internal RPCs

2012-03-19 Thread Suresh Srinivas
I am sure Jitendra understands what Todd meant, given he was quite involved in the work. As Jitendra said, I would like to keep the wire type from the implementation type. Even for internal protocols. Rolling upgrades is important. I understand where Todd is coming from. We did this work for 10

[jira] [Created] (HDFS-3114) Remove implementing Writable interface for the internal data types in HDFS

2012-03-19 Thread Suresh Srinivas (Created) (JIRA)
Remove implementing Writable interface for the internal data types in HDFS -- Key: HDFS-3114 URL: https://issues.apache.org/jira/browse/HDFS-3114 Project: Hadoop HDFS

[jira] [Created] (HDFS-3115) Update hdfs design doc to consider HA NNs

2012-03-19 Thread Todd Lipcon (Created) (JIRA)
Update hdfs design doc to consider HA NNs - Key: HDFS-3115 URL: https://issues.apache.org/jira/browse/HDFS-3115 Project: Hadoop HDFS Issue Type: Bug Components: documentation Affects

[jira] [Resolved] (HDFS-3091) Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters.

2012-03-19 Thread Uma Maheswara Rao G (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G resolved HDFS-3091. --- Resolution: Fixed Assignee: Tsz Wo (Nicholas), SZE Target

[jira] [Created] (HDFS-3116) Typo in fetchdt error message

2012-03-19 Thread Aaron T. Myers (Created) (JIRA)
Typo in fetchdt error message - Key: HDFS-3116 URL: https://issues.apache.org/jira/browse/HDFS-3116 Project: Hadoop HDFS Issue Type: Bug Components: hdfs client Affects Versions: 0.24.0

Re: Proposal: abandon protocol translator layer for cluster-internal RPCs

2012-03-19 Thread Todd Lipcon
On Mon, Mar 19, 2012 at 9:17 AM, Suresh Srinivas sur...@hortonworks.com wrote: I am sure Jitendra understands what Todd meant, given he was quite involved in the work. As Jitendra said, I would like to keep the wire type from the implementation type. Even for internal protocols. Rolling

Re: Review Request: ByteBuffer-based read API for DFSInputStream (review 2)

2012-03-19 Thread Todd Lipcon
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4212/#review6103 --- Real close now!

[jira] [Created] (HDFS-3117) clean cache and can't start hadoop

2012-03-19 Thread cldoltd (Created) (JIRA)
clean cache and can't start hadoop -- Key: HDFS-3117 URL: https://issues.apache.org/jira/browse/HDFS-3117 Project: Hadoop HDFS Issue Type: Task Reporter: cldoltd i use command cache 3