[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14542307#comment-14542307 ]
Louis Ryan commented on HDFS-7966: ---------------------------------- Hey, Im the one working on the grpc impl for HBase so I can help answer questions on that. 1 - grpc is a general purpose content type agnostic transport layer so you can happily use it without using proto. 2 - If you're using your own payload encoding then tagging flush points in a streaming RPC seems pretty trivial. If you'd like to try grpc let me know and I can provide pointers / answer questions > New Data Transfer Protocol via HTTP/2 > ------------------------------------- > > Key: HDFS-7966 > URL: https://issues.apache.org/jira/browse/HDFS-7966 > Project: Hadoop HDFS > Issue Type: New Feature > Reporter: Haohui Mai > Assignee: Qianqian Shi > Labels: gsoc, gsoc2015, mentor > Attachments: GSoC2015_Proposal.pdf > > > The current Data Transfer Protocol (DTP) implements a rich set of features > that span across multiple layers, including: > * Connection pooling and authentication (session layer) > * Encryption (presentation layer) > * Data writing pipeline (application layer) > All these features are HDFS-specific and defined by implementation. As a > result it requires non-trivial amount of work to implement HDFS clients and > servers. > This jira explores to delegate the responsibilities of the session and > presentation layers to the HTTP/2 protocol. Particularly, HTTP/2 handles > connection multiplexing, QoS, authentication and encryption, reducing the > scope of DTP to the application layer only. By leveraging the existing HTTP/2 > library, it should simplify the implementation of both HDFS clients and > servers. -- This message was sent by Atlassian JIRA (v6.3.4#6332)