[ https://issues.apache.org/jira/browse/HADOOP-13144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391491#comment-16391491 ]
Wei Yan commented on HADOOP-13144: ---------------------------------- Thanks for the patch [~elgoiri]. I tried it yesterday and it worked well. The Router RPC throughput has been largely improved, and RPC handlers are not blocked on the connection itself. BTW, it also needs to add new function implementation in classed ProtobufRpcEngine and TestRPC.StoppedRpcEngine. > Enhancing IPC client throughput via multiple connections per user > ----------------------------------------------------------------- > > Key: HADOOP-13144 > URL: https://issues.apache.org/jira/browse/HADOOP-13144 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc > Reporter: Jason Kace > Priority: Minor > Attachments: HADOOP-13144.000.patch > > > The generic IPC client ({{org.apache.hadoop.ipc.Client}}) utilizes a single > connection thread for each {{ConnectionId}}. The {{ConnectionId}} is unique > to the connection's remote address, ticket and protocol. Each ConnectionId > is 1:1 mapped to a connection thread by the client via a map cache. > The result is to serialize all IPC read/write activity through a single > thread for a each user/ticket + address. If a single user makes repeated > calls (1k-100k/sec) to the same destination, the IPC client becomes a > bottleneck. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org