[jira] [Commented] (HADOOP-13057) Async IPC server support
[ https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257619#comment-15257619 ] Siddharth Seth commented on HADOOP-13057: - It would - this is long pending. I don't think I'll be able to update the patch for the next several weeks. If anyone want to take a shot meanwhile, feel free to. > Async IPC server support > > > Key: HADOOP-13057 > URL: https://issues.apache.org/jira/browse/HADOOP-13057 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Affects Versions: 2.6.0 >Reporter: He Tianyi > > On some application, server may run out of handlers when performing many > blocking I/O operations during processing of each call (e.g. calling another > service, etc.). A viable solution is increasing number of handlers. > But this faces the problem that large amount of threads will consume much > memory (stack, etc.), and performance issues either. > After HADOOP-12909, work on asynchronization has been done on caller-side. > This is a similar proposal on server-side. > Suggesting the ability to handle requests asynchronously. > For example, in such server, calls may return a Future object instead of > immediate value. Then sends response to client in {{onSuccess}} or > {{onFailed}} callbacks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-13057) Async IPC server support
[ https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255911#comment-15255911 ] He Tianyi commented on HADOOP-13057: BTW, would be really appreciate to see further updates on HADOOP-11552. > Async IPC server support > > > Key: HADOOP-13057 > URL: https://issues.apache.org/jira/browse/HADOOP-13057 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Affects Versions: 2.6.0 >Reporter: He Tianyi > > On some application, server may run out of handlers when performing many > blocking I/O operations during processing of each call (e.g. calling another > service, etc.). A viable solution is increasing number of handlers. > But this faces the problem that large amount of threads will consume much > memory (stack, etc.), and performance issues either. > After HADOOP-12909, work on asynchronization has been done on caller-side. > This is a similar proposal on server-side. > Suggesting the ability to handle requests asynchronously. > For example, in such server, calls may return a Future object instead of > immediate value. Then sends response to client in {{onSuccess}} or > {{onFailed}} callbacks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-13057) Async IPC server support
[ https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255907#comment-15255907 ] He Tianyi commented on HADOOP-13057: Thanks, [~sseth]. Marked as duplicate. > Async IPC server support > > > Key: HADOOP-13057 > URL: https://issues.apache.org/jira/browse/HADOOP-13057 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Affects Versions: 2.6.0 >Reporter: He Tianyi > > On some application, server may run out of handlers when performing many > blocking I/O operations during processing of each call (e.g. calling another > service, etc.). A viable solution is increasing number of handlers. > But this faces the problem that large amount of threads will consume much > memory (stack, etc.), and performance issues either. > After HADOOP-12909, work on asynchronization has been done on caller-side. > This is a similar proposal on server-side. > Suggesting the ability to handle requests asynchronously. > For example, in such server, calls may return a Future object instead of > immediate value. Then sends response to client in {{onSuccess}} or > {{onFailed}} callbacks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-13057) Async IPC server support
[ https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255896#comment-15255896 ] Siddharth Seth commented on HADOOP-13057: - HADOOP-11552 targets the same. > Async IPC server support > > > Key: HADOOP-13057 > URL: https://issues.apache.org/jira/browse/HADOOP-13057 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Affects Versions: 2.6.0 >Reporter: He Tianyi > > On some application, server may run out of handlers when performing many > blocking I/O operations during processing of each call (e.g. calling another > service, etc.). A viable solution is increasing number of handlers. > But this faces the problem that large amount of threads will consume much > memory (stack, etc.), and performance issues either. > After HADOOP-12909, work on asynchronization has been done on caller-side. > This is a similar proposal on server-side. > Suggesting the ability to handle requests asynchronously. > For example, in such server, calls may return a Future object instead of > immediate value. Then sends response to client in {{onSuccess}} or > {{onFailed}} callbacks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-13057) Async IPC server support
[ https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255868#comment-15255868 ] He Tianyi commented on HADOOP-13057: Sure, added links and description. > Async IPC server support > > > Key: HADOOP-13057 > URL: https://issues.apache.org/jira/browse/HADOOP-13057 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Affects Versions: 2.6.0 >Reporter: He Tianyi > > On some application, server may run out of handlers when performing many > blocking I/O operations during processing of each call (e.g. calling another > service, etc.). A viable solution is increasing number of handlers. > But this faces the problem that large amount of threads will consume much > memory (stack, etc.), and performance issues either. > After HADOOP-12909, work on asynchronization has been done on caller-side. > This is a similar proposal on server-side. > Suggesting the ability to handle requests asynchronously. > For example, in such server, calls may return a Future object instead of > immediate value. Then sends response to client in {{onSuccess}} or > {{onFailed}} callbacks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-13057) Async IPC server support
[ https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255864#comment-15255864 ] Mingliang Liu commented on HADOOP-13057: Can you refer to [HDFS-9924] and [ HADOOP-12909] and describe the difference from here? Thanks. > Async IPC server support > > > Key: HADOOP-13057 > URL: https://issues.apache.org/jira/browse/HADOOP-13057 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Affects Versions: 2.6.0 >Reporter: He Tianyi > > On some application, server may run out of handlers when performing many > blocking I/O operations during processing of each call (e.g. calling another > service, etc.). A viable solution is increasing number of handlers. > But this faces the problem that large amount of threads will consume much > memory (stack, etc.), and performance issues either. > Suggesting the ability to handle requests asynchronously. > For example, in such server, calls may return a Future object instead of > immediate value. Then sends response to client in {{onSuccess}} or > {{onFailed}} callbacks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)