Hassan Eslami created GIRAPH-1027:
-------------------------------------
Summary: Improve flow-control on sender side
Key: GIRAPH-1027
URL: https://issues.apache.org/jira/browse/GIRAPH-1027
Project: Giraph
Issue Type: Improvement
Components: graph
Reporter: Hassan Eslami
Assignee: Hassan Eslami
Currently, a sender worker will keep all open requests (and optionally up to a
certain number of total open requests) in its own memory. This behavior may
cause high memory usage in sender side. Also, since messages can arrive to a
worker at an arbitrary rate, receiver may not have the ability to handle all
incoming messages, hence we may see a large memory footprint in receiver as
well. This diff addresses the problem by limiting the number of open requests
per worker in sender side. Also, it provides a cache of unsent requests on
sender in case the sender already sent enough messages to another worker but
has not received any response back.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)