[
https://issues.apache.org/jira/browse/FLINK-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052874#comment-15052874
]
ASF GitHub Bot commented on FLINK-3134:
---------------------------------------
GitHub user mxm opened a pull request:
https://github.com/apache/flink/pull/1450
[FLINK-3134][yarn] asynchronous YarnJobManager heartbeats
- use AMRMClientAsync instead of AMRMClient
- handle allocation and startup of containers in callbacks
- remove YarnHeartbeat message
The AMRMClientAsync uses one thread to communicate with the resource
manager and an additional thread to execute the callbacks.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mxm/flink yart-heartbeat-async
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1450.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1450
----
commit 8ec6d492795801ffc7c76f37a3a3200bbf85f81c
Author: Maximilian Michels <m...@apache.org>
Date: 2015-12-08T13:35:04Z
[FLINK-3134][yarn] asynchronous YarnJobManager heartbeats
- use AMRMClientAsync instead of AMRMClient
- handle allocation and startup of containers in callbacks
- remove YarnHeartbeat message
The AMRMClientAsync uses one thread to communicate with the resource
manager and an additional thread to execute the callbacks.
----
> Make YarnJobManager's allocate call asynchronous
> ------------------------------------------------
>
> Key: FLINK-3134
> URL: https://issues.apache.org/jira/browse/FLINK-3134
> Project: Flink
> Issue Type: Bug
> Components: YARN Client
> Affects Versions: 0.10.0, 1.0.0, 0.10.1
> Reporter: Maximilian Michels
> Assignee: Maximilian Michels
> Fix For: 1.0.0
>
>
> The {{allocate()}} call is used in the {{YarnJobManager}} to send a heartbeat
> to the YARN resource manager. This call may block the JobManager actor system
> for arbitrary time, e.g. if retry handlers are set up within the call to
> allocate.
> I propose to use the {{AMRMClientAsync}}'s callback methods to send
> heartbeats and update the container information. The API is available for our
> supported Hadoop versions (2.3.0 and above).
> https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/yarn/client/api/async/AMRMClientAsync.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
