[
https://issues.apache.org/jira/browse/FLINK-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15288745#comment-15288745
]
ASF GitHub Bot commented on FLINK-3667:
---------------------------------------
Github user rmetzger commented on the pull request:
https://github.com/apache/flink/pull/1978#issuecomment-219986951
I tried the change on a cluster, but the YARN session is not deploying:
```
2016-05-18 10:25:12,181 INFO
org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider - Failing over
to rm75
2016-05-18 10:25:12,300 INFO
org.apache.flink.yarn.YarnFlinkResourceManager - Trying to
associate with JobManager leader akka://flink/user/jobmanager#49723024
2016-05-18 10:25:12,307 INFO
org.apache.flink.yarn.YarnFlinkResourceManager - Resource
Manager associating with leading JobManager
Actor[akka://flink/user/jobmanager#49723024] - leader session null
2016-05-18 10:25:12,308 INFO
org.apache.flink.yarn.YarnFlinkResourceManager - Requesting new
TaskManager container with 1024 megabytes memory. Pending requests: 1
2016-05-18 10:25:12,317 INFO
org.apache.flink.yarn.YarnFlinkResourceManager - Requesting new
TaskManager container with 1024 megabytes memory. Pending requests: 2
2016-05-18 10:25:13,369 INFO
org.apache.flink.yarn.YarnFlinkResourceManager - Received new
container: container_1463565924024_0001_01_000002 - Remaining pending container
requests: 1
2016-05-18 10:25:13,369 INFO
org.apache.flink.yarn.YarnFlinkResourceManager - Launching
TaskManager in container
ResourceID{resourceId='container_1463565924024_0001_01_000002'} on host
cdh544-worker-5.c.astral-sorter-757.internal
2016-05-18 10:25:13,372 INFO
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy -
Opening proxy : cdh544-worker-5.c.astral-sorter-757.internal:8041
2016-05-18 10:25:13,752 INFO
org.apache.flink.yarn.YarnFlinkResourceManager - Received new
container: container_1463565924024_0001_01_000003 - Remaining pending container
requests: 0
2016-05-18 10:25:13,752 INFO
org.apache.flink.yarn.YarnFlinkResourceManager - Launching
TaskManager in container
ResourceID{resourceId='container_1463565924024_0001_01_000003'} on host
cdh544-worker-2.c.astral-sorter-757.internal
2016-05-18 10:25:13,753 INFO
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy -
Opening proxy : cdh544-worker-2.c.astral-sorter-757.internal:8041
2016-05-18 10:25:17,738 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:17,740 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:18,101 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:18,101 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:18,621 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:18,621 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:18,977 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:18,978 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:19,120 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:19,121 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:19,997 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:19,998 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:21,140 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:21,141 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:22,016 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:22,016 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:25,161 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:25,161 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:26,037 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:26,037 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:27,831 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:27,831 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:28,131 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:28,132 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:28,351 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:28,351 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:28,651 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:28,651 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:28,737 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:28,737 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:29,007 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:29,007 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:29,151 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:29,152 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:29,256 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:29,257 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:29,370 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:29,371 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:29,527 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:29,528 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:29,671 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:29,672 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:29,672 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:29,672 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:30,026 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:30,027 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:30,276 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:30,277 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:30,547 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:30,548 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:30,548 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:30,549 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:30,691 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:30,691 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:31,170 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:31,171 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:31,391 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:31,392 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:31,567 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:31,567 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:31,692 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:31,693 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:31,693 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:31,694 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:32,047 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:32,047 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:32,298 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:32,298 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:32,569 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:32,570 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:32,570 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:32,571 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:32,711 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:32,712 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:32,712 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:32,713 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:33,181 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:33,181 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:33,587 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:33,587 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:33,588 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:33,589 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:34,056 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:34,057 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:34,731 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:34,731 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:35,191 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:35,192 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:35,410 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:35,411 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:35,607 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:35,607 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:35,711 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:35,711 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:35,712 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:35,712 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:36,068 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:36,069 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:36,316 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:36,317 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:36,586 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:36,587 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:36,587 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:36,587 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:36,731 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:36,731 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:36,733 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:36,733 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:37,607 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:37,608 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:37,608 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'}
2016-05-18 10:25:37,609 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000002'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:37,860 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:37,861 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:38,161 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:38,161 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:38,380 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
2016-05-18 10:25:38,381 WARN org.apache.flink.yarn.YarnJobManager
- TaskManager's resource id
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'} is not
registered with ResourceManager. Refusing registration.
2016-05-18 10:25:38,382 WARN
org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager
resource registration failed for
ResourceID{resourceId='container_e58_1463565924024_0001_01_000003'}
```
> Generalize client<->cluster communication
> -----------------------------------------
>
> Key: FLINK-3667
> URL: https://issues.apache.org/jira/browse/FLINK-3667
> Project: Flink
> Issue Type: Improvement
> Components: YARN Client
> Reporter: Maximilian Michels
> Assignee: Maximilian Michels
>
> Here are some notes I took when inspecting the client<->cluster classes with
> regard to future integration of other resource management frameworks in
> addition to Yarn (e.g. Mesos).
> {noformat}
> 1 Cluster Client Abstraction
> ════════════════════════════
> 1.1 Status Quo
> ──────────────
> 1.1.1 FlinkYarnClient
> ╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌
> • Holds the cluster configuration (Flink-specific and Yarn-specific)
> • Contains the deploy() method to deploy the cluster
> • Creates the Hadoop Yarn client
> • Receives the initial job manager address
> • Bootstraps the FlinkYarnCluster
> 1.1.2 FlinkYarnCluster
> ╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌
> • Wrapper around the Hadoop Yarn client
> • Queries cluster for status updates
> • Life time methods to start and shutdown the cluster
> • Flink specific features like shutdown after job completion
> 1.1.3 ApplicationClient
> ╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌
> • Acts as a middle-man for asynchronous cluster communication
> • Designed to communicate with Yarn, not used in Standalone mode
> 1.1.4 CliFrontend
> ╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌
> • Deeply integrated with FlinkYarnClient and FlinkYarnCluster
> • Constantly distinguishes between Yarn and Standalone mode
> • Would be nice to have a general abstraction in place
> 1.1.5 Client
> ╌╌╌╌╌╌╌╌╌╌╌╌
> • Job submission and Job related actions, agnostic of resource framework
> 1.2 Proposal
> ────────────
> 1.2.1 ClusterConfig (before: AbstractFlinkYarnClient)
> ╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌
> • Extensible cluster-agnostic config
> • May be extended by specific cluster, e.g. YarnClusterConfig
> 1.2.2 ClusterClient (before: AbstractFlinkYarnClient)
> ╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌
> • Deals with cluster (RM) specific communication
> • Exposes framework agnostic information
> • YarnClusterClient, MesosClusterClient, StandaloneClusterClient
> 1.2.3 FlinkCluster (before: AbstractFlinkYarnCluster)
> ╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌
> • Basic interface to communicate with a running cluster
> • Receives the ClusterClient for cluster-specific communication
> • Should not have to care about the specific implementations of the
> client
> 1.2.4 ApplicationClient
> ╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌
> • Can be changed to work cluster-agnostic (first steps already in
> FLINK-3543)
> 1.2.5 CliFrontend
> ╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌
> • CliFrontend does never have to differentiate between different
> cluster types after it has determined which cluster class to load.
> • Base class handles framework agnostic command line arguments
> • Pluggables for Yarn, Mesos handle specific commands
> {noformat}
> I would like to create/refactor the affected classes to set us up for a more
> flexible client side resource management abstraction.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
