[
https://issues.apache.org/jira/browse/HAMA-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Minho Kim updated HAMA-848:
---------------------------
Attachment: HAMA_YARN04.patch
I think that token issue is still a problem.
The error log in Application Master stdout is as follows.
{code}
getContainerStatusesResponse : failed_requests { container_id { app_attempt_id
{ application_id { id: 76 cluster_timestamp: 1422512191908 } attemptId: 1 } id:
2 } exception { message: "Container container_1422512191908_0076_01_000002 was
recently stopped on node manager." trace:
"org.apache.hadoop.yarn.exceptions.YarnException: Container
container_1422512191908_0076_01_000002 was recently stopped on node
manager.\n\tat
org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:48)\n\tat
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.getContainerStatusInternal(ContainerManagerImpl.java:793)\n\tat
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.getContainerStatuses(ContainerManagerImpl.java:772)\n\tat
org.apache.hadoop.yarn.api.impl.pb.service.ContainerManagementProtocolPBServiceImpl.getContainerStatuses(ContainerManagementProtocolPBServiceImpl.java:89)\n\tat
org.apache.hadoop.yarn.proto.ContainerManagementProtocol$ContainerManagementProtocolService$2.callBlockingMethod(ContainerManagementProtocol.java:99)\n\tat
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)\n\tat
org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)\n\tat
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)\n\tat
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)\n\tat
java.security.AccessController.doPrivileged(Native Method)\n\tat
javax.security.auth.Subject.doAs(Subject.java:415)\n\tat
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)\n\tat
org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)\n" class_name:
"org.apache.hadoop.yarn.exceptions.YarnException" } }
{code}
And a nodemanager's error log is here.
{code}
WARN ipc.Client (Client.java:call(1388)) - interrupted waiting to send rpc
request to server
java.lang.InterruptedException
at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:400)
at java.util.concurrent.FutureTask.get(FutureTask.java:187)
at org.apache.hadoop.ipc.Client$Connection.sendRpcRequest(Client.java:1029)
at org.apache.hadoop.ipc.Client.call(Client.java:1383)
at org.apache.hadoop.ipc.Client.call(Client.java:1363)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
at com.sun.proxy.$Proxy77.heartbeat(Unknown Source)
at
org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.client.LocalizationProtocolPBClientImpl.heartbeat(LocalizationProtocolPBClientImpl.java:62)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.localizeFiles(ContainerLocalizer.java:255)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:169)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:107)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:999)
2015-02-02 19:48:12,559 INFO localizer.ResourceLocalizationService
(ResourceLocalizationService.java:processHeartbeat(563)) - Unknown localizer
with localizerId container_1422512191908_0076_01_000002 is sending heartbeat.
Ordering it to DIE
{code}
> Refactor YARN module for hadoop 2.x stable version
> --------------------------------------------------
>
> Key: HAMA-848
> URL: https://issues.apache.org/jira/browse/HAMA-848
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.7.0
> Reporter: Edward J. Yoon
> Assignee: Minho Kim
> Labels: patch
> Fix For: 0.7.0
>
> Attachments: HAMA-HDFS2XBuild.Patch, HAMA-YARNDraft.patch,
> HAMA_YARN.patch, HAMA_YARN02.patch, HAMA_YARN03.patch, HAMA_YARN04.patch
>
>
> Current yarn-module was implemented based on Hadoop 0.23.1 version. You'll
> need to use the Hama RPC instead of Hadoop RPC.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)