[
https://issues.apache.org/jira/browse/YARN-10044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jon Bringhurst updated YARN-10044:
----------------------------------
Issue Type: Bug (was: Improvement)
> ResourceManager NPE - Error in handling event type NODE_UPDATE to the Event
> Dispatcher
> --------------------------------------------------------------------------------------
>
> Key: YARN-10044
> URL: https://issues.apache.org/jira/browse/YARN-10044
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 2.9.2
> Reporter: Jon Bringhurst
> Priority: Major
>
> {noformat}
> 2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030]
> resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) -
> USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container
> TARGET=SchedulerApp RESULT=SUCCESS APPID=
> application_1575937033226_0426
> CONTAINERID=container_e18_1575937033226_0426_01_000389
> RESOURCE=<memory:5120, vCores:12>
> 2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030]
> rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) -
> container_e18_1575937033226_0426_01_000392 Container Transitioned from
> ACQUIRED to RELEASED
> 2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030]
> resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) -
> USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container
> TARGET=SchedulerApp RESULT=SUCCESS APPID=
> application_1575937033226_0426
> CONTAINERID=container_e18_1575937033226_0426_01_000392
> RESOURCE=<memory:5120, vCores:12>
> 2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor]
> allocator.AbstractContainerAllocator.getCSAssignmentFromAllocateResult(AbstractContainerAllocator.java:126)
> - assignedContainer application attempt=appattempt_1575937033226
> _0426_000001 container=null
> queue=org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator@73179037
> clusterResource=<memory:151592720, vCores:115668> type=OFF_SWITCH
> requestedPartition=concourse
> 2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030]
> rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) -
> container_e18_1575937033226_0426_01_000393 Container Transitioned from
> ACQUIRED to RELEASED
> 2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor]
> capacity.ParentQueue.assignContainers(ParentQueue.java:616) -
> assignedContainer queue=root usedCapacity=0.68548673
> absoluteUsedCapacity=0.68548673 used=<memory:23682935, vC
> ores:11062> cluster=<memory:151592720, vCores:115668>
> 2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030]
> resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) -
> USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container
> TARGET=SchedulerApp RESULT=SUCCESS APPID=
> application_1575937033226_0426
> CONTAINERID=container_e18_1575937033226_0426_01_000393
> RESOURCE=<memory:5120, vCores:12>
> 2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030]
> rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) -
> container_e18_1575937033226_0426_01_000394 Container Transitioned from
> ACQUIRED to RELEASED
> 2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030]
> resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) -
> USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container
> TARGET=SchedulerApp RESULT=SUCCESS APPID=
> application_1575937033226_0426
> CONTAINERID=container_e18_1575937033226_0426_01_000394
> RESOURCE=<memory:5120, vCores:12>
> 2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030]
> scheduler.AppSchedulingInfo.updatePendingResources(AppSchedulingInfo.java:250)
> - checking for deactivate of application :application_1575937033226_0426
> 2019-12-18 00:46:42,580 [FATAL] [SchedulerEventDispatcher:Event Processor]
> event.EventDispatcher$EventProcessor.run(EventDispatcher.java:75) - Error in
> handling event type NODE_UPDATE to the Event Dispatcher
> java.lang.NullPointerException
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo.allocate(AppSchedulingInfo.java:448)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp.apply(FiCaSchedulerApp.java:533)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.tryCommit(CapacityScheduler.java:2563)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.submitResourceCommitRequest(CapacityScheduler.java:2429)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateOrReserveNewContainers(CapacityScheduler.java:1359)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainerOnSingleNode(CapacityScheduler.java:1348)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1437)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1208)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.nodeUpdate(CapacityScheduler.java:1070)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:1479)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:153)
> at
> org.apache.hadoop.yarn.event.EventDispatcher$EventProcessor.run(EventDispatcher.java:66)
> at java.lang.Thread.run(Thread.java:748)
> 2019-12-18 00:46:42,580 [INFO] [SchedulerEventDispatcher:Event Processor]
> event.EventDispatcher$EventProcessor.run(EventDispatcher.java:79) - Exiting,
> bbye..
> 2019-12-18 00:46:42,651 [ERROR] [Thread[Thread-20,5,main]]
> delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover.run(AbstractDelegationTokenSecretManager.java:696)
> - ExpiredTokenRemover received java.lang.InterruptedException: sleep
> interrupted
> 2019-12-18 00:46:42,676 [INFO] [shutdown-hook-0]
> log.Slf4jLog.info(Slf4jLog.java:67) - Stopped
> HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8088
> 2019-12-18 00:46:42,810 [INFO] [shutdown-hook-0]
> event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
> is draining to stop, ignoring any new events.
> 2019-12-18 00:46:42,812 [INFO] [shutdown-hook-0]
> event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
> is draining to stop, ignoring any new events.
> 2019-12-18 00:46:42,814 [INFO] [shutdown-hook-0]
> event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
> is draining to stop, ignoring any new events.
> 2019-12-18 00:46:42,816 [INFO] [shutdown-hook-0]
> event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
> is draining to stop, ignoring any new events.
> 2019-12-18 00:46:42,818 [INFO] [shutdown-hook-0]
> event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
> is draining to stop, ignoring any new events.
> 2019-12-18 00:46:42,918 [INFO] [shutdown-hook-0]
> event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for
> AsyncDispatcher to drain. Thread state is :RUNNABLE
> 2019-12-18 00:46:43,009 [INFO] [Socket Reader #1 for port 8030]
> ipc.Server$Connection.saslProcess(Server.java:1820) - Auth successful for
> appattempt_1559780328064_0296_000004 (auth:SIMPLE)
> 2019-12-18 00:46:43,018 [INFO] [shutdown-hook-0]
> event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for
> AsyncDispatcher to drain. Thread state is :RUNNABLE
> 2019-12-18 00:46:43,119 [INFO] [shutdown-hook-0]
> event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for
> AsyncDispatcher to drain. Thread state is :RUNNABLE
> 2019-12-18 00:46:43,219 [INFO] [shutdown-hook-0]
> event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for
> AsyncDispatcher to drain. Thread state is :RUNNABLE
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
