[ https://issues.apache.org/jira/browse/YARN-10044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jon Bringhurst updated YARN-10044: ---------------------------------- Issue Type: Bug (was: Improvement) > ResourceManager NPE - Error in handling event type NODE_UPDATE to the Event > Dispatcher > -------------------------------------------------------------------------------------- > > Key: YARN-10044 > URL: https://issues.apache.org/jira/browse/YARN-10044 > Project: Hadoop YARN > Issue Type: Bug > Affects Versions: 2.9.2 > Reporter: Jon Bringhurst > Priority: Major > > {noformat} > 2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030] > resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - > USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container > TARGET=SchedulerApp RESULT=SUCCESS APPID= > application_1575937033226_0426 > CONTAINERID=container_e18_1575937033226_0426_01_000389 > RESOURCE=<memory:5120, vCores:12> > 2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030] > rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) - > container_e18_1575937033226_0426_01_000392 Container Transitioned from > ACQUIRED to RELEASED > 2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030] > resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - > USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container > TARGET=SchedulerApp RESULT=SUCCESS APPID= > application_1575937033226_0426 > CONTAINERID=container_e18_1575937033226_0426_01_000392 > RESOURCE=<memory:5120, vCores:12> > 2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor] > allocator.AbstractContainerAllocator.getCSAssignmentFromAllocateResult(AbstractContainerAllocator.java:126) > - assignedContainer application attempt=appattempt_1575937033226 > _0426_000001 container=null > queue=org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator@73179037 > clusterResource=<memory:151592720, vCores:115668> type=OFF_SWITCH > requestedPartition=concourse > 2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030] > rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) - > container_e18_1575937033226_0426_01_000393 Container Transitioned from > ACQUIRED to RELEASED > 2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor] > capacity.ParentQueue.assignContainers(ParentQueue.java:616) - > assignedContainer queue=root usedCapacity=0.68548673 > absoluteUsedCapacity=0.68548673 used=<memory:23682935, vC > ores:11062> cluster=<memory:151592720, vCores:115668> > 2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030] > resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - > USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container > TARGET=SchedulerApp RESULT=SUCCESS APPID= > application_1575937033226_0426 > CONTAINERID=container_e18_1575937033226_0426_01_000393 > RESOURCE=<memory:5120, vCores:12> > 2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030] > rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) - > container_e18_1575937033226_0426_01_000394 Container Transitioned from > ACQUIRED to RELEASED > 2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030] > resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - > USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container > TARGET=SchedulerApp RESULT=SUCCESS APPID= > application_1575937033226_0426 > CONTAINERID=container_e18_1575937033226_0426_01_000394 > RESOURCE=<memory:5120, vCores:12> > 2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030] > scheduler.AppSchedulingInfo.updatePendingResources(AppSchedulingInfo.java:250) > - checking for deactivate of application :application_1575937033226_0426 > 2019-12-18 00:46:42,580 [FATAL] [SchedulerEventDispatcher:Event Processor] > event.EventDispatcher$EventProcessor.run(EventDispatcher.java:75) - Error in > handling event type NODE_UPDATE to the Event Dispatcher > java.lang.NullPointerException > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo.allocate(AppSchedulingInfo.java:448) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp.apply(FiCaSchedulerApp.java:533) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.tryCommit(CapacityScheduler.java:2563) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.submitResourceCommitRequest(CapacityScheduler.java:2429) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateOrReserveNewContainers(CapacityScheduler.java:1359) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainerOnSingleNode(CapacityScheduler.java:1348) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1437) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1208) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.nodeUpdate(CapacityScheduler.java:1070) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:1479) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:153) > at > org.apache.hadoop.yarn.event.EventDispatcher$EventProcessor.run(EventDispatcher.java:66) > at java.lang.Thread.run(Thread.java:748) > 2019-12-18 00:46:42,580 [INFO] [SchedulerEventDispatcher:Event Processor] > event.EventDispatcher$EventProcessor.run(EventDispatcher.java:79) - Exiting, > bbye.. > 2019-12-18 00:46:42,651 [ERROR] [Thread[Thread-20,5,main]] > delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover.run(AbstractDelegationTokenSecretManager.java:696) > - ExpiredTokenRemover received java.lang.InterruptedException: sleep > interrupted > 2019-12-18 00:46:42,676 [INFO] [shutdown-hook-0] > log.Slf4jLog.info(Slf4jLog.java:67) - Stopped > HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8088 > 2019-12-18 00:46:42,810 [INFO] [shutdown-hook-0] > event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher > is draining to stop, ignoring any new events. > 2019-12-18 00:46:42,812 [INFO] [shutdown-hook-0] > event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher > is draining to stop, ignoring any new events. > 2019-12-18 00:46:42,814 [INFO] [shutdown-hook-0] > event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher > is draining to stop, ignoring any new events. > 2019-12-18 00:46:42,816 [INFO] [shutdown-hook-0] > event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher > is draining to stop, ignoring any new events. > 2019-12-18 00:46:42,818 [INFO] [shutdown-hook-0] > event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher > is draining to stop, ignoring any new events. > 2019-12-18 00:46:42,918 [INFO] [shutdown-hook-0] > event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for > AsyncDispatcher to drain. Thread state is :RUNNABLE > 2019-12-18 00:46:43,009 [INFO] [Socket Reader #1 for port 8030] > ipc.Server$Connection.saslProcess(Server.java:1820) - Auth successful for > appattempt_1559780328064_0296_000004 (auth:SIMPLE) > 2019-12-18 00:46:43,018 [INFO] [shutdown-hook-0] > event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for > AsyncDispatcher to drain. Thread state is :RUNNABLE > 2019-12-18 00:46:43,119 [INFO] [shutdown-hook-0] > event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for > AsyncDispatcher to drain. Thread state is :RUNNABLE > 2019-12-18 00:46:43,219 [INFO] [shutdown-hook-0] > event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for > AsyncDispatcher to drain. Thread state is :RUNNABLE > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org