[ https://issues.apache.org/jira/browse/YARN-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732168#comment-16732168 ]
lujie commented on YARN-9164: ----------------------------- Hi : [~cheersyang] I have changed the patch as your suggestion: (1) fix YARN-9165 together. (2) adding the UT to cover them both. (3) check the style. Please check it! Thanks! > NullPointerException crash the ResourceManager > ---------------------------------------------- > > Key: YARN-9164 > URL: https://issues.apache.org/jira/browse/YARN-9164 > Project: Hadoop YARN > Issue Type: Bug > Reporter: lujie > Assignee: lujie > Priority: Critical > Attachments: YARN-9164-0.patch, YARN-9164-1.patch, > hadoop-hires-resourcemanager-hadoop11.log > > > We have meeted an NPE which can crash the whole cluster > {code:java} > 2018-12-31 22:18:11,924 FATAL org.apache.hadoop.yarn.event.EventDispatcher: > Error in handling event type APP_ATTEMPT_REMOVED to the Event Dispatcher > java.lang.NullPointerException > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler.completedContainer(AbstractYarnScheduler.java:696) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.doneApplicationAttempt(CapacityScheduler.java:1123) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:1827) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:171) > at > org.apache.hadoop.yarn.event.EventDispatcher$EventProcessor.run(EventDispatcher.java:66) > at java.lang.Thread.run(Thread.java:745) > {code} > this bug also happens in the latest trunk! > > workload is > {code:java} > $HADOOP_HOME/bin/hadoop jar > $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-$VERSION.jar pi > -Dmapreduce.job.num-opportunistic-maps-percent="100" 50 100 > {code} > while job is running , shutdown one NM > also need inject sleep before AbstractYarnScheduler.getNode() -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org