Nodemanager can appear to hang on shutdown due to lingering DeletionService 
threads
-----------------------------------------------------------------------------------

                 Key: MAPREDUCE-3862
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3862
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv2, nodemanager
    Affects Versions: 0.23.1
            Reporter: Jason Lowe


When a nodemanager attempts to shutdown cleanly, it's possible for it to appear 
to hang due to lingering DeletionService threads.  This can occur when 
yarn.nodemanager.delete.debug-delay-sec is set to a relatively large value and 
one or more containers executes on the node shortly before the shutdown.

The DeletionService is never calling 
{{setExecuteExistingDelayedTasksAfterShutdownPolicy()}} on the 
ScheduledThreadPoolExecutor, and it defaults to waiting for all scheduled tasks 
to complete before exiting.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to