[ https://issues.apache.org/jira/browse/MAPREDUCE-4137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13251618#comment-13251618 ]
Devaraj K commented on MAPREDUCE-4137: -------------------------------------- Dup of MAPREDUCE-4135. > MRAppMaster shutdown hook should not call FileSystem.closeAll() > --------------------------------------------------------------- > > Key: MAPREDUCE-4137 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4137 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 > Affects Versions: 2.0.0 > Reporter: Alejandro Abdelnur > Fix For: 2.0.0 > > > Filesystem.closeAll() attempts to remove the FileSystem shutdown hook. > This triggers an exception > {code} > Exception in thread "Thread-1" java.lang.IllegalStateException: Shutdown in > progress > at > java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:55) > at java.lang.Runtime.removeShutdownHook(Runtime.java:220) > at org.apache.hadoop.fs.FileSystem$Cache.remove(FileSystem.java:2101) > at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2133) > at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2110) > at org.apache.hadoop.fs.FileSystem.closeAll(FileSystem.java:361) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1013) > {code} > Besides, because the FileSystem has its own shutdown hook that does a > closeAll() the call from MRAppMaster is not needed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira