JHS failed to start when intermediate done path is in LocalFS -------------------------------------------------------------
Key: MAPREDUCE-3514 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3514 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobhistoryserver, mrv2 Affects Versions: 0.24.0 Environment: Single Node Cluster Reporter: Bh V S Kamesh This is the property I have set for intermediate done directory {code:xml} <property> <name>mapreduce.jobhistory.intermediate-done-dir</name> <value>file:///mnt/history/done_intermediate</value> </property> {code} After setting this property, When I started the JHS, it failed to start, and was throwing following exception {noformat} 2011-12-06 12:09:13,650 FATAL org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: Error starting JobHistoryServer org.apache.hadoop.fs.InvalidPathException: Invalid path name Wrong FS: file://<NN Address>:<NN Port>/mnt/history/done_intermediate, expected: file:/// at org.apache.hadoop.fs.AbstractFileSystem.checkPath(AbstractFileSystem.java:361) at org.apache.hadoop.fs.FilterFs.checkPath(FilterFs.java:161) at org.apache.hadoop.fs.FilterFs.getFileStatus(FilterFs.java:115) at org.apache.hadoop.fs.FileContext$14.next(FileContext.java:1086) at org.apache.hadoop.fs.FileContext$14.next(FileContext.java:1083) at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2319) at org.apache.hadoop.fs.FileContext.getFileStatus(FileContext.java:1083) at org.apache.hadoop.fs.FileContext$Util.exists(FileContext.java:1506) at org.apache.hadoop.mapreduce.v2.hs.JobHistory.mkdir(JobHistory.java:232) at org.apache.hadoop.mapreduce.v2.hs.JobHistory.init(JobHistory.java:201) at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58) at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.init(JobHistoryServer.java:62) at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:77) 2011-12-06 12:09:13,653 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: SHUTDOWN_MSG: {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira