Satish Subhashrao Saley created OOZIE-2512: ----------------------------------------------
Summary: ShareLibservice returns incorrect path for jar Key: OOZIE-2512 URL: https://issues.apache.org/jira/browse/OOZIE-2512 Project: Oozie Issue Type: Bug Reporter: Satish Subhashrao Saley Assignee: Satish Subhashrao Saley If we have {{oozie.service.ShareLibService.mapping.file}} setting pointing to a metafile, then ShareLibServe loads paths from that file. We can mention path to a directory or path to a direct file. When path to a directory is mentioned, the paths are populated correctly, but not when we mentioned direct path for a file. Consider following paths: * /sharelib/pig/ ** pig.jar ** some.jar * /sharelib/spark ** spark-assembly.jar In metafile, we have {code} oozie.pig=/sharelib/pig/ oozie.spark=/sharelib/spark/spark-assembly.jar {code} Now, the SharelibService calculates the paths as pig - hdfs://clustername.com:8020/sharelib/pig/pig.jar,hdfs://clustername.com:8020/sharelib/pig/some.jar spark - /sharelib/spark/spark-assembly.jar The spark path does not have hdfs prefixed. Later on, when we run a spark action, it fails with {code} Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, File file:/sharelib/spark/spark-assembly.jar does not exist java.io.FileNotFoundException: File file:/sharelib/spark/spark-assembly.jar does not exist {code} Remember, if we already mentioned hdfs prefixed paths in metafile, then it works fine. -- This message was sent by Atlassian JIRA (v6.3.4#6332)