[
https://issues.apache.org/jira/browse/OOZIE-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
abhishek bafna updated OOZIE-2512:
----------------------------------
Fix Version/s: (was: trunk)
4.3.0
> ShareLibservice returns incorrect path for jar
> ----------------------------------------------
>
> Key: OOZIE-2512
> URL: https://issues.apache.org/jira/browse/OOZIE-2512
> Project: Oozie
> Issue Type: Bug
> Reporter: Satish Subhashrao Saley
> Assignee: Satish Subhashrao Saley
> Fix For: 4.3.0
>
> Attachments: OOZIE-2512-1.patch, OOZIE-2512-2.patch,
> OOZIE-2512-3.patch, OOZIE-2512-amend-1.patch, OOZIE-2512-amend-2.patch,
> OOZIE-2512-amend-3.patch, OOZIE-2512-amend-4.patch, OOZIE-2512-amend-5.patch
>
>
> If we have {{oozie.service.ShareLibService.mapping.file}} setting pointing to
> a metafile, then ShareLibServe loads paths from that file.
> We can mention path to a directory or path to a direct file.
> When path to a directory is mentioned, the paths are populated correctly, but
> not when we mentioned direct path for a file.
> Consider following paths:
> * /sharelib/pig/
> ** pig.jar
> ** some.jar
> * /sharelib/spark
> ** spark-assembly.jar
> In metafile, we have
> {code}
> oozie.pig=/sharelib/pig/
> oozie.spark=/sharelib/spark/spark-assembly.jar
> {code}
> Now, the SharelibService calculates the paths as
> pig -
> hdfs://clustername.com:8020/sharelib/pig/pig.jar,hdfs://clustername.com:8020/sharelib/pig/some.jar
> spark - /sharelib/spark/spark-assembly.jar
> The spark path does not have hdfs prefixed.
> Later on, when we run a spark action, it fails with
> {code}
> Failing Oozie Launcher, Main class
> [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, File
> file:/sharelib/spark/spark-assembly.jar does not exist
> java.io.FileNotFoundException: File file:/sharelib/spark/spark-assembly.jar
> does not exist
> {code}
> Remember, if we already mentioned hdfs prefixed paths in metafile, then it
> works fine.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
