[
https://issues.apache.org/jira/browse/LIVY-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris aby jose updated LIVY-755:
--------------------------------
Description:
I am trying to submit a Livy batch job.But it gives the following error. Can
you please help.
Looks like the jar is not getting included while creating Livy session.I tried
loading the jar from local as well as hdfs.
For trying from local I updated config to add livy.file.local-dir-whitelist and
tried with url as "local:/path/to/file*
I verifed the files is present in HDFS on the correct location.
"Warning: Skip remote jar
hdfs://QuantumHadoopDev/livy_qunatum/SampleSparkProject-0.0.2-SNAPSHOT.jar.",
"java.lang.ClassNotFoundException: App",
" at java.net.URLClassLoader.findClass(URLClassLoader.java:381)",
" at java.lang.ClassLoader.loadClass(ClassLoader.java:424)",
" at java.lang.ClassLoader.loadClass(ClassLoader.java:357)",
" at java.lang.Class.forName0(Native Method)",
" at java.lang.Class.forName(Class.java:348)",
" at org.apache.spark.util.Utils$.classForName(Utils.scala:175
was:
I am trying to submit a Livy batch job.But it gives the following error. Can
you please help.
Looks like the jar is not getting included while creating Livy session.I tried
loading the jar from local as well as hdfs.
"Warning: Skip remote jar
hdfs://QuantumHadoopDev/livy_qunatum/SampleSparkProject-0.0.2-SNAPSHOT.jar.",
"java.lang.ClassNotFoundException: App",
" at java.net.URLClassLoader.findClass(URLClassLoader.java:381)",
" at java.lang.ClassLoader.loadClass(ClassLoader.java:424)",
" at java.lang.ClassLoader.loadClass(ClassLoader.java:357)",
" at java.lang.Class.forName0(Native Method)",
" at java.lang.Class.forName(Class.java:348)",
" at org.apache.spark.util.Utils$.classForName(Utils.scala:175
> Livy Batch job Skiping remote jar from hdfs:
> ---------------------------------------------
>
> Key: LIVY-755
> URL: https://issues.apache.org/jira/browse/LIVY-755
> Project: Livy
> Issue Type: Bug
> Components: Batch
> Affects Versions: 0.4.0
> Reporter: Chris aby jose
> Priority: Major
>
> I am trying to submit a Livy batch job.But it gives the following error. Can
> you please help.
> Looks like the jar is not getting included while creating Livy session.I
> tried loading the jar from local as well as hdfs.
> For trying from local I updated config to add livy.file.local-dir-whitelist
> and tried with url as "local:/path/to/file*
> I verifed the files is present in HDFS on the correct location.
>
> "Warning: Skip remote jar
> hdfs://QuantumHadoopDev/livy_qunatum/SampleSparkProject-0.0.2-SNAPSHOT.jar.",
> "java.lang.ClassNotFoundException: App",
> " at java.net.URLClassLoader.findClass(URLClassLoader.java:381)",
> " at java.lang.ClassLoader.loadClass(ClassLoader.java:424)",
> " at java.lang.ClassLoader.loadClass(ClassLoader.java:357)",
> " at java.lang.Class.forName0(Native Method)",
> " at java.lang.Class.forName(Class.java:348)",
> " at org.apache.spark.util.Utils$.classForName(Utils.scala:175
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
