[ https://issues.apache.org/jira/browse/SPARK-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058539#comment-17058539 ]
Hannah Chua commented on SPARK-4298: ------------------------------------ Please assist my issue writing spark output to cassandra on hortonworks sandbox 2.6.5 (img and phone number attached) > The spark-submit cannot read Main-Class from Manifest. > ------------------------------------------------------ > > Key: SPARK-4298 > URL: https://issues.apache.org/jira/browse/SPARK-4298 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.1.0 > Environment: Linux > spark-1.1.0-bin-hadoop2.4.tgz > java version "1.7.0_72" > Java(TM) SE Runtime Environment (build 1.7.0_72-b14) > Java HotSpot(TM) 64-Bit Server VM (build 24.72-b04, mixed mode) > Reporter: Milan Straka > Assignee: Brennon York > Priority: Major > Fix For: 1.0.3, 1.1.2, 1.2.1, 1.3.0 > > Attachments: Hannah 6598199927.png, Screenshot 2020-03-13 at 4.24.02 > PM.png > > > Consider trivial {{test.scala}}: > {code:title=test.scala|borderStyle=solid} > import org.apache.spark.SparkContext > import org.apache.spark.SparkContext._ > object Main { > def main(args: Array[String]) { > val sc = new SparkContext() > sc.stop() > } > } > {code} > When built with {{sbt}} and executed using {{spark-submit > target/scala-2.10/test_2.10-1.0.jar}}, I get the following error: > {code} > Spark assembly has been built with Hive, including Datanucleus jars on > classpath > Error: Cannot load main class from JAR: > file:/ha/home/straka/s/target/scala-2.10/test_2.10-1.0.jar > Run with --help for usage help or --verbose for debug output > {code} > When executed using {{spark-submit --class Main > target/scala-2.10/test_2.10-1.0.jar}}, it works. > The jar file has correct MANIFEST.MF: > {code:title=MANIFEST.MF|borderStyle=solid} > Manifest-Version: 1.0 > Implementation-Vendor: test > Implementation-Title: test > Implementation-Version: 1.0 > Implementation-Vendor-Id: test > Specification-Vendor: test > Specification-Title: test > Specification-Version: 1.0 > Main-Class: Main > {code} > The problem is that in {{org.apache.spark.deploy.SparkSubmitArguments}}, line > 127: > {code} > val jar = new JarFile(primaryResource) > {code} > the primaryResource has String value > {{"file:/ha/home/straka/s/target/scala-2.10/test_2.10-1.0.jar"}}, which is > URI, but JarFile can use only Path. One way to fix this would be using > {code} > val uri = new URI(primaryResource) > val jar = new JarFile(uri.getPath) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org