[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311447#comment-14311447 ]
DeepakVohra edited comment on SPARK-5625 at 2/8/15 5:56 PM: ------------------------------------------------------------ The jar tf does list the Spark classes, which verifies the Binaries include the Spark artifact classes. The issue subject should be modified to: Is the Spark Assembly a Valid Archive? Extracting/opening with WinZip is only to verify the archive is valid. The following indicate that the spark assembly jar is not a valid archive. 1. Even though the assembly jar is in the classpath, a Spark application does not find the classes in the assembly jar. 2. The assembly jar does not get opened/extracted with WinZip which generates the error: http://s763.photobucket.com/user/dvohra10/media/SparkAssembly_zps4319294c.jpg.html?o=0 All indicators suggest the assembly jar is not a valid archive. Adding a Spark core artifact jar to the same directory, the lib directory of Spark binaries, adds the classes from the Spark Core to the classpath. Could it be verified: 1. The assembly jar gets extracted and is a valid archive? 2. Adding the jar in the classpath adds the classes to classpath? was (Author: dvohra): Extracting/opening with WinZip is only to verify the archive is valid. The following indicate that the spark assembly jar is not a valid archive. 1. Even though the assembly jar is in the classpath, a Spark application does not find the classes in the assembly jar. 2. The assembly jar does not get opened/extracted with WinZip which generates the error: http://s763.photobucket.com/user/dvohra10/media/SparkAssembly_zps4319294c.jpg.html?o=0 All indicators suggest the assembly jar is not a valid archive. Adding a Spark core artifact jar to the same directory, the lib directory of Spark binaries, adds the classes from the Spark Core to the classpath. Could it be verified: 1. The assembly jar gets extracted and is a valid archive? 2. Adding the jar in the classpath adds the classes to classpath? > Spark binaries do not incude Spark Core > --------------------------------------- > > Key: SPARK-5625 > URL: https://issues.apache.org/jira/browse/SPARK-5625 > Project: Spark > Issue Type: Bug > Components: Java API > Affects Versions: 1.2.0 > Environment: CDH4 > Reporter: DeepakVohra > > Spark binaries for CDH 4 do not include the Spark Core Jar. > http://spark.apache.org/downloads.html -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org