+1 - I currently am doing what Marcelo is suggesting as I have a CDH 5.2
cluster (with Spark 1.1) and I'm also running Spark 1.3.0+ side-by-side in
my cluster.
On Wed, Mar 18, 2015 at 1:23 PM Marcelo Vanzin van...@cloudera.com wrote:
Since you're using YARN, you should be able to download a
Hi all,
I am trying to run my job which needs spark-sql_2.11-1.3.0.jar.
The cluster that I am running on is still on spark-1.2.0.
I tried the following :
spark-submit --class class-name --num-executors 100 --master yarn
application_jar--jars hdfs:///path/spark-sql_2.11-1.3.0.jar
Since you're using YARN, you should be able to download a Spark 1.3.0
tarball from Spark's website and use spark-submit from that
installation to launch your app against the YARN cluster.
So effectively you would have 1.2.0 and 1.3.0 side-by-side in your cluster.
On Wed, Mar 18, 2015 at 11:09
