Hi,

I'm trying to run a Spark 1.6.0 application on a CDH 5.6.0 cluster.

How do I submit the uber-jar so it's totally self-reliant?

With kind regards,
Mitchel


spark-submit --class TEST --master yarn-cluster ./uber-TEST-1.0-SNAPSHOT.jar


Spark 1.6.1
Version: Cloudera Express 5.6.0

16/03/22 09:16:33 INFO yarn.ApplicationMaster: Unregistering ApplicationMaster 
with FAILED (diag message: User class threw exception: 
java.lang.NoSuchMethodError: 
org.apache.spark.streaming.api.java.JavaPairDStream.mapWithState(Lorg/apache/spark/streaming/StateSpec;)Lorg/apache/spark/streaming/api/java/JavaMapWithStateDStream;)



Reply via email to