Hi, I think if you remove --jars, it will work. Like:
spark-submit /usr/hdp/2.5.0.0-1245/spark/lib/spark-assembly-1.6.2.2.5. 0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar I had the same problem before and solved it by removing --jars. Cheers, Anahita On Saturday, February 25, 2017, Raymond Xie <xie3208...@gmail.com> wrote: > I am doing a spark streaming on a hortonworks sandbox and am stuck here > now, can anyone tell me what's wrong with the following code and the > exception it causes and how do I fix it? Thank you very much in advance. > > spark-submit --jars /usr/hdp/2.5.0.0-1245/spark/ > lib/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar > /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar > /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test > > Error: > No main class set in JAR; please specify one with --class > > > spark-submit --class /usr/hdp/2.5.0.0-1245/spark/ > lib/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar > /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar > /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test > > Error: > java.lang.ClassNotFoundException: /usr/hdp/2.5.0.0-1245/spark/ > lib/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar > > spark-submit --class /usr/hdp/2.5.0.0-1245/kafka/ > libs/kafka-streams-0.10.0.2.5.0.0-1245.jar /usr/hdp/2.5.0.0-1245/spark/ > lib/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar > /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test > > Error: > java.lang.ClassNotFoundException: /usr/hdp/2.5.0.0-1245/kafka/ > libs/kafka-streams-0.10.0.2.5.0.0-1245.jar > > *------------------------------------------------* > *Sincerely yours,* > > > *Raymond* >
