Thank you, it is still not working: [image: Inline image 1]
By the way, here is the original source: https://github.com/apache/spark/blob/master/examples/src/main/python/streaming/kafka_wordcount.py *------------------------------------------------* *Sincerely yours,* *Raymond* On Sat, Feb 25, 2017 at 4:48 PM, Anahita Talebi <anahita.t.am...@gmail.com> wrote: > Hi, > > I think if you remove --jars, it will work. Like: > > spark-submit /usr/hdp/2.5.0.0-1245/spark/lib/spark-assembly-1.6.2.2.5.0. > 0-1245-hadoop2.7.3.2.5.0.0-1245.jar > > I had the same problem before and solved it by removing --jars. > > Cheers, > Anahita > > On Saturday, February 25, 2017, Raymond Xie <xie3208...@gmail.com> wrote: > >> I am doing a spark streaming on a hortonworks sandbox and am stuck here >> now, can anyone tell me what's wrong with the following code and the >> exception it causes and how do I fix it? Thank you very much in advance. >> >> spark-submit --jars /usr/hdp/2.5.0.0-1245/spark/li >> b/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >> /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar >> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >> >> Error: >> No main class set in JAR; please specify one with --class >> >> >> spark-submit --class /usr/hdp/2.5.0.0-1245/spark/li >> b/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >> /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar >> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >> >> Error: >> java.lang.ClassNotFoundException: /usr/hdp/2.5.0.0-1245/spark/li >> b/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >> >> spark-submit --class /usr/hdp/2.5.0.0-1245/kafka/l >> ibs/kafka-streams-0.10.0.2.5.0.0-1245.jar /usr/hdp/2.5.0.0-1245/spark/li >> b/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >> >> Error: >> java.lang.ClassNotFoundException: /usr/hdp/2.5.0.0-1245/kafka/li >> bs/kafka-streams-0.10.0.2.5.0.0-1245.jar >> >> *------------------------------------------------* >> *Sincerely yours,* >> >> >> *Raymond* >> >
