Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

Hi Raymond run this command and it should work, provided you have kafka setup a s well on localhost at port 2181 spark-submit --packages org.apache.spark:spark-streaming-kafka-0-8_2.11:2.0.1 kafka_wordcount.py localhost:2181 test But i suggest, if you are a beginner, to use Spark examples'

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

Try to use --packages to include the jars. From error it seems it's looking for main class in jars but u r running a python script... On 25 Feb 2017 10:36 pm, "Raymond Xie" wrote: That's right Anahita, however, the class name is not indicated in the original github

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

Thank you very much Marco, I am a beginner in this area, is it possible for you to show me what you think the right script should be to get it executed in terminal? ** *Sincerely yours,* *Raymond* On Sat, Feb 25, 2017 at 6:00 PM, Marco Mistroni

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

That's right Anahita, however, the class name is not indicated in the original github project so I don't know what class should be used here. The github only says: and then run the example `$ bin/spark-submit --jars \ external/kafka-assembly/target/scala-*/spark-streaming-kafka-assembly-*.jar \

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

You're welcome. You need to specify the class. I meant like that: spark-submit /usr/hdp/2.5.0.0-1245/spark/lib/spark-assembly-1.6.2.2.5.0. 0-1245-hadoop2.7.3.2.5.0.0-1245.jar --class "give the name of the class" On Saturday, February 25, 2017, Raymond Xie wrote: >

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

Thank you, it is still not working: [image: Inline image 1] By the way, here is the original source: https://github.com/apache/spark/blob/master/examples/src/main/python/streaming/kafka_wordcount.py ** *Sincerely yours,* *Raymond* On Sat, Feb

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

Hi, I think if you remove --jars, it will work. Like: spark-submit /usr/hdp/2.5.0.0-1245/spark/lib/spark-assembly-1.6.2.2.5. 0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar I had the same problem before and solved it by removing --jars. Cheers, Anahita On Saturday, February 25, 2017, Raymond Xie

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

You should read (again?) the Spark documentation about submitting an application: http://spark.apache.org/docs/latest/submitting-applications.html Try with the Pi computation example available with Spark. For example: ./bin/spark-submit --class org.apache.spark.examples.SparkPi

No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

I am doing a spark streaming on a hortonworks sandbox and am stuck here now, can anyone tell me what's wrong with the following code and the exception it causes and how do I fix it? Thank you very much in advance. spark-submit --jars