s...@gmail.com>; "user"<user@spark.apache.org>;
: ?? Could not find or load main class
org.apache.spark.deploy.yarn.ExecutorLauncher
yes??it run well
shihj@master:/usr/local/spark/spark-1.6.1-bin-hadoop2.6$ ./bin/spark-submit \
> --class org.apache.spark.examples.SparkPi \
>
hadoop2.6$
-- --
??: "Yash Sharma";<yash...@gmail.com>;
: 2016??6??22??(??) 3:06
??: ""<958943...@qq.com>;
: "Saisai Shao"<sai.sai.s...@gmail.com>; "user"<user@spark.apache.org>;
: Re: Could not fi
t;
>
> -- 原始邮件 --
> *发件人:* "Yash Sharma";<yash...@gmail.com>;
> *发送时间:* 2016年6月22日(星期三) 下午2:46
> *收件人:* "另一片天"<958943...@qq.com>;
> *抄送:* "Saisai Shao"<sai.sai.s...@gmail.com>; "user"<use
quot;<sai.sai.s...@gmail.com>; "user"<user@spark.apache.org>;
: Re: Could not find or load main class
org.apache.spark.deploy.yarn.ExecutorLauncher
Are you able to run anything else on the cluster, I suspect its yarn that not
able to run the class. If you could just share the logs i
2016年6月22日(星期三) 下午2:34
> *收件人:* "另一片天"<958943...@qq.com>;
> *抄送:* "Saisai Shao"<sai.sai.s...@gmail.com>; "user"<user@spark.apache.org>;
>
> *主题:* Re: Could not find or load main class
> org.apache.spark.deploy.yarn.ExecutorLau
uot;;<yash...@gmail.com>;
: 2016??6??22??(??) 2:34
??: ""<958943...@qq.com>;
: "Saisai Shao"<sai.sai.s...@gmail.com>; "user"<user@spark.apache.org>;
: Re: Could not find or load main class
org.apache.spark.
0(Native Method)
>> at java.lang.Class.forName(Class.java:348)
>> at org.apache.spark.util.Utils$.classForName(Utils.scala:174)
>> at
>> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:689)
>> at org.apache.spark
: "Yash Sharma";<yash...@gmail.com>;
: 2016??6??22??(??) 2:34
??: ""<958943...@qq.com>;
: "Saisai Shao"<sai.sai.s...@gmail.com>; "user"<user@spark.apache.org>;
: Re: Could not find or load main class
org.a
下午2:28
> *收件人:* "另一片天"<958943...@qq.com>;
> *抄送:* "Saisai Shao"<sai.sai.s...@gmail.com>; "user"<user@spark.apache.org>;
>
> *主题:* Re: Could not find or load main class
> org.apache.spark.deploy.yarn.ExecutorLauncher
>
> Or better , try
- --
??: "Yash Sharma";<yash...@gmail.com>;
: 2016??6??22??(??) 2:18
??: "Saisai Shao"<sai.sai.s...@gmail.com>;
????: ""<958943...@qq.com>; "user"<user@spark.apache.org>;
: Re:
日(星期三) 下午2:18
> *收件人:* "Saisai Shao"<sai.sai.s...@gmail.com>;
> *抄送:* "另一片天"<958943...@qq.com>; "user"<user@spark.apache.org>;
> *主题:* Re: Could not find or load main class
> org.apache.spark.deploy.yarn.ExecutorLauncher
>
> Try providi
2:18
> *收件人:* "Saisai Shao"<sai.sai.s...@gmail.com>;
> *抄送:* "另一片天"<958943...@qq.com>; "user"<user@spark.apache.org>;
> *主题:* Re: Could not find or load main class
> org.apache.spark.deploy.yarn.ExecutorLauncher
>
> Try providing the
?"<958943...@qq.com>; "user"<user@spark.apache.org>;
: Re: Could not find or load main class
org.apache.spark.deploy.yarn.ExecutorLauncher
Try providing the jar with the hdfs prefix. Its probably just because its not
able to find the jar on all nodes.
hdfs://m
onf
spark.yarn.jar
hdfs://master:9000/user/shihj/spark_lib/spark-examples-1.6.1-hadoop2.6.0.jar
then ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master
yarn-client --driver-memory 512m --num-executors 2 --executor-memory 512m
--executor-cores 210:
Error: Could not find o
SparkSubmit.scala:206)
>> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
>> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>> get error at once
>> ------ 原始邮件 ------
>> *发件人:* "Yash Sharma";<yash...@gmail.com&
ma"<yash...@gmail.com>;
: ""<958943...@qq.com>; "user"<user@spark.apache.org>;
: Re: Could not find or load main class
org.apache.spark.deploy.yarn.ExecutorLauncher
Make sure you built spark with -Pyarn, and check whether you have class
ExecutorLauncher
gt; -- 原始邮件 --
> *发件人:* "Yash Sharma";<yash...@gmail.com>;
> *发送时间:* 2016年6月22日(星期三) 下午2:04
> *收件人:* "另一片天"<958943...@qq.com>;
> *抄送:* "user"<user@spark.apache.org>;
> *主题:* Re: Could not find or load ma
er"<user@spark.apache.org>;
: Re: Could not find or load main class
org.apache.spark.deploy.yarn.ExecutorLauncher
How about supplying the jar directly in spark submit -
./bin/spark-submit \
--class org.apache.spark.examples.SparkPi \
--master yarn-client \
--driver-memory 5
examples.SparkPi
>> --master yarn-client --driver-memory 512m --num-executors 2
>> --executor-memory 512m --executor-cores 210:
>>
>>
>>
>>- Error: Could not find or load main class
>>org.apache.spark.deploy.yarn.ExecutorLauncher
>>
>> but i don't config that para ,there no error why???that para is only
>> avoid Uploading resource file(jar package)??
>>
>
>
--
Best Regards
Jeff Zhang
org.apache.spark.examples.SparkPi --master
> yarn-client --driver-memory 512m --num-executors 2 --executor-memory 512m
> --executor-cores 2 10:
>
>
>
>- Error: Could not find or load main class
>org.apache.spark.deploy.yarn.ExecutorLauncher
>
> but i don't config
--executor-cores 210:
Error: Could not find or load main class
org.apache.spark.deploy.yarn.ExecutorLauncher
but i don't config that para ,there no error why???that para is only avoid
Uploading resource file(jar package)??
the datanodes?
>>
>> I asked because I'm getting below error when I run a Spark job through
>> spark-submit:
>>
>> Error: Could not find or load main class
>> org.apache.spark.deploy.yarn.ExecutorLauncher
>>
>> I appreciate your help.
>>
>> Many thanks
>>
>>
>
: Could not find or load main class
org.apache.spark.deploy.yarn.ExecutorLauncher
I appreciate your help.
Many thanks
t; resourcemaneger). I have Spark setup only on the namenode/resource manager.
>
> Do I need to have Spark installed on the datanodes?
>
> I asked because I'm getting below error when I run a Spark job through
> spark-submit:
>
> Error: Could not find or load main class
> org
application
already ended,might be killed or not able to launch application master.
*On Linux Hadoop Cluster:*
/opt/hadoop/hadoop/logs/userlogs/application_1411473500741_0002/container_1411473500741_0002_01_01/stderr
Error: Could not find or load main class
25 matches
Mail list logo
