Hey Jiacheng Guo,
do you have SPARK_EXAMPLES_JAR env variable set? If you do, you have to add
the --addJars parameter to the yarn client and point to the spark examples jar.
Or just unset SPARK_EXAMPLES_JAR env variable.
You should only have to set SPARK_JAR env variable.
If that isn't the issue let me know the build command you used and hadoop
version, and your defaultFs or hadoop.
Tom
On Saturday, November 16, 2013 2:32 AM, guojc <guoj...@gmail.com> wrote:
hi,
After reading about the exiting progress in consolidating shuffle, I'm eager
to trying out the last master branch. However up to launch the example
application, the job failed with prompt the app master failed to find the
target jar. appDiagnostics: Application application_1384588058297_0017 failed 1
times due to AM Container for appattempt_1384588058297_0017_000001 exited with
exitCode: -1000 due to: java.io.FileNotFoundException: File
file:/${my_work_dir}/spark/examples/target/scala-2.9.3/spark-examples-assembly-0.9.0-incubating-SNAPSHOT.jar
does not exist.
Is there any change on how to launch a yarn job now?
Best Regards,
Jiacheng Guo
