Hi, My HDFS and YARN services are started, and my spark-shell can wok in local mode.
But when I try spark-shell --master yarn-client, a job can be created at the YARN service, but will fail very soon. The Diagnostics are: Application application_1425559747310_0002 failed 2 times due to AM Container for appattempt_1425559747310_0002_000002 exited with exitCode: 1 For more detailed output, check application tracking page: http://Xi-Laptop:8088/proxy/application_1425559747310_0002/Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1425559747310_0002_02_000001 Exit code: 1 Stack trace: ExitCodeException exitCode=1: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) at org.apache.hadoop.util.Shell.run(Shell.java:455) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Shell output: 1 file(s) moved. Container exited with a non-zero exit code 1 Failing this attempt. Failing the application. And in the AM log, there're something like: Could not find or load main class '-Dspark.driver.appUIAddress=http:..<my-server>:4040' And it changes from time to time. It feels like something is not right in YARN. Thanks, David