Issues about running on client in standalone mode

2014-11-24 Thread LinQili
Hi all:I deployed a spark client in my own machine. I put SPARK in path:` 
/home/somebody/spark`, and the cluster's worker spark home path is 
`/home/spark/spark` .While I launched the jar, it shows that: ` 
AppClient$ClientActor: Executor updated: app-20141124170955-11088/12 is now 
FAILED (java.io.IOException: Cannot run program 
/home/somebody/proc/spark_client/spark/bin/compute-classpath.sh (in directory 
.): error=2, No such file or directory)`. 
The worker should run /home/spark/spark/bin/compute-classpath.sh but not the 
client's compute-classpath.sh.  It appears to be that I set some environment 
variables with the client path, but in fact, there is no spark-env.sh or 
spark-default.conf associated  with my client spark path.Is there any hint? 
Thanks.

Re: Issues about running on client in standalone mode

2014-11-24 Thread Akhil Das
How are you submitting the job?

Thanks
Best Regards

On Mon, Nov 24, 2014 at 3:02 PM, LinQili lin_q...@outlook.com wrote:

 Hi all:
 I deployed a spark client in my own machine. I put SPARK in path:`
 /home/somebody/spark`, and the cluster's worker spark home path is
 `/home/spark/spark` .
 While I launched the jar, it shows that:
 ` AppClient$ClientActor: Executor updated: app-20141124170955-11088/12 is
 now FAILED (java.io.IOException: Cannot run program
 /home/somebody/proc/spark_client/spark/bin/compute-classpath.sh (in
 directory .): error=2, No such file or directory)`.

 The worker should run /home/spark/spark/bin/compute-classpath.sh but not
 the client's compute-classpath.sh.  It appears to be that I set some
 environment variables with the client path, but in fact, there is no
 spark-env.sh or spark-default.conf associated  with my client spark path.
 Is there any hint? Thanks.