Re: Submitted applications does not run.

This is master log. There's no worker registration info in the log. That means the worker may not start properly. Please check the log file with apache.spark.deploy.worker in file name. On Tue, Sep 1, 2015 at 2:55 PM, Madawa Soysa wrote: > I cannot see anything

Re: Submitted applications does not run.

It's in SPARK_HOME/logs Or you can check the spark web ui. http://[master-machine]:8080 On Tue, Sep 1, 2015 at 2:44 PM, Madawa Soysa wrote: > How do I check worker logs? SPARK_HOME/work folder does not exist. I am > using the spark standalone mode. > > On 1 September

Re: Submitted applications does not run.

No executors ? Please check the worker logs if you are using spark standalone mode. On Tue, Sep 1, 2015 at 2:17 PM, Madawa Soysa wrote: > Hi All, > > I have successfully submitted some jobs to spark master. But the jobs > won't progress and not finishing. Please see the

Submitted applications does not run.

Hi All, I have successfully submitted some jobs to spark master. But the jobs won't progress and not finishing. Please see the attached screenshot. These are fairly very small jobs and this shouldn't take more than a minute to finish. I'm new to spark and any help would be appreciated. Thanks,

Re: Submitted applications does not run.

How do I check worker logs? SPARK_HOME/work folder does not exist. I am using the spark standalone mode. On 1 September 2015 at 12:05, Jeff Zhang wrote: > No executors ? Please check the worker logs if you are using spark > standalone mode. > > On Tue, Sep 1, 2015 at 2:17 PM,

Re: Submitted applications does not run.

I cannot see anything abnormal in logs. What would be the reason for not availability of executors? On 1 September 2015 at 12:24, Madawa Soysa wrote: > Following are the logs available. Please find the attached. > > On 1 September 2015 at 12:18, Jeff Zhang

Re: Submitted applications does not run.

Following are the logs available. Please find the attached. On 1 September 2015 at 12:18, Jeff Zhang wrote: > It's in SPARK_HOME/logs > > Or you can check the spark web ui. http://[master-machine]:8080 > > > On Tue, Sep 1, 2015 at 2:44 PM, Madawa Soysa

Re: Submitted applications does not run.

Did you start spark cluster using command sbin/start-all.sh ? You should have 2 log files under folder if it is single-node cluster. Like the following spark-jzhang-org.apache.spark.deploy.master.Master-1-jzhangMBPr.local.out

Re: Submitted applications does not run.

I used ./sbin/start-master.sh When I used ./sbin/start-all.sh the start fails. I get the following error. failed to launch org.apache.spark.deploy.master.Master: localhost: ssh: connect to host localhost port 22: Connection refused On 1 September 2015 at 13:41, Jeff Zhang

Re: Submitted applications does not run.

There are no logs which includes apache.spark.deploy.worker in file name in the SPARK_HOME/logs folder. On 1 September 2015 at 13:00, Jeff Zhang wrote: > This is master log. There's no worker registration info in the log. That > means the worker may not start properly. Please

Re: Submitted applications does not run.

You need to make yourself able to ssh to localhost without password, please check this blog. http://hortonworks.com/kb/generating-ssh-keys-for-passwordless-login/ On Tue, Sep 1, 2015 at 4:31 PM, Madawa Soysa wrote: > I used ./sbin/start-master.sh > > When I used

Re: Submitted applications does not run.

Hi Jeff, I solved the issue by following the given instructions. Thanks for the help. Regards, Madawa. On 1 September 2015 at 14:12, Jeff Zhang wrote: > You need to make yourself able to ssh to localhost without password, > please check this blog. > >