Exception in saving MatrixFactorizationModel

2015-09-04 Thread Madawa Soysa
Hi All, I'm getting an error when trying to save a MatrixFactorizationModel. I'm using following method to save the model. model.save(sc, outPath) I'm getting the following exception when saving the model. I have attached the full stack trace. Any help would be appreciated to resolve this

Submitted applications does not run.

2015-09-01 Thread Madawa Soysa
Hi All, I have successfully submitted some jobs to spark master. But the jobs won't progress and not finishing. Please see the attached screenshot. These are fairly very small jobs and this shouldn't take more than a minute to finish. I'm new to spark and any help would be appreciated. Thanks,

Re: Submitted applications does not run.

2015-09-01 Thread Madawa Soysa
1, 2015 at 2:17 PM, Madawa Soysa <madawa...@cse.mrt.ac.lk> > wrote: > >> Hi All, >> >> I have successfully submitted some jobs to spark master. But the jobs >> won't progress and not finishing. Please see the attached screenshot. These >> are fairl

Re: Submitted applications does not run.

2015-09-01 Thread Madawa Soysa
I cannot see anything abnormal in logs. What would be the reason for not availability of executors? On 1 September 2015 at 12:24, Madawa Soysa <madawa...@cse.mrt.ac.lk> wrote: > Following are the logs available. Please find the attached. > > On 1 September 2015 at 12:18,

Re: Submitted applications does not run.

2015-09-01 Thread Madawa Soysa
Following are the logs available. Please find the attached. On 1 September 2015 at 12:18, Jeff Zhang <zjf...@gmail.com> wrote: > It's in SPARK_HOME/logs > > Or you can check the spark web ui. http://[master-machine]:8080 > > > On Tue, Sep 1, 2015 at 2:44 PM, Madawa Soysa

Re: Submitted applications does not run.

2015-09-01 Thread Madawa Soysa
k.deploy.worker.Worker-1-jzhangMBPr.local.out > > > > On Tue, Sep 1, 2015 at 4:01 PM, Madawa Soysa <madawa...@cse.mrt.ac.lk> > wrote: > >> There are no logs which includes apache.spark.deploy.worker in file name >> in the SPARK_HOME/logs folder. >> &g

Re: Submitted applications does not run.

2015-09-01 Thread Madawa Soysa
erly. Please check the log file > with apache.spark.deploy.worker in file name. > > > > On Tue, Sep 1, 2015 at 2:55 PM, Madawa Soysa <madawa...@cse.mrt.ac.lk> > wrote: > >> I cannot see anything abnormal in logs. What would be the reason for not >> availabili

Error when creating an ALS model in spark

2015-09-01 Thread Madawa Soysa
I'm getting the an error when I try to build an ALS model in spark standalone. I am new to spark. Any help would be appreciated to resolve this issue. Stack Trace: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost

Re: Submitted applications does not run.

2015-09-01 Thread Madawa Soysa
://hortonworks.com/kb/generating-ssh-keys-for-passwordless-login/ > > > > On Tue, Sep 1, 2015 at 4:31 PM, Madawa Soysa <madawa...@cse.mrt.ac.lk> > wrote: > >> I used ./sbin/start-master.sh >> >> When I used ./sbin/start-all.sh the start

Serializing MLlib MatrixFactorizationModel

2015-08-17 Thread Madawa Soysa
-lang.scala-library_2.10.4.v20140209-180020-VFINAL-b66a39653b Any solution for this? -- *_**Madawa Soysa* Undergraduate, Department of Computer Science and Engineering, University of Moratuwa. Mobile: +94 71 461 6050 %2B94%2075%20812%200726 | Email: madawa