2016-03-24 11:09 GMT+01:00 Shishir Anshuman <shishiranshu...@gmail.com>:
> I am using two Slaves to run the ALS algorithm. I am saving the predictions
> in a textfile using :
>       saveAsTextFile(path)
>
> The predictions is getting stored on the slaves but I want the predictions
> to be saved on the Master.
Yes, that is expected behavior. `path` is resolved on the machine it
is executed, the slaves. I'd recommend to either use a cluster FS
(e.g. HDFS) or .collect() your data so you can save them locally on
the master. Beware of OOM if your data is big.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Reply via email to