Re: MLLib: implementing ALS with distributed matrix

2014-08-17 Thread Wei Tan
user@spark.apache.org Date: 08/04/2014 12:51 AM Subject:Re: MLLib: implementing ALS with distributed matrix To be precise, the optimization is not `get all products that are related to this user` but `get all products that are related to users inside this block`. So a product factor

Re: MLLib: implementing ALS with distributed matrix

2014-08-17 Thread Debasish Das
To:Wei Tan/Watson/IBM@IBMUS, Cc:user@spark.apache.org user@spark.apache.org Date:08/04/2014 12:51 AM Subject:Re: MLLib: implementing ALS with distributed matrix -- To be precise, the optimization is not `get all products that are related

Re: MLLib: implementing ALS with distributed matrix

2014-08-17 Thread Wei Tan
Subject:Re: MLLib: implementing ALS with distributed matrix Hi Wei, Sparkler code was not available for benchmarking and so I picked up Jellyfish which uses SGD and if you look at the paper, the ideas are very similar to sparkler paper but Jellyfish is on shared memory and uses C code