I think Xiangrui's ALS code implement certain aspect of it. You may want to check it out. Best regards, Wei
--------------------------------- Wei Tan, PhD Research Staff Member IBM T. J. Watson Research Center From: Xiangrui Meng <men...@gmail.com> To: Duy Huynh <duy.huynh....@gmail.com> Cc: user <u...@spark.incubator.apache.org> Date: 11/05/2014 01:13 PM Subject: Re: sparse x sparse matrix multiplication You can use breeze for local sparse-sparse matrix multiplication and then define an RDD of sub-matrices RDD[(Int, Int, CSCMatrix[Double])] (blockRowId, blockColId, sub-matrix) and then use join and aggregateByKey to implement this feature, which is the same as in MapReduce. -Xiangrui --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
