/2014 01:13 PM
Subject: Re: sparse x sparse matrix multiplication
--
You can use breeze for local sparse-sparse matrix multiplication and
then define an RDD of sub-matrices
RDD[(Int, Int, CSCMatrix[Double])] (blockRowId, blockColId, sub-matrix)
and then use join
Date: 11/05/2014 01:13 PM
Subject: Re: sparse x sparse matrix multiplication
--
You can use breeze for local sparse-sparse matrix multiplication and
then define an RDD of sub-matrices
RDD[(Int, Int, CSCMatrix[Double])] (blockRowId, blockColId, sub-matrix
---You can use breeze for local sparse-sparse
matrix multiplication and then define an RDD of sub-matri
From: Xiangrui Meng men...@gmail.com
To: Duy Huynh duy.huynh@gmail.com
Cc: user u...@spark.incubator.apache.org
Date: 11/05/2014 01:13 PM
Subject: Re: sparse x sparse matrix multiplication
local matrix-matrix multiplication or distributed?
On Tue, Nov 4, 2014 at 11:58 PM, ll duy.huynh@gmail.com wrote:
what is the best way to implement a sparse x sparse matrix multiplication
with spark?
--
View this message in context:
distributed. something like CordinatedMatrix.multiply(CoordinatedMatrix).
thanks xiangrui!
On Wed, Nov 5, 2014 at 4:24 AM, Xiangrui Meng men...@gmail.com wrote:
local matrix-matrix multiplication or distributed?
On Tue, Nov 4, 2014 at 11:58 PM, ll duy.huynh@gmail.com wrote:
what is
in case, this won't be available anytime soon with spark. what would be a
good way to implement this multiplication feature in spark?
On Wed, Nov 5, 2014 at 4:59 AM, Duy Huynh duy.huynh@gmail.com wrote:
distributed. something like CordinatedMatrix.multiply(CoordinatedMatrix).
thanks
You can use breeze for local sparse-sparse matrix multiplication and
then define an RDD of sub-matrices
RDD[(Int, Int, CSCMatrix[Double])] (blockRowId, blockColId, sub-matrix)
and then use join and aggregateByKey to implement this feature, which
is the same as in MapReduce.
-Xiangrui
Cc: user u...@spark.incubator.apache.org
Date: 11/05/2014 01:13 PM
Subject:Re: sparse x sparse matrix multiplication
You can use breeze for local sparse-sparse matrix multiplication and
then define an RDD of sub-matrices
RDD[(Int, Int, CSCMatrix[Double])] (blockRowId, blockColId