Re: Which linear algebra interface to use within Spark MLlib?

2015-03-21 Thread Debasish Das
Hi Burak, For local linear algebra package why are we not extending breeze ? Breeze is a mllib dependency...Also that way the local linear algebra package will be used by other scala based frontend APIs as well that do not necessarily pull in Spark dependencies... Thanks. Deb On Fri, Mar 20,

Re: Which linear algebra interface to use within Spark MLlib?

2015-03-20 Thread Burak Yavuz
Hi, We plan to add a more comprehensive local linear algebra package for MLlib 1.4. This local linear algebra package can then easily be extended to BlockMatrix to support the same operations in a distributed fashion. You may find the JIRA to track this here: SPARK-6442

Re: Which linear algebra interface to use within Spark MLlib?

2015-03-19 Thread Ulanov, Alexander
Thank you! When do you expect to have gemm in Breeze and that version of Breeze to ship with MLlib? Also, could someone please elaborate on the linalg.BLAS and Matrix? Are they going to be developed further, should in long term all developers use them? Best regards, Alexander 18.03.2015, в

Which linear algebra interface to use within Spark MLlib?

2015-03-18 Thread Ulanov, Alexander
Hi, Currently I am using Breeze within Spark MLlib for linear algebra. I would like to reuse previously allocated matrices for storing the result of matrices multiplication, i.e. I need to use gemm function C:=q*A*B+p*C, which is missing in Breeze (Breeze automatically allocates a new matrix