Re: Large-scale matrix inverse in Spark

2016-09-29 Thread Robineast
gt; the parallelized matrix inversion in Spark, however I am trying to use an > existing code instead of implementing one from scratch, if available. > > If you reply to this email, your message will be added to the discussion > below: > http://apache-spark-user-list.1001560.n3

Re: Large-scale matrix inverse in Spark

2016-09-27 Thread Anastasios Zouzias
ttps://en.wikipedia.org/wiki/Computational_ > complexity_of_mathematical_operations#Matrix_algebra > or if you really want to dig into it > Stoer and Bulirsch http://www.springer.com/us/book/9780387954523 > > On Mon, Sep 26, 2016 at 11:00 PM Sean Owen wrote: > >> I don't recall a

Re: Large-scale matrix inverse in Spark

2016-09-26 Thread Edward Fine
at 11:00 PM Sean Owen wrote: > I don't recall any code in Spark that computes a matrix inverse. There is > code that solves linear systems Ax = b with a decomposition. For example > from looking at the code recently, I think the regression implementation > actually solves A

Re: Large-scale matrix inverse in Spark

2016-09-26 Thread Sean Owen
I don't recall any code in Spark that computes a matrix inverse. There is code that solves linear systems Ax = b with a decomposition. For example from looking at the code recently, I think the regression implementation actually solves AtAx = Atb using a Cholesky decomposition. But, A =

Large-scale matrix inverse in Spark

2016-09-26 Thread Cooper
ilable. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Large-scale-matrix-inverse-in-Spark-tp27796.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubsc

Matrix Inverse

2015-12-17 Thread Arunkumar Pillai
Hi I want to find matrix inverse of (XTranspose * X). PFB my code. This code does not work for even slight larger dataset. Please help me if the approach is correct. val sqlQuery = "SELECT column1,column2 ,column3 FROM " + tableName val matrixDF` = sqlContext.sql(sqlQuery)

Re: matrix inverse and multiplication

2015-08-14 Thread go canal
Correction: I am not able to convert the Scala statement to java.

matrix inverse and multiplication

2015-08-13 Thread go canal
Hello,I am new to Spark. I am looking for a matrix inverse and multiplication solution. I did a quick search and found a couple of solutions but my requirements are:- large matrix (up to 2 millions x 2 m)- need to support complex double data type- preferably in Java  There is one post  http