Re: Local versions of Linear Algebra Operators in DML

2016-10-24 Thread Matthias Boehm
dev@systemml.incubator.apache.org Date: 10/24/2016 11:54 AM Subject: Re: Local versions of Linear Algebra Operators in DML well, we still compute memory estimates for these operations. So I guess, a good compromise would be to raise a warning whenever the memory estimate is known to excee

Re: Local versions of Linear Algebra Operators in DML

2016-10-24 Thread Berthold Reinwald
Research Center office: (408) 927 2208; T/L: 457 2208 e-mail: reinw...@us.ibm.com From: Matthias Boehm To: dev@systemml.incubator.apache.org Date: 10/24/2016 11:54 AM Subject:Re: Local versions of Linear Algebra Operators in DML well, we still compute memory estimates for

Re: Local versions of Linear Algebra Operators in DML

2016-10-24 Thread Matthias Boehm
1:14 PM Subject: Re: Local versions of Linear Algebra Operators in DML I am also comfortable with option (2) ... "with a plan to implement its distributed version" Thanks, Niketan Pansare IBM Almaden Research Center E-mail: npansar At us.ibm.com http://researcher.watson.ib

Re: Local versions of Linear Algebra Operators in DML

2016-10-24 Thread Deron Eriksson
en jiras for it. > > > > Regards, > > Berthold Reinwald > > IBM Almaden Research Center > > office: (408) 927 2208; T/L: 457 2208 > > e-mail: reinw...@us.ibm.com > > > > > > > > From: Niketan Pansare/Almaden/IBM@IBMUS > > To:

Re: Local versions of Linear Algebra Operators in DML

2016-10-24 Thread Nakul Jindal
sare/Almaden/IBM@IBMUS > To: dev@systemml.incubator.apache.org > Date: 10/21/2016 01:14 PM > Subject:Re: Local versions of Linear Algebra Operators in DML > > > > I am also comfortable with option (2) ... "with a plan to implement its >

Re: Local versions of Linear Algebra Operators in DML

2016-10-24 Thread Berthold Reinwald
maden/IBM@IBMUS To: dev@systemml.incubator.apache.org Date: 10/21/2016 01:14 PM Subject: Re: Local versions of Linear Algebra Operators in DML I am also comfortable with option (2) ... "with a plan to implement its distributed version" Thanks, Niketan Pansare IBM Almad

Re: Local versions of Linear Algebra Operators in DML

2016-10-21 Thread Niketan Pansare
o: dev@systemml.incubator.apache.org Date: 10/21/2016 01:00 PM Subject: Re: Local versions of Linear Algebra Operators in DML thanks Nakul for reaching out before starting work on this. Actually, the introduction of these CP-only builtin functions was a big mistake because (as you already menti

Re: Local versions of Linear Algebra Operators in DML

2016-10-21 Thread Niketan Pansare
esearcher/view.php?person=us-npansar From: Deron Eriksson To: dev@systemml.incubator.apache.org Date: 10/21/2016 12:52 PM Subject: Re: Local versions of Linear Algebra Operators in DML Hi Nakul, +1 I think having some clear characteristic to distinguish operations that only o

Re: Local versions of Linear Algebra Operators in DML

2016-10-21 Thread Matthias Boehm
thanks Nakul for reaching out before starting work on this. Actually, the introduction of these CP-only builtin functions was a big mistake because (as you already mentioned) they mistakenly suggest that we provide distributed operations for them too. The intend was to support them in later ver

Re: Local versions of Linear Algebra Operators in DML

2016-10-21 Thread Deron Eriksson
Hi Nakul, +1 I think having some clear characteristic to distinguish operations that only operate locally is a great idea. Otherwise, how would a user know that these operations are only local and not distributed? Adding this naming convention for local operations sounds reasonable to me so that w

Local versions of Linear Algebra Operators in DML

2016-10-21 Thread Nakul Jindal
Hi, Imran was planning on implementing a distributed SVD as a DML bodied function. The algorithm is described in the paper titled "A Distributed and Incremental SVD Algorithm for Agglomerative Data Analysis on Large Networks" available at https://arxiv.org/abs/1601.07010. This algorithm requires