Re: Exception in thread "main" java.lang.IllegalArgumentException: Unable to read output from "mahout -spark classpath"

2015-10-08 Thread Andrew Palumbo
The Mahout 0.11.0 Shell requires Spark 1.3. Please try with Spark 1.3.1. On 10/08/2015 10:37 PM, go canal wrote: > I tried Spark 1.4.1, same error. Then I saw the same error from shell > command. So I suspect that it is the environment configuration problem. > I have followed this https://mahout.

Re: Exception in thread "main" java.lang.IllegalArgumentException: Unable to read output from "mahout -spark classpath"

2015-10-08 Thread go canal
I tried Spark 1.4.1, same error. Then I saw the same error from shell command. So I suspect that it is the environment configuration problem. I have followed this https://mahout.apache.org/general/downloads.html for Mahout configuration.  So it seems to be a Spark configuration problem, I guess,

Re: matrix inversion in plan ?

2015-10-08 Thread Andrew Musselman
Totally an approximation; depends on why people are asking for the inverse and whether it'd do. On Thu, Oct 8, 2015 at 4:20 PM, Dmitriy Lyubimov wrote: > or pseudoinverse really, i guess > > On Thu, Oct 8, 2015 at 3:58 PM, Dmitriy Lyubimov > wrote: > > > Mahout translation (approximation, since

Re: matrix inversion in plan ?

2015-10-08 Thread Dmitriy Lyubimov
or pseudoinverse really, i guess On Thu, Oct 8, 2015 at 3:58 PM, Dmitriy Lyubimov wrote: > Mahout translation (approximation, since ssvd is reduced-rank, not the > true thing): > > val (drmU, drmV, s) = dssvd(drmA, k = 100) > val drmInvA = drmV %*% diagv(1 /=: s) %*% drmU.t > > Still, technicall

Re: matrix inversion in plan ?

2015-10-08 Thread Andrew Musselman
Go, if you'd like to put your research team in touch with the list we may be able to help work through a good approach; let us know. On Thu, Oct 8, 2015 at 3:58 PM, Dmitriy Lyubimov wrote: > Mahout translation (approximation, since ssvd is reduced-rank, not the true > thing): > > val (drmU, drmV

Re: matrix inversion in plan ?

2015-10-08 Thread Dmitriy Lyubimov
Mahout translation (approximation, since ssvd is reduced-rank, not the true thing): val (drmU, drmV, s) = dssvd(drmA, k = 100) val drmInvA = drmV %*% diagv(1 /=: s) %*% drmU.t Still, technically, it is a right inverse as in reality m is rarely the same as n. Also, k must be k<= drmA.nrow min drmA

Re: matrix inversion in plan ?

2015-10-08 Thread Andrew Musselman
Yeah, nice trick Ted; here's a how-to for the list: http://www.cse.unr.edu/~bebis/CS791E/Notes/SVD.pdf On Thu, Oct 8, 2015 at 2:31 PM, Ted Dunning wrote: > Yes. You can get the inverse from an SVD or emulate its effect. > > Can you share the actual mathematical specification for your problem? >

Re: matrix inversion in plan ?

2015-10-08 Thread Ted Dunning
Yes. You can get the inverse from an SVD or emulate its effect. Can you share the actual mathematical specification for your problem? If you can't, then there is little we can do to help. On Wed, Oct 7, 2015 at 11:35 PM, go canal wrote: > Unfortunately I do not know much details of these. Th