Re: Distributed Matrices - spark mllib

2016-07-24 Thread Yanbo Liang
Hi Gourav, I can not reproduce your problem. The following code snippets works well on my local machine, you can try to verify it in your environment. Or could you provide more information to make others can reproduce your problem? from pyspark.mllib.linalg.distributed import CoordinateMatrix,

Distributed Matrices - spark mllib

2016-07-22 Thread Gourav Sengupta
Hi, I had a sparse matrix and I wanted to add the value of a particular row which is identified by a particular number. from pyspark.mllib.linalg.distributed import CoordinateMatrix, MatrixEntry mat = CoordinateMatrix(all_scores_df.select('ID_1','ID_2','value').rdd.map(lambda row: