[jira] [Commented] (SPARK-7368) add QR decomposition for RowMatrix
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537205#comment-14537205 ] yuhao yang commented on SPARK-7368: --- Hi Zongheng, since the Amplab version is built upon a different RowMatrix implementation. I'm not sure if it's appropriate to make a direct comparison. I haven't got the time to review the difference carefully. If possible, can you please share more information that has been collected, like some benchmark or capability. In the meantime, I'll do it for my PR also. And what's better is that there have been a plan to migrate the Amplab version to Spark. Let me know if you have any suggestion about how shall we proceed. Thanks. > add QR decomposition for RowMatrix > -- > > Key: SPARK-7368 > URL: https://issues.apache.org/jira/browse/SPARK-7368 > Project: Spark > Issue Type: Improvement > Components: MLlib >Reporter: yuhao yang > Original Estimate: 48h > Remaining Estimate: 48h > > Add QR decomposition for RowMatrix. > There's a great distributed algorithm for QR decomposition, which I'm > currently referring to. > Austin R. Benson, David F. Gleich, James Demmel. "Direct QR factorizations > for tall-and-skinny matrices in MapReduce architectures", 2013 IEEE > International Conference on Big Data -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7368) add QR decomposition for RowMatrix
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529742#comment-14529742 ] yuhao yang commented on SPARK-7368: --- Oops, I was not aware of the previous effort. Thanks Joseph and Zongheng. I'll try with the AMPLab version and send update. > add QR decomposition for RowMatrix > -- > > Key: SPARK-7368 > URL: https://issues.apache.org/jira/browse/SPARK-7368 > Project: Spark > Issue Type: Improvement > Components: MLlib >Reporter: yuhao yang > Original Estimate: 48h > Remaining Estimate: 48h > > Add QR decomposition for RowMatrix. > There's a great distributed algorithm for QR decomposition, which I'm > currently referring to. > Austin R. Benson, David F. Gleich, James Demmel. "Direct QR factorizations > for tall-and-skinny matrices in MapReduce architectures", 2013 IEEE > International Conference on Big Data -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7368) add QR decomposition for RowMatrix
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529214#comment-14529214 ] Zongheng Yang commented on SPARK-7368: -- FYI, the ml-matrix package from AMPLab (github.com/amplab/ml-matrix) has a TSQR implementation [1]. It has been deployed in several machine learning applications for a while. Would be good to compare design/perf. etc. [1] https://github.com/amplab/ml-matrix/blob/master/src/main/scala/edu/berkeley/cs/amplab/mlmatrix/TSQR.scala > add QR decomposition for RowMatrix > -- > > Key: SPARK-7368 > URL: https://issues.apache.org/jira/browse/SPARK-7368 > Project: Spark > Issue Type: Improvement > Components: MLlib >Reporter: yuhao yang > Original Estimate: 48h > Remaining Estimate: 48h > > Add QR decomposition for RowMatrix. > There's a great distributed algorithm for QR decomposition, which I'm > currently referring to. > Austin R. Benson, David F. Gleich, James Demmel. "Direct QR factorizations > for tall-and-skinny matrices in MapReduce architectures", 2013 IEEE > International Conference on Big Data -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7368) add QR decomposition for RowMatrix
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529165#comment-14529165 ] Joseph K. Bradley commented on SPARK-7368: -- CC: [~rezazadeh] [~brkyvz] Pinging since you may have plans related to this > add QR decomposition for RowMatrix > -- > > Key: SPARK-7368 > URL: https://issues.apache.org/jira/browse/SPARK-7368 > Project: Spark > Issue Type: Improvement > Components: MLlib >Reporter: yuhao yang > Original Estimate: 48h > Remaining Estimate: 48h > > Add QR decomposition for RowMatrix. > There's a great distributed algorithm for QR decomposition, which I'm > currently referring to. > Austin R. Benson, David F. Gleich, James Demmel. "Direct QR factorizations > for tall-and-skinny matrices in MapReduce architectures", 2013 IEEE > International Conference on Big Data -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7368) add QR decomposition for RowMatrix
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14528341#comment-14528341 ] Apache Spark commented on SPARK-7368: - User 'hhbyyh' has created a pull request for this issue: https://github.com/apache/spark/pull/5909 > add QR decomposition for RowMatrix > -- > > Key: SPARK-7368 > URL: https://issues.apache.org/jira/browse/SPARK-7368 > Project: Spark > Issue Type: Improvement > Components: MLlib >Reporter: yuhao yang > Original Estimate: 48h > Remaining Estimate: 48h > > Add QR decomposition for RowMatrix. > There's a great distributed algorithm for QR decomposition, which I'm > currently referring to. > Austin R. Benson, David F. Gleich, James Demmel. "Direct QR factorizations > for tall-and-skinny matrices in MapReduce architectures", 2013 IEEE > International Conference on Big Data -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
