[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322332#comment-14322332 ]
Manoj Kumar commented on SPARK-5016: ------------------------------------ [~mengxr] Can you please clarify a few things. 1. How to key the BreezeData in order to effect parallelization across k gaussians. (considering the fact that it is a soft assignment)? 2. Even if we are able to do so, there are a few lines of code corresponding to the log-likelihood computation as pointed by [~tgaloppo] , which are interdependent, How can that be done? > GaussianMixtureEM should distribute matrix inverse for large numFeatures, k > --------------------------------------------------------------------------- > > Key: SPARK-5016 > URL: https://issues.apache.org/jira/browse/SPARK-5016 > Project: Spark > Issue Type: Improvement > Components: MLlib > Affects Versions: 1.2.0 > Reporter: Joseph K. Bradley > > If numFeatures or k are large, GMM EM should distribute the matrix inverse > computation for Gaussian initialization. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org