[ https://issues.apache.org/jira/browse/SPARK-19078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhengruifeng closed SPARK-19078. -------------------------------- Resolution: Duplicate > hashingTF,ChiSqSelector,IDF,StandardScaler,PCA transform avoid extra vector > conversion > -------------------------------------------------------------------------------------- > > Key: SPARK-19078 > URL: https://issues.apache.org/jira/browse/SPARK-19078 > Project: Spark > Issue Type: Improvement > Components: ML > Reporter: zhengruifeng > Priority: Minor > > There some ML.algs (hashingTF,ChiSqSelector,IDF,StandardScaler,PCA,LDA) that > use oldModel in MLlib in {{transform}} method, this will cause extra > conversion of vectors and matrices. > This pr modify transform to direct use ml.linalg in > {{hashingTF,ChiSqSelector,IDF,StandardScaler,PCA}}. > I do not touch LDA because it is more complicated than others. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org