[
https://issues.apache.org/jira/browse/SPARK-13196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13196:
------------------------------------
Assignee: (was: Apache Spark)
> Optimize the option and flatten in Word2Vec to reduce the max memory
> consumption
> --------------------------------------------------------------------------------
>
> Key: SPARK-13196
> URL: https://issues.apache.org/jira/browse/SPARK-13196
> Project: Spark
> Issue Type: Improvement
> Components: MLlib
> Reporter: yuhao yang
> Priority: Minor
>
> code optimization.
> 1. remove the unnecessary Option and flatten.
> 2. avoid the extra space caused by the ++ operation.
> This would reduce the maximum memory word2vec requires, thus to support
> larger dataset or vocabulary for limited memory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
