[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2017-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887730#comment-15887730 ] Apache Spark commented on SPARK-16440: -- User 'AnthonyTruchet' has created a pull request for this

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-21 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387342#comment-15387342 ] Anthony Truchet commented on SPARK-16440: - Regarding the try finally: we are computing numerous

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384608#comment-15384608 ] Apache Spark commented on SPARK-16440: -- User 'AnthonyTruchet' has created a pull request for this

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384131#comment-15384131 ] Sean Owen commented on SPARK-16440: --- Yeah it seems good to destroy even in case of errors, but in

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-19 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384118#comment-15384118 ] Anthony Truchet commented on SPARK-16440: - I will, as well as putting this is a try finally to

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383971#comment-15383971 ] Sean Owen commented on SPARK-16440: --- Oh, may be better still indeed. Feel free to submit a follow up

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-19 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383967#comment-15383967 ] Anthony Truchet commented on SPARK-16440: - Thanks for such a quick fix [~srowen] : I was off-line

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372781#comment-15372781 ] Apache Spark commented on SPARK-16440: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367616#comment-15367616 ] Sean Owen commented on SPARK-16440: --- Yeah it would be fine to unpersist these at the end of the method.

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-08 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367615#comment-15367615 ] Anthony Truchet commented on SPARK-16440: - Hello Spark developers, I'm preparing a patch for