Hi Jim, You're right; that should be unpersisted. Could you please create a JIRA and submit a patch?
Thanks! Joseph On Wed, Apr 22, 2015 at 6:00 PM, jimfcarroll <jimfcarr...@gmail.com> wrote: > Hi all, > > It appears GradientBoostedTrees.scala can call 'persist' on an RDD and > never > unpersist it. In the master branch it's here: > > > https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/mllib/tree/GradientBoostedTrees.scala#L181 > > In 1.3.1 it's here: > > > https://github.com/apache/spark/blob/v1.3.1/mllib/src/main/scala/org/apache/spark/mllib/tree/GradientBoostedTrees.scala#L138 > > Let me know if you want a fix for this. > > Jim > > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/GradientBoostTrees-leaks-a-persisted-RDD-tp11750.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional commands, e-mail: dev-h...@spark.apache.org > >
