zhengruifeng created SPARK-30457: ------------------------------------ Summary: Use PeriodicRDDCheckpointer instead of NodeIdCache Key: SPARK-30457 URL: https://issues.apache.org/jira/browse/SPARK-30457 Project: Spark Issue Type: Improvement Components: ML Affects Versions: 3.0.0 Reporter: zhengruifeng
Both PeriodicRDDCheckpointer and NodeIdCache are used in tree models: PeriodicRDDCheckpointer is used in GBT to maintain prediction and errors, NodeIdCache is used to maintain NodeIds. The functionality of them are highly similar, and the update process of NodeIdCache is simply. I guess we can delete NodeIdCache and use PeriodicRDDCheckpointer instead. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org