zhengruifeng created SPARK-30457:
------------------------------------

             Summary: Use PeriodicRDDCheckpointer instead of NodeIdCache
                 Key: SPARK-30457
                 URL: https://issues.apache.org/jira/browse/SPARK-30457
             Project: Spark
          Issue Type: Improvement
          Components: ML
    Affects Versions: 3.0.0
            Reporter: zhengruifeng


Both PeriodicRDDCheckpointer and NodeIdCache are used in tree models:

PeriodicRDDCheckpointer is used in GBT to maintain prediction and errors,

NodeIdCache is used to maintain NodeIds.

 

The functionality of them are highly similar, and the update process of 
NodeIdCache is simply. I guess we can delete NodeIdCache and use 
PeriodicRDDCheckpointer instead.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to