[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
LI Guobao updated SYSTEMML-2419: -------------------------------- Description: In the context of distributed spark env, we need to firstly ship the necessary functions and variables to the remote workers and then to initialize and register the cleanup of buffer pool for each remote worker. All these are inspired by the parfor implementation. (was: In the context of distributed spark env, we need to initialize and register the cleanup of buffer pool for each remote worker. It could be inspired by the parfor implementation.) > Setup and cleanup of remote workers > ----------------------------------- > > Key: SYSTEMML-2419 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2419 > Project: SystemML > Issue Type: Sub-task > Reporter: LI Guobao > Assignee: LI Guobao > Priority: Major > > In the context of distributed spark env, we need to firstly ship the > necessary functions and variables to the remote workers and then to > initialize and register the cleanup of buffer pool for each remote worker. > All these are inspired by the parfor implementation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)