[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
LI Guobao updated SYSTEMML-2420: -------------------------------- Attachment: systemml_rpc_sequence_diagram.png > Communication between ps and workers > ------------------------------------ > > Key: SYSTEMML-2420 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2420 > Project: SystemML > Issue Type: Sub-task > Reporter: LI Guobao > Assignee: LI Guobao > Priority: Major > Attachments: systemml_rpc_2_seq_diagram.png, > systemml_rpc_sequence_diagram.png > > > It aims to implement the parameter exchange between ps and workers. We could > leverage spark RPC to setup a ps endpoint in driver node which means that the > ps service could be discovered by workers in the network. And then the > workers could invoke the pull/push method via RPC using the registered > endpoint of ps service. Hence, in details, this tasks consists of registering > the ps endpoint in spark rpc framework and using rpc to invoke target method > in worker side. We can learn that the spark rpc is implemented in Scala. > Hence we need to wrap them in in order to be used in Java. Overall, we could > register the ps service with _RpcEndpoint_ and invoke the service with > _RpcEndpointRef_. -- This message was sent by Atlassian JIRA (v7.6.3#76005)