Hi all
Recently I have learned about 1.3 spark core source code , can't
understand rpc, How to communicate between client driver, worker and
master?
There are some scala files such as RpcCallContextRpcEndPointRef
RpcEndpoint RpcEnv. On spark core rpc module
Have any blogs ?
The new RPC interface is an internal module and added in 1.4. It should not
exist in 1.3. Where did you find it?
For the communication between driver, worker and master, it still uses
Akka. There are a pending PR to update them:
https://github.com/apache/spark/pull/5392 Do you mean the
