You might want to consider SparkContext.addFile() for distributing the file
at the client and SparkFiles.get() for retrieving the file at the execution
node.
--Xuefu
On Fri, Jan 2, 2015 at 7:15 PM, Zhang, Liyun liyun.zh...@intel.com wrote:
Hi all,
I want to ask a question about ship in pig:
Hi all,
I want to ask a question about ship in pig:
Ship with streaming, it will send streaming binary and supporting files, if
any, from the client node to the compute nodes.
I found that the implementation of ship in Mapreduce mode is:
Hi all,
I want to ask a question about ship in pig:
Ship with streaming, it will send streaming binary and supporting files, if
any, from the client node to the compute nodes.
I found that the implementation of ship in Mapreduce mode is:
