I finally found the answer. SparkContext has a method addFile.
On Wed, Mar 19, 2014 at 5:23 PM, Mayur Rustagi <[email protected]>wrote: > I doubt thr is something like this out of the box. Easiest thing is to > package it in to a jar & send that jar across. > Regards > > Mayur Rustagi > Ph: +1 (760) 203 3257 > http://www.sigmoidanalytics.com > @mayur_rustagi <https://twitter.com/mayur_rustagi> > > > > On Wed, Mar 19, 2014 at 6:57 AM, Jaonary Rabarisoa <[email protected]>wrote: > >> Hi all, >> >> I'm trying to build an evaluation platform based on Spark. The idea is to >> run a blackbox executable (build with c/c++ or some scripting language). >> This blackbox takes a set of data as input and outpout some metrics. Since >> I have a huge amount of data, I need to distribute the computation and use >> tools like mapreduce. >> >> The question is, how do I send these blacboxes executable to each node >> automatically so they can be called. I need something similar to addJar but >> for any kind of files. >> >> >> Cheers, >> >> >> >
