Hi all, I'm trying to build an evaluation platform based on Spark. The idea is to run a blackbox executable (build with c/c++ or some scripting language). This blackbox takes a set of data as input and outpout some metrics. Since I have a huge amount of data, I need to distribute the computation and use tools like mapreduce.
The question is, how do I send these blacboxes executable to each node automatically so they can be called. I need something similar to addJar but for any kind of files. Cheers,