This can only be a local filesystem though, it can't refer to an HDFS location. This is because it gets passed directly to the JVM.
On Mon, Apr 28, 2014 at 9:55 PM, Patrick Wendell <[email protected]> wrote: > Yes, you can set SPARK_LIBRARY_PATH in 0.9.X and in 1.0 you can set > spark.executor.extraLibraryPath. > > > On Mon, Apr 28, 2014 at 9:16 AM, Shubham Chopra > <[email protected]>wrote: > >> I am trying to use Spark/MLLib on Yarn and do not have libgfortran >> installed on my cluster. Is there any way I can set LD_LIBRARY_PATH so >> Spark/MLLib/jblas pick up the library from a non-standard location (like >> say the distributed cache or /tmp instead of /usr/lib). >> >> Thanks, >> ~Shubham. >> >> >> >
