Hi, On Sun, Jan 18, 2015 at 11:08 AM, guxiaobo1982 <guxiaobo1...@qq.com> wrote: > > Driver programs submitted by the spark-submit script will get the runtime > spark master URL, but how it get the URL inside the main method when > creating the SparkConf object? >
The master will be stored in the spark.master property. I use the following snippet: // When run through spark-submit, the Java system property "spark.master" // will contain the master passed to spark-submit and we *must* use the // same; otherwise use "local[3]". val master = scala.util.Properties.propOrElse("spark.master", "local[3]") Tobias