Thanks, it looks like the config has to start with "spark", a very interesting
requirement.
I am using Spark 1.3.1, I didn't see this Warning log in the console.
Thanks for your help.
Yong
Date: Thu, 12 Nov 2015 23:03:12 +0530
Subject: Re: In Spark application, how to get the passed in
You must be getting a warning at the start of application like : Warning:
Ignoring non-spark config property: runtime.environment=passInValue .
Configs in spark should start with *spark* as prefix. So try something like
--conf spark.runtime.environment=passInValue .
Regards
Varun
On Thu, Nov
In my Spark application, I want to access the pass in configuration, but it
doesn't work. How should I do that?
object myCode extends Logging {
// starting point of the application
def main(args: Array[String]): Unit = {
val sparkContext = new SparkContext()
val runtimeEnvironment =
