I'm running Spark1.1.0 on YARN(Hadoop-2.4.1) and try to use "spark.yarn.appMasterEnv.*" to execute some scripts. In spark-default.conf, I set environment variables like this, but this description is redundant.
spark.yarn.appMasterEnv.SCRIPT_DIR /home/kuromtsu/spark-1.1.0/scripts spark.yarn.appMasterEnv.SCRIT1 /home/kuromtsu/spark-1.1.0/scripts/scritp1.sh spark.yarn.appMasterEnv.SCRIT2 /home/kuromtsu/spark-1.1.0/scripts/scritp3.sh spark.yarn.appMasterEnv.SCRIT3 /home/kuromtsu/spark-1.1.0/scripts/scritp4.sh Wold anybody know more simple desciption? Regards, Kuromatsu --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
