You can set HADOOP_CONF_DIR inside the spark-env.sh file Thanks Best Regards
On Sat, Nov 1, 2014 at 4:14 AM, ameyc <ambr...@gmail.com> wrote: > How do i setup hadoop_conf_dir correctly when I'm running my spark job on > Yarn? My Yarn environment has the correct hadoop_conf_dir settings by the > configuration that I pull from sc.hadoopConfiguration() is incorrect. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/hadoop-conf-dir-when-running-spark-on-yarn-tp17872.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
