Hi, How did you set it? How do you run the app? Use sys.env to know whether it was set or not.
Jacek On 17 Jul 2016 11:33 a.m., "Daniel Haviv" <daniel.ha...@veracity-group.com> wrote: > Hi, > I'm running Spark using IntelliJ on Windows and even though I set > HADOOP_CONF_DIR it does not affect the contents of sc.hadoopConfiguration. > > Anybody encountered it ? > > Thanks, > Daniel >