There is a sc._jsc_ which you can access to get/set hadoop conf. On Wed, Jul 1, 2015 at 7:41 AM, Richard Ding <pigu...@gmail.com> wrote:
> Hi, > > I noticed that, in Scala API, one can call hadoopConfiguration on > SparkContext to retrieve the hadoop configuration object which is very > handy in modifying certain hadoop properties at runtime. But there is no > corresponding method in Python API. > > Will this method be added to Python API in a later release? In the mean > time, what will be the work around (of setting hadoop properties at > runtime) using Python API? > > Thanks, > Richard > -- Best Regards, Ayan Guha
