Re: Spark property parameters priority

2016-03-11 Thread Jacek Laskowski
Hi It could also be conf/spark-defaults.conf. Jacek 11.03.2016 8:07 PM "Cesar Flores" napisaƂ(a): > > Right now I know of three different things to pass property parameters to > the Spark Context. They are: > >- A) Inside a SparkConf object just before creating the Spark

Spark property parameters priority

2016-03-11 Thread Cesar Flores
Right now I know of three different things to pass property parameters to the Spark Context. They are: - A) Inside a SparkConf object just before creating the Spark Context - B) During job submission (i.e. --conf spark.driver.memory.memory = 2g) - C) By using a specific property file