What I found from a quick search of the Spark source code (from my local
snapshot on January 25, 2015):
// Interval between each check for event log updates
private val UPDATE_INTERVAL_MS =
conf.getInt("spark.history.fs.updateInterval",
conf.getInt("spark.history.updateInterval", 10)) * 1000
private val retainedApplications =
conf.getInt("spark.history.retainedApplications", 50)
On Tue, Mar 10, 2015 at 12:37 AM Srini Karri <[email protected]> wrote:
> Hi All,
>
> What are the default values for the following conf properities if we don't
> set in the conf file?
>
> # spark.history.fs.updateInterval 10
>
> # spark.history.retainedApplications 500
>
>
> Regards,
>
> Srini.
>
