What I found from a quick search of the Spark source code (from my local
snapshot on January 25, 2015):
// Interval between each check for event log updates
private val UPDATE_INTERVAL_MS =
conf.getInt(spark.history.fs.updateInterval,
conf.getInt(spark.history.updateInterval, 10)) * 1000
Thank you Charles and Meethu.
On Tue, Mar 10, 2015 at 12:47 AM, Charles Feduke charles.fed...@gmail.com
wrote:
What I found from a quick search of the Spark source code (from my local
snapshot on January 25, 2015):
// Interval between each check for event log updates
private val
Hi All,
What are the default values for the following conf properities if we don't
set in the conf file?
# spark.history.fs.updateInterval 10
# spark.history.retainedApplications 500
Regards,
Srini.
