You can update $SPARK_HOME/spark-env.sh by setting the environment variable SPARK_HISTORY_OPTS.
See http://spark.apache.org/docs/latest/monitoring.html#spark-configuration-options for options (spark.history.fs.logDirectory) you can set. There is log rotation built in (by time, not size) to the history server, you need to enable/configure it. Hope that helps. -Don On Thu, Dec 8, 2016 at 9:20 PM, John Fang <xiaojian....@alibaba-inc.com> wrote: > ./start-history-server.sh > starting org.apache.spark.deploy.history.HistoryServer, > logging to /home/admin/koala/data/versions/0/SPARK/2.0.2/ > spark-2.0.2-bin-hadoop2.6/logs/spark-admin-org.apache. > spark.deploy.history.HistoryServer-1-v069166214.sqa.zmf.out > > Then the history will print all log to the XXX.sqa.zmf.out， so i can't > limit the file max size. I want limit the size of the log file > -- Donald Drake Drake Consulting http://www.drakeconsulting.com/ https://twitter.com/dondrake <http://www.MailLaunder.com/> 800-733-2143
