[ https://issues.apache.org/jira/browse/SPARK-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves resolved SPARK-2668. ---------------------------------- Resolution: Fixed Fix Version/s: 1.2.0 > Add variable of yarn log directory for reference from the log4j configuration > ----------------------------------------------------------------------------- > > Key: SPARK-2668 > URL: https://issues.apache.org/jira/browse/SPARK-2668 > Project: Spark > Issue Type: Improvement > Components: YARN > Affects Versions: 1.0.0 > Reporter: Peng Zhang > Fix For: 1.2.0 > > > Assign value of yarn container log directory to java opts > "spark.yarn.log.dir", So user defined log4j.properties can reference this > value and write log to YARN container's log directory. > Otherwise, user defined file appender will only write to container's CWD, and > log files in CWD will not be displayed on YARN UIļ¼and either cannot be > aggregated to HDFS log directory after job finished. > User defined log4j.properties reference example: > {code} > log4j.appender.rolling_file.File = ${spark.yarn.log.dir}/spark.log > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org