[ https://issues.apache.org/jira/browse/SPARK-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peng Zhang updated SPARK-2668: ------------------------------ Affects Version/s: 1.0.0 > Support log4j log to yarn container log directory > ------------------------------------------------- > > Key: SPARK-2668 > URL: https://issues.apache.org/jira/browse/SPARK-2668 > Project: Spark > Issue Type: Improvement > Components: YARN > Affects Versions: 1.0.0 > Reporter: Peng Zhang > > Assign value of yarn container log directory to java opts > "spark.yarn.log.dir", So user defined log4j.properties can reference this > value and write log to YARN container directory. > Otherwise, user defined file append will log to CWD, and files will not be > displayed on YARN UIļ¼and either cannot be aggregated to HDFS log directory > after job finished. > User defined log4j.properties reference example: > {code} > log4j.appender.rolling_file.File = ${spark.yarn.log.dir}/spark.log > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)