[jira] [Updated] (SPARK-11354) Expose custom log4j to executor page in Spark standalone cluster
[ https://issues.apache.org/jira/browse/SPARK-11354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-11354: - Labels: bulk-closed (was: ) > Expose custom log4j to executor page in Spark standalone cluster > - > > Key: SPARK-11354 > URL: https://issues.apache.org/jira/browse/SPARK-11354 > Project: Spark > Issue Type: Improvement > Components: Web UI >Reporter: Yongjia Wang >Priority: Minor > Labels: bulk-closed > Attachments: custom log4j on executor page.png > > > Spark uses log4j, which is very flexible. However, on the executor page in > standalone cluster, only stdout and stderr are shown in the UI. In the > default log4j profile, all messages are forwarded to System.err which is, in > turn, written to the file stderr in executor directory. Similarly, stdout is > written to the stdout file in executor directory. > It would be very useful to show all the file appenders configured in a custom > log4j profile. Right now, these file appenders are written to the executor > directory, but they are not exposed to the UI. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-11354) Expose custom log4j to executor page in Spark standalone cluster
[ https://issues.apache.org/jira/browse/SPARK-11354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated SPARK-11354: Description: Spark uses log4j, which is very flexible. However, on the executor page in standalone cluster, only stdout and stderr are shown in the UI. In the default log4j profile, all messages are forwarded to System.err which is, in turn, written to the file stderr in executor directory. Similarly, stdout is written to the stdout file in executor directory. It would be very useful to show all the file appenders configured in a custom log4j profile. Right now, these file appenders are written to the executor directory, but they are not exposed to the UI. was: Spark use log4j, which is very flexible. However, on the executor page in standalone cluster, only stdout and stderr are shown in the UI. In the default log4j profile, all messages are forwarded to System.err which is in turned written to the file stderr in executor directory. Similarly, stdout is written to the stdout file in executor directory. It would be very useful to show all the file appenders configured in a custom log4j profile. Right now, these file appenders are written to the executor directory, but they are not exposed to the UI. > Expose custom log4j to executor page in Spark standalone cluster > - > > Key: SPARK-11354 > URL: https://issues.apache.org/jira/browse/SPARK-11354 > Project: Spark > Issue Type: Improvement > Components: Web UI >Reporter: Yongjia Wang >Priority: Minor > Attachments: custom log4j on executor page.png > > > Spark uses log4j, which is very flexible. However, on the executor page in > standalone cluster, only stdout and stderr are shown in the UI. In the > default log4j profile, all messages are forwarded to System.err which is, in > turn, written to the file stderr in executor directory. Similarly, stdout is > written to the stdout file in executor directory. > It would be very useful to show all the file appenders configured in a custom > log4j profile. Right now, these file appenders are written to the executor > directory, but they are not exposed to the UI. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-11354) Expose custom log4j to executor page in Spark standalone cluster
[ https://issues.apache.org/jira/browse/SPARK-11354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11354: -- Priority: Minor (was: Major) > Expose custom log4j to executor page in Spark standalone cluster > - > > Key: SPARK-11354 > URL: https://issues.apache.org/jira/browse/SPARK-11354 > Project: Spark > Issue Type: Improvement > Components: Web UI >Reporter: Yongjia Wang >Priority: Minor > Attachments: custom log4j on executor page.png > > > Spark use log4j, which is very flexible. However, on the executor page in > standalone cluster, only stdout and stderr are shown in the UI. In the > default log4j profile, all messages are forwarded to System.err which is in > turned written to the file stderr in executor directory. Similarly, stdout is > written to the stdout file in executor directory. > It would be very useful to show all the file appenders configured in a custom > log4j profile. Right now, these file appenders are written to the executor > directory, but they are not exposed to the UI. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-11354) Expose custom log4j to executor page in Spark standalone cluster
[ https://issues.apache.org/jira/browse/SPARK-11354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-11354: - Attachment: custom log4j on executor page.png > Expose custom log4j to executor page in Spark standalone cluster > - > > Key: SPARK-11354 > URL: https://issues.apache.org/jira/browse/SPARK-11354 > Project: Spark > Issue Type: Improvement > Components: Web UI >Reporter: Yongjia Wang > Attachments: custom log4j on executor page.png > > > Spark use log4j, which is very flexible. However, on the executor page in > standalone cluster, only stdout and stderr are shown in the UI. In the > default log4j profile, all messages are forwarded to System.err which is in > turned written to the file stderr in executor directory. Similarly, stdout is > written to the stdout file in executor directory. > It would be very useful to show all the file appenders configured in a custom > log4j profile. Right now, these file appenders are written to the executor > directory, but they are not exposed to the UI. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
