[
https://issues.apache.org/jira/browse/SPARK-21711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mahesh Ambule updated SPARK-21711:
----------------------------------
Description:
Currently, log4j properties can be specified in spark 'conf' directory in
log4j.properties file.
The spark-submit command can override these log4j properties for driver and
executors logs. But it can not override log4j properties for spark and yarn
clients in yarn-cluster mode.
The user should be able to pass log4j properties for spark and yarn clients
using the spark-submit command.
was:
Currently, log4j properties can be specified in spark 'conf' directory in
log4j.properties file.
The spark-submit command can override these log4j properties for driver and
executors logs. But it can not override log4j properties for spark and yarn
clients in yarn-cluster mode.
The user should be able to pass log4j properties for spark and yarn client
using spark-submit command.
> spark-submit command should accept log4j configuration parameters for spark
> client logging.
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-21711
> URL: https://issues.apache.org/jira/browse/SPARK-21711
> Project: Spark
> Issue Type: Improvement
> Components: Spark Submit
> Affects Versions: 1.6.0, 2.1.0
> Reporter: Mahesh Ambule
> Priority: Minor
>
> Currently, log4j properties can be specified in spark 'conf' directory in
> log4j.properties file.
> The spark-submit command can override these log4j properties for driver and
> executors logs. But it can not override log4j properties for spark and yarn
> clients in yarn-cluster mode.
> The user should be able to pass log4j properties for spark and yarn clients
> using the spark-submit command.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
