[jira] [Assigned] (SPARK-22467) Added a switch to support whether `stdout_stream` and `stderr_stream` output to disk
[ https://issues.apache.org/jira/browse/SPARK-22467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22467: Assignee: Apache Spark > Added a switch to support whether `stdout_stream` and `stderr_stream` output > to disk > > > Key: SPARK-22467 > URL: https://issues.apache.org/jira/browse/SPARK-22467 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 2.3.0 >Reporter: liuxian >Assignee: Apache Spark > > We should add a switch to control the `stdout_stream` and `stdout_stream` > output to disk. > In my environment,due to disk I/O blocking, the `stdout_stream` output is > very slow, so it can not be timely cleaning,and this leads the executor > process to be blocked. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-22467) Added a switch to support whether `stdout_stream` and `stderr_stream` output to disk
[ https://issues.apache.org/jira/browse/SPARK-22467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22467: Assignee: (was: Apache Spark) > Added a switch to support whether `stdout_stream` and `stderr_stream` output > to disk > > > Key: SPARK-22467 > URL: https://issues.apache.org/jira/browse/SPARK-22467 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 2.3.0 >Reporter: liuxian > > We should add a switch to control the `stdout_stream` and `stdout_stream` > output to disk. > In my environment,due to disk I/O blocking, the `stdout_stream` output is > very slow, so it can not be timely cleaning,and this leads the executor > process to be blocked. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org