Yu Peng created SPARK-17711: ------------------------------- Summary: Compress rolled executor logs Key: SPARK-17711 URL: https://issues.apache.org/jira/browse/SPARK-17711 Project: Spark Issue Type: New Feature Reporter: Yu Peng
Currently, rolled executor logs are not compressed. If the executor produces a lot of logs, it may consume all executor disk space and fail the task. With this feature, executor will compress the rolled stderr/stdout like log4j to reduce disk usage. [~mengxr] -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org