Repository: spark Updated Branches: refs/heads/branch-1.3 485b91934 -> b8db84c5b
fix spark-6033, clarify the spark.worker.cleanup behavior in standalone mode jira case spark-6033 https://issues.apache.org/jira/browse/SPARK-6033 In standalone deploy mode, the cleanup will only remove the stopped application's directories. The original description about the cleanup behavior is incorrect. Author: è®¸é¹ <peng...@fraudmetrix.cn> Closes #4803 from hseagle/spark-6033 and squashes the following commits: 927a6a0 [许é¹] fix the incorrect description about the spark.worker.cleanup in standalone mode (cherry picked from commit 0375a413b8a009f5820897691570a1273ee25b97) Signed-off-by: Andrew Or <and...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b8db84c5 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b8db84c5 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b8db84c5 Branch: refs/heads/branch-1.3 Commit: b8db84c5b6a9d7d538d066f5a84a50ac8c8f9b41 Parents: 485b919 Author: è®¸é¹ <peng...@fraudmetrix.cn> Authored: Thu Feb 26 23:05:56 2015 -0800 Committer: Andrew Or <and...@databricks.com> Committed: Thu Feb 26 23:06:42 2015 -0800 ---------------------------------------------------------------------- docs/spark-standalone.md | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/b8db84c5/docs/spark-standalone.md ---------------------------------------------------------------------- diff --git a/docs/spark-standalone.md b/docs/spark-standalone.md index 5c6084f..74d8653 100644 --- a/docs/spark-standalone.md +++ b/docs/spark-standalone.md @@ -222,8 +222,7 @@ SPARK_WORKER_OPTS supports the following system properties: <td>false</td> <td> Enable periodic cleanup of worker / application directories. Note that this only affects standalone - mode, as YARN works differently. Applications directories are cleaned up regardless of whether - the application is still running. + mode, as YARN works differently. Only the directories of stopped applications are cleaned up. </td> </tr> <tr> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org