Repository: spark
Updated Branches:
  refs/heads/branch-1.3 485b91934 -> b8db84c5b


fix spark-6033, clarify the spark.worker.cleanup behavior in standalone mode

jira case spark-6033 https://issues.apache.org/jira/browse/SPARK-6033

In standalone deploy mode, the cleanup will only remove the stopped 
application's directories.

The original description about the cleanup behavior is incorrect.

Author: 许鹏 <peng...@fraudmetrix.cn>

Closes #4803 from hseagle/spark-6033 and squashes the following commits:

927a6a0 [许鹏] fix the incorrect description about the spark.worker.cleanup 
in standalone mode

(cherry picked from commit 0375a413b8a009f5820897691570a1273ee25b97)
Signed-off-by: Andrew Or <and...@databricks.com>


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b8db84c5
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b8db84c5
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b8db84c5

Branch: refs/heads/branch-1.3
Commit: b8db84c5b6a9d7d538d066f5a84a50ac8c8f9b41
Parents: 485b919
Author: 许鹏 <peng...@fraudmetrix.cn>
Authored: Thu Feb 26 23:05:56 2015 -0800
Committer: Andrew Or <and...@databricks.com>
Committed: Thu Feb 26 23:06:42 2015 -0800

----------------------------------------------------------------------
 docs/spark-standalone.md | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/b8db84c5/docs/spark-standalone.md
----------------------------------------------------------------------
diff --git a/docs/spark-standalone.md b/docs/spark-standalone.md
index 5c6084f..74d8653 100644
--- a/docs/spark-standalone.md
+++ b/docs/spark-standalone.md
@@ -222,8 +222,7 @@ SPARK_WORKER_OPTS supports the following system properties:
   <td>false</td>
   <td>
     Enable periodic cleanup of worker / application directories.  Note that 
this only affects standalone
-    mode, as YARN works differently. Applications directories are cleaned up 
regardless of whether
-    the application is still running.
+    mode, as YARN works differently. Only the directories of stopped 
applications are cleaned up.
   </td>
 </tr>
 <tr>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Reply via email to