spark git commit: [SPARK-17010][MINOR][DOC] Wrong description in memory management document
Repository: spark Updated Branches: refs/heads/master 665e17532 -> 7a6a3c3fb [SPARK-17010][MINOR][DOC] Wrong description in memory management document ## What changes were proposed in this pull request? change the remain percent to right one. ## How was this patch tested? Manual review Author: Tao WangCloses #14591 from WangTaoTheTonic/patch-1. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7a6a3c3f Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7a6a3c3f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/7a6a3c3f Branch: refs/heads/master Commit: 7a6a3c3fbcea889ca20beae9d4198df2fe53bd1b Parents: 665e175 Author: Tao Wang Authored: Wed Aug 10 22:30:18 2016 -0700 Committer: Reynold Xin Committed: Wed Aug 10 22:30:18 2016 -0700 -- docs/tuning.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/spark/blob/7a6a3c3f/docs/tuning.md -- diff --git a/docs/tuning.md b/docs/tuning.md index 1ed1409..976f2eb 100644 --- a/docs/tuning.md +++ b/docs/tuning.md @@ -115,7 +115,7 @@ Although there are two relevant configurations, the typical user should not need as the default values are applicable to most workloads: * `spark.memory.fraction` expresses the size of `M` as a fraction of the (JVM heap space - 300MB) -(default 0.6). The rest of the space (25%) is reserved for user data structures, internal +(default 0.6). The rest of the space (40%) is reserved for user data structures, internal metadata in Spark, and safeguarding against OOM errors in the case of sparse and unusually large records. * `spark.memory.storageFraction` expresses the size of `R` as a fraction of `M` (default 0.5). - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
spark git commit: [SPARK-17010][MINOR][DOC] Wrong description in memory management document
Repository: spark Updated Branches: refs/heads/branch-2.0 d3a30d2f0 -> 1e4013571 [SPARK-17010][MINOR][DOC] Wrong description in memory management document ## What changes were proposed in this pull request? change the remain percent to right one. ## How was this patch tested? Manual review Author: Tao WangCloses #14591 from WangTaoTheTonic/patch-1. (cherry picked from commit 7a6a3c3fbcea889ca20beae9d4198df2fe53bd1b) Signed-off-by: Reynold Xin Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1e401357 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/1e401357 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1e401357 Branch: refs/heads/branch-2.0 Commit: 1e4013571b18ca337ea664838f7f8e781c8de7aa Parents: d3a30d2 Author: Tao Wang Authored: Wed Aug 10 22:30:18 2016 -0700 Committer: Reynold Xin Committed: Wed Aug 10 22:30:25 2016 -0700 -- docs/tuning.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/spark/blob/1e401357/docs/tuning.md -- diff --git a/docs/tuning.md b/docs/tuning.md index 1ed1409..976f2eb 100644 --- a/docs/tuning.md +++ b/docs/tuning.md @@ -115,7 +115,7 @@ Although there are two relevant configurations, the typical user should not need as the default values are applicable to most workloads: * `spark.memory.fraction` expresses the size of `M` as a fraction of the (JVM heap space - 300MB) -(default 0.6). The rest of the space (25%) is reserved for user data structures, internal +(default 0.6). The rest of the space (40%) is reserved for user data structures, internal metadata in Spark, and safeguarding against OOM errors in the case of sparse and unusually large records. * `spark.memory.storageFraction` expresses the size of `R` as a fraction of `M` (default 0.5). - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org