Repository: spark Updated Branches: refs/heads/branch-1.6 069591799 -> a98cac26f
[SPARK-11670] Fix incorrect kryo buffer default value in docs <img width="931" alt="screen shot 2015-11-11 at 1 53 21 pm" src="https://cloud.githubusercontent.com/assets/2133137/11108261/35d183d4-889a-11e5-9572-85e9d6cebd26.png"> Author: Andrew Or <and...@databricks.com> Closes #9638 from andrewor14/fix-kryo-docs. (cherry picked from commit cf38fc7551f4743958c2fdc7931affd672755e68) Signed-off-by: Andrew Or <and...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a98cac26 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a98cac26 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/a98cac26 Branch: refs/heads/branch-1.6 Commit: a98cac26fc5213a67ea515db44f3467662299ff2 Parents: 0695917 Author: Andrew Or <and...@databricks.com> Authored: Thu Nov 12 15:47:29 2015 -0800 Committer: Andrew Or <and...@databricks.com> Committed: Thu Nov 12 15:47:39 2015 -0800 ---------------------------------------------------------------------- docs/tuning.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/a98cac26/docs/tuning.md ---------------------------------------------------------------------- diff --git a/docs/tuning.md b/docs/tuning.md index 6936912..879340a 100644 --- a/docs/tuning.md +++ b/docs/tuning.md @@ -61,8 +61,8 @@ The [Kryo documentation](https://github.com/EsotericSoftware/kryo) describes mor registration options, such as adding custom serialization code. If your objects are large, you may also need to increase the `spark.kryoserializer.buffer` -config property. The default is 2, but this value needs to be large enough to hold the *largest* -object you will serialize. +[config](configuration.html#compression-and-serialization). This value needs to be large enough +to hold the *largest* object you will serialize. Finally, if you don't register your custom classes, Kryo will still work, but it will have to store the full class name with each object, which is wasteful. --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org