[
https://issues.apache.org/jira/browse/SPARK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349646#comment-14349646
]
Nishkam Ravi commented on SPARK-6142:
-------------------------------------
[~zsxwing] Yes, the 10-12% regression was very consistent and is gone after
the revert by Andrew. You can reproduce it with PageRank with a large enough
input data set so that there is spilling to disk.
[~srowen] An object containing finalizer creates significant overhead for
GC/JVM even if the finalizer method contains nothing in it.
> 10-12% Performance regression with "finalize"
> ---------------------------------------------
>
> Key: SPARK-6142
> URL: https://issues.apache.org/jira/browse/SPARK-6142
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.3.0
> Reporter: Nishkam Ravi
>
> 10-12% performance regression in PageRank (and potentially other workloads)
> caused due to the use of finalize in ExternalAppendOnlyMap. Introduced by a
> commit on Feb 19th.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
