Shixiong Zhu created SPARK-18991:
------------------------------------
Summary: Change ContextCleaner.referenceBuffer to
ConcurrentHashMap to make it faster
Key: SPARK-18991
URL: https://issues.apache.org/jira/browse/SPARK-18991
Project: Spark
Issue Type: Improvement
Components: Spark Core
Reporter: Shixiong Zhu
Assignee: Shixiong Zhu
Right now `ContextCleaner.referenceBuffer` is ConcurrentLinkedQueue and the
time complexity of the `remove` action is O(n). It can be changed to use
ConcurrentHashMap whose `remove` is O(1).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
