Zhan Zhang created SPARK-23306:
----------------------------------
Summary: Race condition in TaskMemoryManager
Key: SPARK-23306
URL: https://issues.apache.org/jira/browse/SPARK-23306
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.2.1
Reporter: Zhan Zhang
There is race condition in TaskMemoryManger, which may cause OOM.
The memory released may be taken by another task because there is a gap between
releaseMemory and acquireMemory, e.g., UnifiedMemoryManager, causing the OOM.
if the current is the only one that can perform spill. It can happen to
BytesToBytesMap, as it only spill required bytes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
