[ https://issues.apache.org/jira/browse/SPARK-23306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-23306: ------------------------------------ Assignee: Apache Spark > Race condition in TaskMemoryManager > ----------------------------------- > > Key: SPARK-23306 > URL: https://issues.apache.org/jira/browse/SPARK-23306 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 2.2.1 > Reporter: Zhan Zhang > Assignee: Apache Spark > Priority: Minor > > There is race condition in TaskMemoryManger, which may cause OOM. > The memory released may be taken by another task because there is a gap > between releaseMemory and acquireMemory, e.g., UnifiedMemoryManager, causing > the OOM. if the current is the only one that can perform spill. It can happen > to BytesToBytesMap, as it only spill required bytes. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org