Andrew Or created SPARK-10783:
---------------------------------
Summary: Do track the pointer array in UnsafeInMemorySorter
Key: SPARK-10783
URL: https://issues.apache.org/jira/browse/SPARK-10783
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.6.0, 1.5.1
Reporter: Andrew Or
Priority: Blocker
SPARK-10474 (https://github.com/apache/spark/pull/8888) removed the pointer
array tracking because `TungstenAggregate` would fail under memory pressure.
However, this is somewhat of a hack that we should fix in the right way in
1.6.0 to ensure we don't OOM because of this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
