Parth Chandra created SPARK-38169:
-------------------------------------
Summary: Use OffHeap memory if configured in vectorized
DeltaByteArray reader
Key: SPARK-38169
URL: https://issues.apache.org/jira/browse/SPARK-38169
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.1
Reporter: Parth Chandra
The VectorizedDeltaByteArray reader allocates some vectors for internal use
that are allocated off of heap memory. Depending on the configuration, the
vectors should be either on-heap or off-heap.
To support off-heap vectors, the vectorized readers must be made closable and
memory allocated for the vectors must be freed on close.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
