Riza Suminto created IMPALA-11104:
-------------------------------------
Summary: Revisit computeMinScalarColumnMemReservation for ORC
async IO
Key: IMPALA-11104
URL: https://issues.apache.org/jira/browse/IMPALA-11104
Project: IMPALA
Issue Type: Improvement
Components: Frontend
Reporter: Riza Suminto
HdfsScanNode.computeMinScalarColumnMemReservation has estimate to reduce memory
reservation for a column lower than DEFAULT_COLUMN_SCAN_RANGE_RESERVATION (4MB).
[https://github.com/apache/impala/blob/df528fe/fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java#L2226-L2235]
This estimate is based on Parquet table. We need to revisit this estimate for
ORC table.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
