Joe McDonnell created IMPALA-15316:
--------------------------------------
Summary: Support huge pages when tcmalloc's aggressive decommit is
off
Key: IMPALA-15316
URL: https://issues.apache.org/jira/browse/IMPALA-15316
Project: IMPALA
Issue Type: Task
Components: Backend
Affects Versions: Impala 5.0.0
Reporter: Joe McDonnell
In IMPALA-14900, we added support for turning off TCMalloc's aggressive
decommit mode. This came at the cost of disabling madvise_huge_pages for that
configuration. Without aggressive decommit, TCMalloc could break up huge pages
and reuse smaller chunks. This could make the memory usage deceptive.
We can support huge pages with aggressive decommit off by mmap them ourselves
in the SystemAllocator. We would need to track this memory usage and count it
toward the process limit.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]