chrajeshbabu opened a new issue, #15093:
URL: https://github.com/apache/pinot/issues/15093
Currently when the buffer size required for sort and aggregate the records
require for star tree building above 500mb using MMAP based files used which is
making star tree building slower compared to direct memory usage when the
number of docs and dimensions are higher. Would be better to make it
configurable so based on the available memory and number of segments to build
the startree.
// If the temporary buffer needed is larger than 500M, use MMAP, otherwise
use DIRECT
private static final long MMAP_SIZE_THRESHOLD = 500_000_000;
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
