mcvsubbu commented on issue #3978: The segments are stored in memory URL: https://github.com/apache/incubator-pinot/issues/3978#issuecomment-473982286 All segments of a table are divided among the tenant instances that host the table. If a server has a segment to serve, it will be loaded into memory. You can use rest commands on the controller to see the idealstate of a table, and that will indicate to you the servers that host each segment. It is up to you how you want to reduce cost. You can load the segments in "HEAP" mode, you just need to make sure that the maxDirectMemory argument to the jvm is sufficiently large so that the segments are loaded without OOM errors. You can load the segments in MMAP mode, in which case the segments are paged in from disk and Pinot lets the Operating System handle paging of segments in and out.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
