Jackie-Jiang commented on issue #8750: URL: https://github.com/apache/pinot/issues/8750#issuecomment-1328330848
For this column, the length of the values are quite skewed (from 20 to 512). The default string dictionary stores values with fixed length (shorter values are padded to be the same length), so the size of the dictionary is 8 (header) + 512 * 776088 = 397357064. Instead, we can store it using var-length dictionary, which has a 4 bytes overhead per entry, but avoid padding the values. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
