t0mpere commented on issue #11659:
URL: https://github.com/apache/pinot/issues/11659#issuecomment-1733256695
Ok so misunderstanding from my side. I thought both indexes could be
disabled and the column still be used in AGG fuctions. I'm trying to reduce the
space used by this column. It's very high cardinality and it contains a 12 bit
HLL state. Something like ```0000000c00000aac000000000<many zeros...>00``` what
do you think would be the best configuration for a column like this?
What I've tried so far:
- no dictionary = 2GB fwd index
- raw = ~1GB fwd index + dictionary
- inverted = ~1GB fwd index
I'm wandering if I'm doing something wrong here, how would I enable lz4
compression on the fwd index? `"noDictionaryConfig": {"hll_column": "LZ4"}`
seem to have no effects after a reload. Do I have to refresh all segments to
make it work? Is it because it's a metrics column? What if i switch to a
dimension column, would it enable lz4 by default? (seems to be the case from
the documentation). Also is there a way to check if compression is actually
used?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
