Hi team, I came across a recent string compression algorithm called OnPair and spent some time experimenting with it as a Parquet encoding, benchmarked against FSST, DELTA_LENGTH_BYTE_ARRAY, dictionary encoding, and the usual zstd/lz4/snappy page compression across 30 string corpora.
Report <https://docs.google.com/document/d/1cctFqNVh_Ul6huiXyMeFWNaGhZba0fMJ/edit> Short version: it trades encode speed for ratio and decode speed — it decodes faster than every compressed alternative measured and wins ratio on most text-heavy columns, but its training pass makes encode substantially slower. Apologies in advance for slow replies — I'm travelling. Best Prateek
