sunchao commented on PR #4884: URL: https://github.com/apache/arrow-rs/pull/4884#issuecomment-1743375561
> Also, I don't understand the "replaced lz4 with lz4hadoopcodec" comment. I probably am missing something. > cc @sunchao who might have more context on parquet / compression formats (or know someone who does) @alamb There are now two LZ4 compression codes in Parquet: the old/deprecated "Hadoop" [LZ4](https://github.com/apache/parquet-format/blob/master/Compression.md#lz4) and the new `LZ4_RAW`, due to the framing issue @tustvold mentioned. There's an email thread and discussions on this: https://www.mail-archive.com/dev@parquet.apache.org/msg14529.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
