[ https://issues.apache.org/jira/browse/PARQUET-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260287#comment-16260287 ]
ASF GitHub Bot commented on PARQUET-970: ---------------------------------------- advancedxy opened a new pull request #419: PARQUET-970: Add Lz4 and Zstd compression codec URL: https://github.com/apache/parquet-cpp/pull/419 Looks like parquet-format already adds support for Lz4 and Zstd, see https://github.com/apache/parquet-format/pull/70 This patch adds support for Lz4 and Zstd compression codec in parquet-cpp. Two things pending determining: 1. How do we update parquet.thrift? 2. Is the benchmark code needed? Additionally, Zstd's compression speed and ratio varies largely for different compression levels, we may want to add the compression level parameter for Zstd codec. cc @wesm and @xhochy ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Add ZstdCompressor for parquet-cpp compressor interface > ------------------------------------------------------- > > Key: PARQUET-970 > URL: https://issues.apache.org/jira/browse/PARQUET-970 > Project: Parquet > Issue Type: New Feature > Components: parquet-cpp > Reporter: Xianjin YE > Assignee: Xianjin YE > > https://github.com/facebook/zstd looks quite promising, I'd like to add a > compressor in parquet-cpp. -- This message was sent by Atlassian JIRA (v6.4.14#64029)