[ https://issues.apache.org/jira/browse/PARQUET-678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195461#comment-16195461 ]
Ryan Blue commented on PARQUET-678: ----------------------------------- I think custom codecs is a bad idea. It will only cause compatibility issues to support arbitrary codecs, so I recommend we implement a small set. Probably just adding brotli and zstd. > Allow for custom compression codecs > ----------------------------------- > > Key: PARQUET-678 > URL: https://issues.apache.org/jira/browse/PARQUET-678 > Project: Parquet > Issue Type: Wish > Reporter: Steven Anton > Priority: Minor > > I understand that the list of accepted compression codecs is explicity > limited to uncompressed, snappy, gzip, and lzo. (See > parquet.hadoop.metadata.CompressionCodecName.java) Is there a reason for > this? Or is there an easy workaround? On the surface it seems like an > unnecessary restriction. > I ask because I have written a custom codec to implement encryption and I'm > unable to use it with Parquet, which is a real shame because it is the main > storage format I was hoping to use. > Other thoughts on how to implement encryption in Parquet with this limitation? -- This message was sent by Atlassian JIRA (v6.4.14#64029)