Dandandan commented on PR #7692: URL: https://github.com/apache/arrow-datafusion/pull/7692#issuecomment-1741682796
> I think defaulting to basic and fast block level compression is much less surprising than NO compression for most users and therefore I think this is a good change. > > While there may be corner cases where no compression is desired as @tustvold mentions, I think they are somewhat specialized > > Maybe some other contributors have opinions on the matter (@Dandandan perhaps?) I agree. Parquet is designed for block compression. And people want to optimize for long term storage cost as well. Zstd is probably one of the better defaults for use cases @devinjdangelo describes (data pipelines). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
