blacha opened a new pull request, #47086:
URL: https://github.com/apache/arrow/pull/47086

   ### Rationale for this change
   
   The default value for ZSTD compression is very low (level 1) this number is 
not aligned to the other compression types for example GZIP and Brotli both 
have relatively high levels of level 9 and 8 respectively
   
   ### Are these changes tested?
   
   I have been manually testing the compression levels with osgeo/gdal's 
`compression_level` flag
   
   ### Are there any user-facing changes?
   
   This will change the default compression speed for ZSTD to be slightly 
slower (500ms -> 1.5 seconds compared with brotli's 6 seconds), but give 
significantly smaller files (approx 30-40% smaller than level 1) on my 110MB 
test parquet
   
   Fixes: https://github.com/OSGeo/gdal/issues/12750
   Fixes: https://github.com/apache/arrow/issues/47085
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to