lidavidm opened a new issue, #15203: URL: https://github.com/apache/arrow/issues/15203
### Describe the enhancement requested Their reader counterparts support compression, but the writers don't give you any way to enable it. Furthermore, the design of the compression API means that enabling this will require modifying several classes: the compression API closes the input buffer after compression, but this runs contrary to the expectation of VectorUnloader, which isn't supposed to mutate the source VectorSchemaRoot. (Arguably, this is a flaw in the VectorUnloader API that prevents efficient memory usage, but fixing _that_ would mean invalidating essentially all current Arrow Java code.) Also there are various other flaws (e.g. VectorUnloader says it is OK to pass a null compression codec but will crash if you do so because it assumes the codec is never null.) See also: #15102 It is possible to manually generate compressed data yourself in Java, but this requires taping together several low-level APIs yourself. ### Component(s) Java -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
