m-v-w opened a new pull request, #46190:
URL: https://github.com/apache/arrow/pull/46190

   ### Rationale for this change
   `ArrowStreamWriter` should not make large heap allocations for temporary 
buffers. Pooled buffers should be used. 
   All allocations made by `MemoryAllocator` should be disposed before they are 
finalized.
   
   ### What changes are included in this PR?
   
   - `ArrowStreamWriter` makes sure all temporary buffers are disposed.
   - `ArrowStreamWriter` uses `MemoryAllocator` for decompression buffers 
instead of `MemoryStream`.
   - Added `TryCompress` method to `ICompressionCodec` and implemented it.
   
   ### Are these changes tested?
   
   Yes. 
   - `MemoryOwnerDisposal` in 
`Apache.Arrow.Compression.Tests.ArrowStreamWriterTests`
   - `MemoryOwnerDisposalSlicedArray` in 
`Apache.Arrow.Tests.ArrowStreamWriterTests`
   
   ### Are there any user-facing changes?
   
   Yes. `ICompressionCodec` requires the implementation of a new method 
'TryCompress'
   
   **This PR includes breaking changes to public APIs.**
   
   `ICompressionCodec` requires the implementation of a new method 'TryCompress'
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to