Re: java arrow: memory management with multiple references to same batch

2021-01-29 Thread Steve Kim
I recommend that you direct these questions to u...@arrow.apache.org (https://mail-archives.apache.org/mod_mbox/arrow-user/). On Fri, Jan 29, 2021 at 7:07 AM Joris Peeters wrote: > > Hello, > > I'm writing an HTTP server in Java that provides Arrow data to users. For > performance, I keep the mo

java arrow: memory management with multiple references to same batch

2021-01-29 Thread Joris Peeters
Hello, I'm writing an HTTP server in Java that provides Arrow data to users. For performance, I keep the most-recently-used Arrow batches in an in-memory cache. A batch is wrapped in a "DataBatch" Java object containing the schema and field vectors. I'm looking for a good memory management strate