westonpace commented on issue #36161:
URL: https://github.com/apache/arrow/issues/36161#issuecomment-1632936333
Things I would think to investigate:
* It's possible that bytes_allocated is 0 and arrow has "freed" the memory
which gives it back to the allocator (jemalloc, malloc). These allocators do
not necessarily give the memory back to the operating system (either due to
fragmentation or because it is saving the memory to use again later). Do you
know if you are using jemalloc or the system allocator?
* It's possible that more memory is being used because of the
`library(dplyr)`, `library(arrow)`, `library(pryr)` commands.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
