voltcode opened a new issue #464: URL: https://github.com/apache/arrow-datafusion/issues/464
I browsed the readme and slides but failed to grok - can DataFusion handle larger than RAM datasets? In other words, if I register multiple parquet files, which size exceeds RAM, will they get all loaded into memory or will DataFusion carefully manage memory buffers to avoid out of memory exception? As an extension of this question, I'd like to ask for pointers on how can one tune DataFusion resource usage if necessary ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
