alamb commented on issue #16643: URL: https://github.com/apache/datafusion/issues/16643#issuecomment-3152429809
> > the scripts do not set any memory limit > > setting memory limit = memory available on machine sounds reasonable to me and would explain OOMs, but I'm not sure if that's in the spirit of clickbench or not. if that is the issue having a default memory limit equal to memory available on machine sounds reasonable for datafusion-cli. Yeah, I prefer using only the default settings in `datafusion-cli` (and DataFusion) for ClickBench to guard against [Benchmaxxing](https://x.com/andrewlamb1111/status/1952386263450841233) I agree setting the datafusion-cli memory limit to the available memory on the machine seems reasonable to me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
