alamb commented on PR #17275: URL: https://github.com/apache/datafusion/pull/17275#issuecomment-3274533057
> > So what I think is needed is here is a way to turn this setting off via a DataFusion setting as well, which is what I was trying to say with > > > . Add new Parquet option to control the size of the predicate cache > > > > > > Let me give this a try and see if we can get it working better > > Thanks @alamb, a config in datafusion would be ideal. @nuno-faria -- I added a config flag Can you possibly test that if you set ```sql set datafusion.execution.parquet.max_predicate_cache_size = 0 ``` That the I/O goes back to what you it was like in 56.0.0? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
