mbutrovich commented on issue #21080: URL: https://github.com/apache/datafusion/issues/21080#issuecomment-4634493813
> FWIW I think [@AdamGS](https://github.com/AdamGS) found a slowdown in parsing metadata due to a new cap on the amount of memory used for metadata caching. Perhaps something similar is affecting comet. If so, we should perhaps highlight this more aggressively in the upgrade guide / change the default value > > * [Release DataFusion `54.0.0` (Apr 2026 / May 2026) #21080 (comment)](https://github.com/apache/datafusion/issues/21080#issuecomment-4517509250) I'm digging into this but I don't think Comet uses the `ListingTable` API that @AdamGS mentioned, so not sure it's the issue Comet is hitting. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
