adriangb commented on PR #22024: URL: https://github.com/apache/datafusion/pull/22024#issuecomment-4451838847
> fetching the ParquetMetadata yourself before creating the plan This is the part I wanted to avoid (yes we can cache some of it but it is duplicate work) :( > Yeah, I agree we would have to try it out and see how much commonality there is and if this idea is actually possible. I also realize it is not really fair to make you test this out given it is some crazy idea I came up with All good. I agree with you in principle and I'm willing to give it a shot. Just can't promise it will work / I may come back and say I spent some time on it and couldn't get to anywhere nice. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
