alamb commented on PR #18820: URL: https://github.com/apache/datafusion/pull/18820#issuecomment-3582785573
> > In my mind the config flag is required in order to allow people to opt out of the new behavior > > so if the behavior changed, we want by default to opt out of it for this release, no? or only for this pr, I am not sure The default behavior of the parquet reader has changed in arrow-rs (in theory it will always be better). The only usecase I have is adding an "escape valve" so that if someone hit an issue with the new code, there was a way to turn if off without requiring a fork I don't (yet) have any reason to believe the new behavior isn't always better nor any usecase for tuning the row selector policy from DataFusion -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
