peter-toth commented on PR #57357: URL: https://github.com/apache/spark/pull/57357#issuecomment-5015792760
Thanks for the review @cloud-fan! Since not pushing non-deterministic filters is a behavior change — some sources were allowed to evaluate some non-deterministic predicates — I added a legacy flag `spark.sql.legacy.allowNonDeterministicV2FilterPushDown` (default off) to restore the old behavior if needed. I also use that flag in the H2 `RAND(1) < bonus` pushdown test so it runs both ways and stays green. It's in a separate follow-up commit on top of the one you approved. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
