psavalle commented on code in PR #58201:
URL: https://github.com/apache/spark/pull/58201#discussion_r3831274183
##########
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FilterPushdownSuite.scala:
##########
@@ -202,6 +202,68 @@ class FilterPushdownSuite extends PlanTest {
comparePlans(optimized, correctAnswer)
}
+ test("SPARK-39481: avoid evaluating scalar Python UDFs twice") {
Review Comment:
Good point, I was looking at both, let me use SPARK-47672 everywhere since
that is the one for the main mechanism (and we address not just pandas, but all
Python UDFs).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
