Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19617#discussion_r147995716 --- Diff: python/pyspark/sql/functions.py --- @@ -2185,6 +2185,12 @@ def udf(f=None, returnType=StringType()): duplicate invocations may be eliminated or the function may even be invoked more times than it is present in the query. + .. note:: The user-defined functions do not support conditional execution by using them with --- End diff -- Yes. I think this is a valid worry. Thanks.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org