[jira] [Commented] (SPARK-36211) type check fails for `F.udf(...).asNonDeterministic()
[ https://issues.apache.org/jira/browse/SPARK-36211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17387834#comment-17387834 ] Maciej Szymkiewicz commented on SPARK-36211: Issue resolved by pull request 33399 https://github.com/apache/spark/pull/33399 > type check fails for `F.udf(...).asNonDeterministic() > - > > Key: SPARK-36211 > URL: https://issues.apache.org/jira/browse/SPARK-36211 > Project: Spark > Issue Type: Bug > Components: PySpark >Affects Versions: 3.1.2 >Reporter: Luran He >Priority: Minor > Original Estimate: 48h > Remaining Estimate: 48h > > The following code should type-check, but doesn't: > > {{import uuid}} > {{pyspark.sql.functions as F}} > {{my_udf = F.udf(lambda: str(uuid.uuid4())).asNondeterministic()}} > > In {{python/pyspark/sql/functions.pyi}} the {{udf}} signature is wrong -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-36211) type check fails for `F.udf(...).asNonDeterministic()
[ https://issues.apache.org/jira/browse/SPARK-36211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383385#comment-17383385 ] Apache Spark commented on SPARK-36211: -- User 'luranhe' has created a pull request for this issue: https://github.com/apache/spark/pull/33399 > type check fails for `F.udf(...).asNonDeterministic() > - > > Key: SPARK-36211 > URL: https://issues.apache.org/jira/browse/SPARK-36211 > Project: Spark > Issue Type: Bug > Components: PySpark >Affects Versions: 3.1.2 >Reporter: Luran He >Priority: Minor > Original Estimate: 48h > Remaining Estimate: 48h > > The following code should type-check, but doesn't: > > {{import uuid}} > {{pyspark.sql.functions as F}} > {{my_udf = F.udf(lambda: str(uuid.uuid4())).asNondeterministic()}} > > In {{python/pyspark/sql/functions.pyi}} the {{udf}} signature is wrong -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org