[ https://issues.apache.org/jira/browse/SPARK-41850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ruifeng Zheng resolved SPARK-41850. ----------------------------------- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39376 [https://github.com/apache/spark/pull/39376] > Fix `isnan` function > -------------------- > > Key: SPARK-41850 > URL: https://issues.apache.org/jira/browse/SPARK-41850 > Project: Spark > Issue Type: Sub-task > Components: Connect > Affects Versions: 3.4.0 > Reporter: Sandeep Singh > Priority: Major > Fix For: 3.4.0 > > > {code:java} > File > "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/functions.py", > line 288, in pyspark.sql.connect.functions.isnan > Failed example: > df.select("a", "b", isnan("a").alias("r1"), > isnan(df.b).alias("r2")).show() > Expected: > +---+---+-----+-----+ > | a| b| r1| r2| > +---+---+-----+-----+ > |1.0|NaN|false| true| > |NaN|2.0| true|false| > +---+---+-----+-----+ > Got: > +----+----+-----+-----+ > | a| b| r1| r2| > +----+----+-----+-----+ > | 1.0|null|false|false| > |null| 2.0|false|false| > +----+----+-----+-----+ > <BLANKLINE>{code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org